2023-10-05T19:38:47.058 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T19:38:47.058 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi --verbose --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} --archive /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765 -- /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765/orig.config.yaml 2023-10-05T19:38:47.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T19:38:47.163 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765 branch: wip-yuri2-testing-2023-10-04-1333-quincy description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: yweinste@redhat.com first_in_suite: false job_id: '7411765' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri2-testing-2023-10-04-1333-quincy ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd objectstore: filestore osd sloppy crc: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true workunit: branch: wip-yuri2-testing-2023-10-04-1333-quincy sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 880 sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 sleep_before_teardown: 0 subset: 111/12000 suite: rgw suite_branch: wip-yuri2-testing-2023-10-04-1333-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_487ffcb5ddb60d29c5688d1a457e812b1b697b90/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 targets: smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_14:30:58 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-05T19:38:47.163 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_487ffcb5ddb60d29c5688d1a457e812b1b697b90/qa; will attempt to use it 2023-10-05T19:38:47.164 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_487ffcb5ddb60d29c5688d1a457e812b1b697b90/qa/tasks 2023-10-05T19:38:47.164 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-05T19:38:47.166 INFO:teuthology.task.internal:Checking packages... 2023-10-05T19:38:47.190 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '487ffcb5ddb60d29c5688d1a457e812b1b697b90' 2023-10-05T19:38:47.190 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-05T19:38:47.190 INFO:teuthology.packaging:ref: None 2023-10-05T19:38:47.190 INFO:teuthology.packaging:tag: None 2023-10-05T19:38:47.190 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-10-04-1333-quincy 2023-10-05T19:38:47.190 INFO:teuthology.packaging:sha1: 487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T19:38:47.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri2-testing-2023-10-04-1333-quincy 2023-10-05T19:38:47.409 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1278-g487ffcb5-1focal 2023-10-05T19:38:47.409 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-05T19:38:47.416 INFO:teuthology.task.internal:no buildpackages task found 2023-10-05T19:38:47.416 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-05T19:38:47.424 INFO:teuthology.task.internal:Saving configuration 2023-10-05T19:38:47.435 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-05T19:38:47.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T19:38:47.465 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 19:32:02.569276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-05T19:38:47.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 19:32:02.567700', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-05T19:38:47.490 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-05T19:38:47.497 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2023-10-05T19:38:47.497 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-05T19:38:47.497 INFO:teuthology.run_tasks:Running task console_log... 2023-10-05T19:38:47.568 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fba81dd6040>, signals=[15]) 2023-10-05T19:38:47.569 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-05T19:38:47.575 INFO:teuthology.task.internal:Opening connections... 2023-10-05T19:38:47.575 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2023-10-05T19:38:47.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:38:47.624 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T19:38:47.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:38:47.672 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-05T19:38:47.678 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-10-05T19:38:47.704 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-10-05T19:38:47.704 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-10-05T19:38:47.709 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-10-05T19:38:47.709 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-05T19:38:47.709 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-10-05T19:38:47.710 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-10-05T19:38:47.710 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-05T19:38:47.710 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="20.04" 2023-10-05T19:38:47.710 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-05T19:38:47.710 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-05T19:38:47.710 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-05T19:38:47.710 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-05T19:38:47.710 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=focal 2023-10-05T19:38:47.710 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=focal 2023-10-05T19:38:47.711 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-10-05T19:38:47.732 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-10-05T19:38:47.748 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-10-05T19:38:47.749 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-05T19:38:47.755 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-05T19:38:47.756 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-10-05T19:38:47.756 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-10-05T19:38:47.756 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-10-05T19:38:47.782 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-05T19:38:47.789 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-05T19:38:47.794 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-05T19:38:47.795 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2023-10-05T19:38:47.797 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2023-10-05T19:38:47.802 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-05T19:38:47.808 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-05T19:38:47.808 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2023-10-05T19:38:47.810 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2023-10-05T19:38:47.863 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-05T19:38:47.917 INFO:teuthology.run_tasks:Running task kernel... 2023-10-05T19:38:47.931 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-05T19:38:47.931 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-05T19:38:47.932 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T19:38:47.932 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T19:38:47.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:38:47.938 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-10-05T19:38:47.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:38:47.939 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-10-05T19:38:47.945 INFO:teuthology.orchestra.run.smithi118.stdout:5.4.0-124-generic 2023-10-05T19:38:47.945 INFO:teuthology.task.kernel:Running kernel on smithi118: 5.4.0-124-generic 2023-10-05T19:38:47.946 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get clean 2023-10-05T19:38:47.947 INFO:teuthology.orchestra.run.smithi167.stdout:5.4.0-124-generic 2023-10-05T19:38:47.947 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.4.0-124-generic 2023-10-05T19:38:47.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get clean 2023-10-05T19:38:48.162 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2023-10-05T19:38:48.164 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get update 2023-10-05T19:38:48.315 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-05T19:38:48.316 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-05T19:38:48.316 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-05T19:38:48.348 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-05T19:38:48.348 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-05T19:38:48.348 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-05T19:38:48.378 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-05T19:38:48.429 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-05T19:38:48.697 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [659 kB] 2023-10-05T19:38:48.732 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,495 kB] 2023-10-05T19:38:48.801 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,495 kB] 2023-10-05T19:38:48.835 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,889 kB] 2023-10-05T19:38:48.842 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [389 kB] 2023-10-05T19:38:48.846 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-05T19:38:48.846 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,257 kB] 2023-10-05T19:38:48.850 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [659 kB] 2023-10-05T19:38:48.855 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [389 kB] 2023-10-05T19:38:48.860 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-05T19:38:48.860 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-05T19:38:48.862 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,257 kB] 2023-10-05T19:38:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-05T19:38:48.864 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [316 kB] 2023-10-05T19:38:48.867 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-05T19:38:48.867 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-05T19:38:48.870 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-05T19:38:48.872 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-05T19:38:48.876 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-05T19:38:48.878 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-05T19:38:48.878 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-05T19:38:48.878 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-05T19:38:48.879 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [316 kB] 2023-10-05T19:38:48.881 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-05T19:38:48.881 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-05T19:38:48.887 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-05T19:38:48.892 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-05T19:38:48.893 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-05T19:38:48.893 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-05T19:38:48.894 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-05T19:38:48.894 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-05T19:38:48.894 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-05T19:38:48.895 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-05T19:38:48.908 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-05T19:38:48.933 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-05T19:38:48.942 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-05T19:38:48.946 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-05T19:38:48.946 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-05T19:38:48.950 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,889 kB] 2023-10-05T19:38:48.962 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-05T19:38:48.963 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-05T19:38:48.965 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-05T19:38:48.965 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-05T19:38:48.972 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-05T19:38:48.977 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-05T19:38:48.981 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-05T19:38:48.981 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-05T19:38:48.981 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-05T19:38:48.996 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-05T19:38:48.996 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-05T19:38:48.997 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-05T19:38:48.997 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-05T19:38:48.997 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-05T19:38:48.997 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-05T19:38:49.000 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-05T19:38:49.000 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-05T19:38:49.013 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-05T19:38:49.013 INFO:teuthology.orchestra.run.smithi118.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-05T19:38:49.014 INFO:teuthology.orchestra.run.smithi118.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-05T19:38:49.019 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-05T19:38:49.019 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-05T19:38:49.022 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-05T19:38:49.022 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-05T19:38:49.031 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-05T19:38:49.038 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-05T19:38:49.040 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-05T19:38:49.040 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-05T19:38:49.041 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-05T19:38:49.041 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-05T19:38:49.041 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-05T19:38:49.060 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-05T19:38:49.061 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-05T19:38:49.061 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-05T19:38:49.061 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-05T19:38:49.080 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-05T19:38:49.080 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-05T19:38:52.619 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 17.6 MB in 3s (6,890 kB/s) 2023-10-05T19:38:52.769 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 17.6 MB in 3s (7,003 kB/s) 2023-10-05T19:38:54.070 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2023-10-05T19:38:54.097 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-05T19:38:54.171 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2023-10-05T19:38:54.275 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-10-05T19:38:54.299 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-05T19:38:54.371 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2023-10-05T19:38:54.372 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2023-10-05T19:38:54.378 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-10-05T19:38:54.554 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2023-10-05T19:38:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-05T19:38:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-05T19:38:54.555 INFO:teuthology.orchestra.run.smithi167.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-05T19:38:54.556 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2023-10-05T19:38:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-05T19:38:54.556 INFO:teuthology.orchestra.run.smithi167.stdout:Recommended packages: 2023-10-05T19:38:54.556 INFO:teuthology.orchestra.run.smithi167.stdout: thermald 2023-10-05T19:38:54.583 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2023-10-05T19:38:54.583 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2023-10-05T19:38:54.611 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2023-10-05T19:38:54.611 INFO:teuthology.orchestra.run.smithi167.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-05T19:38:54.611 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-05T19:38:54.611 INFO:teuthology.orchestra.run.smithi167.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-05T19:38:54.612 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages will be upgraded: 2023-10-05T19:38:54.613 INFO:teuthology.orchestra.run.smithi167.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-05T19:38:54.666 INFO:teuthology.orchestra.run.smithi167.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-05T19:38:54.666 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 77.0 MB of archives. 2023-10-05T19:38:54.666 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-05T19:38:54.666 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-05T19:38:54.778 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2023-10-05T19:38:54.778 INFO:teuthology.orchestra.run.smithi118.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-05T19:38:54.778 INFO:teuthology.orchestra.run.smithi118.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-05T19:38:54.778 INFO:teuthology.orchestra.run.smithi118.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-05T19:38:54.779 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2023-10-05T19:38:54.779 INFO:teuthology.orchestra.run.smithi118.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-05T19:38:54.779 INFO:teuthology.orchestra.run.smithi118.stdout:Recommended packages: 2023-10-05T19:38:54.779 INFO:teuthology.orchestra.run.smithi118.stdout: thermald 2023-10-05T19:38:54.835 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2023-10-05T19:38:54.835 INFO:teuthology.orchestra.run.smithi118.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-05T19:38:54.835 INFO:teuthology.orchestra.run.smithi118.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-05T19:38:54.836 INFO:teuthology.orchestra.run.smithi118.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-05T19:38:54.837 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages will be upgraded: 2023-10-05T19:38:54.838 INFO:teuthology.orchestra.run.smithi118.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-05T19:38:54.897 INFO:teuthology.orchestra.run.smithi118.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-05T19:38:54.898 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 77.0 MB of archives. 2023-10-05T19:38:54.898 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-05T19:38:54.898 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-05T19:38:54.994 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-05T19:38:55.085 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-05T19:38:55.286 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-05T19:38:55.380 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-05T19:38:55.578 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-05T19:38:55.578 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-05T19:38:55.578 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-05T19:38:55.674 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-05T19:38:55.684 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-05T19:38:55.892 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-05T19:38:55.892 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-05T19:38:55.892 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-05T19:38:55.986 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-05T19:38:56.000 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-05T19:38:56.380 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 77.0 MB in 1s (72.3 MB/s) 2023-10-05T19:38:56.571 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-05T19:38:56.732 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 77.0 MB in 1s (66.6 MB/s) 2023-10-05T19:38:56.908 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-05T19:38:58.338 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-05T19:38:58.342 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-05T19:38:58.444 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:38:58.666 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-05T19:38:58.697 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-05T19:38:58.814 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:00.403 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-05T19:39:00.417 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-05T19:39:01.327 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:01.330 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-05T19:39:01.330 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-05T19:39:01.330 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:01.623 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-05T19:39:01.640 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-05T19:39:01.673 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:02.103 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-05T19:39:02.115 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-05T19:39:02.152 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:06.488 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-05T19:39:06.632 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-05T19:39:06.975 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-05T19:39:07.078 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-05T19:39:07.127 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-05T19:39:07.229 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-05T19:39:07.438 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-05T19:39:07.454 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-05T19:39:07.488 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-05T19:39:07.579 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-05T19:39:07.708 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-05T19:39:08.053 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-05T19:39:08.067 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-05T19:39:08.111 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-05T19:39:12.737 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-05T19:39:12.760 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-05T19:39:12.804 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:14.046 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-05T19:39:14.072 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-05T19:39:14.129 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:15.527 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-05T19:39:15.655 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-05T19:39:16.014 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-05T19:39:16.143 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:16.269 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:16.901 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-05T19:39:17.053 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-05T19:39:17.411 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-05T19:39:17.487 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:17.516 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:17.617 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:18.631 INFO:teuthology.orchestra.run.smithi167.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-05T19:39:18.631 INFO:teuthology.orchestra.run.smithi167.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-05T19:39:18.828 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-05T19:39:18.869 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:18.974 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:19.998 INFO:teuthology.orchestra.run.smithi118.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-05T19:39:19.998 INFO:teuthology.orchestra.run.smithi118.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-05T19:39:20.129 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-05T19:39:20.167 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-05T19:39:20.293 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-05T19:39:20.443 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:20.516 INFO:teuthology.orchestra.run.smithi167.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-05T19:39:20.517 INFO:teuthology.orchestra.run.smithi167.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-05T19:39:20.807 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:22.490 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-05T19:39:22.591 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-05T19:39:22.701 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-05T19:39:22.797 INFO:teuthology.orchestra.run.smithi118.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-05T19:39:22.797 INFO:teuthology.orchestra.run.smithi118.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-05T19:39:42.433 INFO:teuthology.orchestra.run.smithi167.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-05T19:39:42.433 INFO:teuthology.orchestra.run.smithi167.stdout:Sourcing file `/etc/default/grub' 2023-10-05T19:39:42.446 INFO:teuthology.orchestra.run.smithi167.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-05T19:39:42.457 INFO:teuthology.orchestra.run.smithi167.stdout:Generating grub configuration file ... 2023-10-05T19:39:42.856 INFO:teuthology.orchestra.run.smithi167.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-05T19:39:42.880 INFO:teuthology.orchestra.run.smithi167.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-05T19:39:43.344 INFO:teuthology.orchestra.run.smithi167.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-05T19:39:43.355 INFO:teuthology.orchestra.run.smithi167.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-05T19:39:44.703 INFO:teuthology.orchestra.run.smithi118.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-05T19:39:44.704 INFO:teuthology.orchestra.run.smithi118.stdout:Sourcing file `/etc/default/grub' 2023-10-05T19:39:44.710 INFO:teuthology.orchestra.run.smithi118.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-05T19:39:44.738 INFO:teuthology.orchestra.run.smithi118.stdout:Generating grub configuration file ... 2023-10-05T19:39:45.062 INFO:teuthology.orchestra.run.smithi118.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-05T19:39:45.089 INFO:teuthology.orchestra.run.smithi118.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-05T19:39:45.473 INFO:teuthology.orchestra.run.smithi118.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-05T19:39:45.484 INFO:teuthology.orchestra.run.smithi118.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-05T19:39:45.869 INFO:teuthology.orchestra.run.smithi167.stdout:done 2023-10-05T19:39:46.301 DEBUG:teuthology.orchestra.run.smithi167:> dpkg -s linux-image-generic 2023-10-05T19:39:46.349 INFO:teuthology.orchestra.run.smithi167.stdout:Package: linux-image-generic 2023-10-05T19:39:46.350 INFO:teuthology.orchestra.run.smithi167.stdout:Status: install ok installed 2023-10-05T19:39:46.350 INFO:teuthology.orchestra.run.smithi167.stdout:Priority: optional 2023-10-05T19:39:46.350 INFO:teuthology.orchestra.run.smithi167.stdout:Section: kernel 2023-10-05T19:39:46.350 INFO:teuthology.orchestra.run.smithi167.stdout:Installed-Size: 20 2023-10-05T19:39:46.350 INFO:teuthology.orchestra.run.smithi167.stdout:Maintainer: Ubuntu Kernel Team 2023-10-05T19:39:46.351 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: amd64 2023-10-05T19:39:46.351 INFO:teuthology.orchestra.run.smithi167.stdout:Source: linux-meta 2023-10-05T19:39:46.351 INFO:teuthology.orchestra.run.smithi167.stdout:Version: 5.4.0.164.161 2023-10-05T19:39:46.351 INFO:teuthology.orchestra.run.smithi167.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-05T19:39:46.351 INFO:teuthology.orchestra.run.smithi167.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-05T19:39:46.351 INFO:teuthology.orchestra.run.smithi167.stdout:Recommends: thermald 2023-10-05T19:39:46.351 INFO:teuthology.orchestra.run.smithi167.stdout:Description: Generic Linux kernel image 2023-10-05T19:39:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: This package will always depend on the latest generic kernel image 2023-10-05T19:39:46.352 INFO:teuthology.orchestra.run.smithi167.stdout: available. 2023-10-05T19:39:46.352 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-05T19:39:46.352 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-05T19:39:46.353 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-05T19:39:46.353 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-10-05T19:39:46.353 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2023-10-05T19:39:46.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get clean 2023-10-05T19:39:46.441 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2023-10-05T19:39:46.572 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-05T19:39:46.572 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-05T19:39:46.577 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-05T19:39:46.594 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-05T19:39:47.658 INFO:teuthology.orchestra.run.smithi118.stdout:done 2023-10-05T19:39:48.095 DEBUG:teuthology.orchestra.run.smithi118:> dpkg -s linux-image-generic 2023-10-05T19:39:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:Package: linux-image-generic 2023-10-05T19:39:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:Status: install ok installed 2023-10-05T19:39:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:Priority: optional 2023-10-05T19:39:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:Section: kernel 2023-10-05T19:39:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:Installed-Size: 20 2023-10-05T19:39:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:Maintainer: Ubuntu Kernel Team 2023-10-05T19:39:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: amd64 2023-10-05T19:39:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:Source: linux-meta 2023-10-05T19:39:48.156 INFO:teuthology.orchestra.run.smithi118.stdout:Version: 5.4.0.164.161 2023-10-05T19:39:48.157 INFO:teuthology.orchestra.run.smithi118.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-05T19:39:48.157 INFO:teuthology.orchestra.run.smithi118.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-05T19:39:48.157 INFO:teuthology.orchestra.run.smithi118.stdout:Recommends: thermald 2023-10-05T19:39:48.157 INFO:teuthology.orchestra.run.smithi118.stdout:Description: Generic Linux kernel image 2023-10-05T19:39:48.157 INFO:teuthology.orchestra.run.smithi118.stdout: This package will always depend on the latest generic kernel image 2023-10-05T19:39:48.157 INFO:teuthology.orchestra.run.smithi118.stdout: available. 2023-10-05T19:39:48.157 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-05T19:39:48.157 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-05T19:39:48.157 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-05T19:39:48.157 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-05T19:39:48.158 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=None, version=distro) 2023-10-05T19:39:48.158 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get clean 2023-10-05T19:39:48.230 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get update 2023-10-05T19:39:48.314 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2023-10-05T19:39:48.338 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-05T19:39:48.365 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-05T19:39:48.374 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-05T19:39:48.393 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-05T19:39:48.409 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2023-10-05T19:39:48.480 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-05T19:39:48.610 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2023-10-05T19:39:48.610 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2023-10-05T19:39:48.827 INFO:teuthology.orchestra.run.smithi167.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-05T19:39:48.827 INFO:teuthology.orchestra.run.smithi167.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-05T19:39:48.829 DEBUG:teuthology.orchestra.run.smithi167:> dpkg -s linux-image-generic 2023-10-05T19:39:48.848 INFO:teuthology.orchestra.run.smithi167.stdout:Package: linux-image-generic 2023-10-05T19:39:48.848 INFO:teuthology.orchestra.run.smithi167.stdout:Status: install ok installed 2023-10-05T19:39:48.848 INFO:teuthology.orchestra.run.smithi167.stdout:Priority: optional 2023-10-05T19:39:48.848 INFO:teuthology.orchestra.run.smithi167.stdout:Section: kernel 2023-10-05T19:39:48.849 INFO:teuthology.orchestra.run.smithi167.stdout:Installed-Size: 20 2023-10-05T19:39:48.849 INFO:teuthology.orchestra.run.smithi167.stdout:Maintainer: Ubuntu Kernel Team 2023-10-05T19:39:48.849 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: amd64 2023-10-05T19:39:48.849 INFO:teuthology.orchestra.run.smithi167.stdout:Source: linux-meta 2023-10-05T19:39:48.849 INFO:teuthology.orchestra.run.smithi167.stdout:Version: 5.4.0.164.161 2023-10-05T19:39:48.849 INFO:teuthology.orchestra.run.smithi167.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-05T19:39:48.849 INFO:teuthology.orchestra.run.smithi167.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-05T19:39:48.849 INFO:teuthology.orchestra.run.smithi167.stdout:Recommends: thermald 2023-10-05T19:39:48.849 INFO:teuthology.orchestra.run.smithi167.stdout:Description: Generic Linux kernel image 2023-10-05T19:39:48.850 INFO:teuthology.orchestra.run.smithi167.stdout: This package will always depend on the latest generic kernel image 2023-10-05T19:39:48.850 INFO:teuthology.orchestra.run.smithi167.stdout: available. 2023-10-05T19:39:48.850 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2023-10-05T19:39:48.855 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.RUdm9f2irt 2023-10-05T19:39:48.856 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub/grub.cfg /tmp/tmp.RUdm9f2irt 2023-10-05T19:39:48.865 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.RUdm9f2irt 2023-10-05T19:39:48.901 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.RUdm9f2irt is 9KB 2023-10-05T19:39:48.915 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.RUdm9f2irt 2023-10-05T19:39:48.921 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-05T19:39:48.976 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:39:48.976 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-05T19:39:48.976 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-05T19:39:49.009 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-05T19:39:49.010 DEBUG:teuthology.orchestra.run.smithi167:> sudo update-grub 2023-10-05T19:39:50.093 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-10-05T19:39:50.119 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-05T19:39:50.190 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-10-05T19:39:50.317 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub' 2023-10-05T19:39:50.323 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-05T19:39:50.332 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2023-10-05T19:39:50.367 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2023-10-05T19:39:50.367 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2023-10-05T19:39:50.575 INFO:teuthology.orchestra.run.smithi118.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-05T19:39:50.575 INFO:teuthology.orchestra.run.smithi118.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-05T19:39:50.578 DEBUG:teuthology.orchestra.run.smithi118:> dpkg -s linux-image-generic 2023-10-05T19:39:50.595 INFO:teuthology.orchestra.run.smithi118.stdout:Package: linux-image-generic 2023-10-05T19:39:50.595 INFO:teuthology.orchestra.run.smithi118.stdout:Status: install ok installed 2023-10-05T19:39:50.595 INFO:teuthology.orchestra.run.smithi118.stdout:Priority: optional 2023-10-05T19:39:50.595 INFO:teuthology.orchestra.run.smithi118.stdout:Section: kernel 2023-10-05T19:39:50.595 INFO:teuthology.orchestra.run.smithi118.stdout:Installed-Size: 20 2023-10-05T19:39:50.595 INFO:teuthology.orchestra.run.smithi118.stdout:Maintainer: Ubuntu Kernel Team 2023-10-05T19:39:50.595 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: amd64 2023-10-05T19:39:50.595 INFO:teuthology.orchestra.run.smithi118.stdout:Source: linux-meta 2023-10-05T19:39:50.596 INFO:teuthology.orchestra.run.smithi118.stdout:Version: 5.4.0.164.161 2023-10-05T19:39:50.596 INFO:teuthology.orchestra.run.smithi118.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-05T19:39:50.596 INFO:teuthology.orchestra.run.smithi118.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-05T19:39:50.596 INFO:teuthology.orchestra.run.smithi118.stdout:Recommends: thermald 2023-10-05T19:39:50.596 INFO:teuthology.orchestra.run.smithi118.stdout:Description: Generic Linux kernel image 2023-10-05T19:39:50.596 INFO:teuthology.orchestra.run.smithi118.stdout: This package will always depend on the latest generic kernel image 2023-10-05T19:39:50.596 INFO:teuthology.orchestra.run.smithi118.stdout: available. 2023-10-05T19:39:50.596 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-10-05T19:39:50.643 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-05T19:39:50.644 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.aKUMkpdagR 2023-10-05T19:39:50.645 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub/grub.cfg /tmp/tmp.aKUMkpdagR 2023-10-05T19:39:50.651 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-05T19:39:50.659 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.aKUMkpdagR 2023-10-05T19:39:50.695 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.aKUMkpdagR is 9KB 2023-10-05T19:39:50.709 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.aKUMkpdagR 2023-10-05T19:39:50.715 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-05T19:39:50.771 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:39:50.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-05T19:39:50.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-05T19:39:50.831 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-05T19:39:50.831 DEBUG:teuthology.orchestra.run.smithi118:> sudo update-grub 2023-10-05T19:39:51.042 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-05T19:39:51.055 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-05T19:39:52.182 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub' 2023-10-05T19:39:52.191 INFO:teuthology.orchestra.run.smithi118.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-05T19:39:52.203 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2023-10-05T19:39:52.439 INFO:teuthology.orchestra.run.smithi167.stderr:done 2023-10-05T19:39:52.441 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2023-10-05T19:39:52.495 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-05T19:39:52.507 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-05T19:39:52.890 INFO:teuthology.orchestra.run.smithi118.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-05T19:39:52.902 INFO:teuthology.orchestra.run.smithi118.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-05T19:39:53.882 INFO:teuthology.orchestra.run.smithi118.stderr:done 2023-10-05T19:39:53.884 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2023-10-05T19:40:22.471 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-10-05T19:40:22.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T19:40:22.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:40:23.888 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-05T19:40:23.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-05T19:40:23.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:40:57.082 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-05T19:40:58.362 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-05T19:41:06.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T19:41:06.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:41:07.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-05T19:41:07.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:41:10.426 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-05T19:41:22.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-05T19:41:22.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:41:24.474 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-05T19:41:36.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T19:41:37.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:41:38.034 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-10-05T19:41:39.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T19:41:39.232 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.4.0-164-generic"... 2023-10-05T19:41:39.232 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2023-10-05T19:41:39.238 INFO:teuthology.orchestra.run.smithi167.stdout:5.4.0-164-generic 2023-10-05T19:41:39.239 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-05T19:41:39.239 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-05T19:41:39.239 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-05T19:41:40.240 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-10-05T19:41:40.241 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-05T19:41:40.350 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2023-10-05T19:41:40.373 DEBUG:teuthology.parallel:result is None 2023-10-05T19:41:54.110 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-10-05T19:41:54.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-05T19:41:54.691 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-164-generic"... 2023-10-05T19:41:54.691 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2023-10-05T19:41:54.697 INFO:teuthology.orchestra.run.smithi118.stdout:5.4.0-164-generic 2023-10-05T19:41:54.698 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-05T19:41:54.698 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-05T19:41:54.698 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-05T19:41:55.699 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-05T19:41:55.699 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-05T19:41:55.798 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2023-10-05T19:41:55.817 DEBUG:teuthology.parallel:result is None 2023-10-05T19:41:55.817 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-05T19:41:55.824 INFO:teuthology.task.internal:Creating test directory... 2023-10-05T19:41:55.825 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T19:41:55.827 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T19:41:55.834 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-05T19:41:55.840 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-05T19:41:55.850 INFO:teuthology.task.internal:Creating archive directory... 2023-10-05T19:41:55.851 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T19:41:55.853 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T19:41:55.878 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-05T19:41:55.884 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-05T19:41:55.885 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T19:41:55.916 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T19:41:55.931 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T19:41:55.941 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T19:41:55.945 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T19:41:55.955 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T19:41:55.957 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-05T19:41:55.964 INFO:teuthology.task.internal:Configuring sudo... 2023-10-05T19:41:55.964 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T19:41:55.966 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T19:41:55.980 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-05T19:41:55.990 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-05T19:41:55.991 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T19:41:56.024 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T19:41:56.032 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T19:41:56.038 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T19:41:56.089 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:41:56.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T19:41:56.117 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T19:41:56.124 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T19:41:56.131 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:41:56.131 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T19:41:56.156 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2023-10-05T19:41:56.158 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2023-10-05T19:41:56.207 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-05T19:41:56.214 INFO:teuthology.task.internal:Starting timer... 2023-10-05T19:41:56.214 INFO:teuthology.run_tasks:Running task pcp... 2023-10-05T19:41:56.223 INFO:teuthology.run_tasks:Running task selinux... 2023-10-05T19:41:56.231 DEBUG:teuthology.task.selinux:Excluding smithi118: OS 'ubuntu' does not support SELinux 2023-10-05T19:41:56.231 DEBUG:teuthology.task.selinux:Excluding smithi167: OS 'ubuntu' does not support SELinux 2023-10-05T19:41:56.231 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-05T19:41:56.231 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-05T19:41:56.231 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-05T19:41:56.231 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-05T19:41:56.241 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-05T19:41:56.246 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-05T19:41:56.377 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-05T19:41:56.392 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-05T19:41:56.393 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi118.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-05T19:47:36.922 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi118.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2023-10-05T19:47:36.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-05T19:47:36.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:47:36.969 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-10-05T19:47:37.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-05T19:47:37.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T19:47:37.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T19:47:37.142 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-10-05T19:47:37.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-05T19:47:37.272 INFO:teuthology.run_tasks:Running task clock... 2023-10-05T19:47:37.282 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-05T19:47:37.283 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T19:47:37.283 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T19:47:37.285 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T19:47:37.285 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T19:47:37.319 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-05T19:47:37.319 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: Command line: ntpd -gq 2023-10-05T19:47:37.320 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-05T19:47:37.320 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: Command line: ntpd -gq 2023-10-05T19:47:37.321 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: proto: precision = 0.195 usec (-22) 2023-10-05T19:47:37.321 INFO:teuthology.orchestra.run.smithi118.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-05T19:47:37.321 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-05T19:47:37.321 INFO:teuthology.orchestra.run.smithi118.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-05T19:47:37.323 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: restrict ::: KOD does nothing without LIMITED. 2023-10-05T19:47:37.323 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: Listen and drop on 0 v6wildcard [::]:123 2023-10-05T19:47:37.323 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-05T19:47:37.323 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: Listen normally on 2 lo 127.0.0.1:123 2023-10-05T19:47:37.323 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: Listen normally on 3 enp3s0f1 172.21.15.118:123 2023-10-05T19:47:37.323 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: Listen normally on 4 lo [::1]:123 2023-10-05T19:47:37.323 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d725%5]:123 2023-10-05T19:47:37.323 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:37 ntpd[22802]: Listening on routing socket on fd #22 for interface updates 2023-10-05T19:47:37.324 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: proto: precision = 0.093 usec (-23) 2023-10-05T19:47:37.324 INFO:teuthology.orchestra.run.smithi167.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-05T19:47:37.324 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-05T19:47:37.325 INFO:teuthology.orchestra.run.smithi167.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-05T19:47:37.326 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: restrict ::: KOD does nothing without LIMITED. 2023-10-05T19:47:37.326 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: Listen and drop on 0 v6wildcard [::]:123 2023-10-05T19:47:37.326 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-05T19:47:37.326 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: Listen normally on 2 lo 127.0.0.1:123 2023-10-05T19:47:37.326 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: Listen normally on 3 enp3s0f1 172.21.15.167:123 2023-10-05T19:47:37.326 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: Listen normally on 4 lo [::1]:123 2023-10-05T19:47:37.326 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7309%5]:123 2023-10-05T19:47:37.326 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:37 ntpd[22857]: Listening on routing socket on fd #22 for interface updates 2023-10-05T19:47:38.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:38 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:38.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:38 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:38.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:38 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:38.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:38 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:38.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:38 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:38.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:38 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:38.322 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:38 ntpd[22802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:38.322 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:38 ntpd[22802]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:38.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:38.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:38.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:38.325 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:38.325 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:38.325 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:38.325 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:38.325 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:38.325 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:38.325 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:38.325 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:38.325 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:38 ntpd[22857]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:39.321 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:39 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:39.322 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:39 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:40.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:40.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:40.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:40 ntpd[22802]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:40.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:40.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:40.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:40.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:40.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:40.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:40.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:40.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:40.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:40.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:40.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:40.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:40 ntpd[22857]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:41.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:41 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:41.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:41 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:41.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:41 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:41.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:41 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:41.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:41 ntpd[22802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:41.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:41 ntpd[22802]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:41.321 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:41 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:41.321 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:41 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:41.322 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:41 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:41.322 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:41 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:41.322 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:41 ntpd[22857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:41.322 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:41 ntpd[22857]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:42.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:42.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:42 ntpd[22802]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:42.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:42.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:42.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:42.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:42.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:42.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:42.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:42.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:42.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:42.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:42.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:42.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:42 ntpd[22857]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:43.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:43 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:43.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:43 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:43.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:43 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:43.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:43 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:43.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:43 ntpd[22802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:43.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:43 ntpd[22802]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:43.321 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:43 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:43.321 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:43 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:43.321 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:43 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:43.322 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:43 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:43.322 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:43 ntpd[22857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:43.322 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:43 ntpd[22857]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:44.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:44.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:44.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:44.320 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:44.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:44.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:44.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:44.321 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:44.321 INFO:teuthology.orchestra.run.smithi118.stdout: 5 Oct 19:47:44 ntpd[22802]: ntpd: time slew +0.000288 s 2023-10-05T19:47:44.321 INFO:teuthology.orchestra.run.smithi118.stdout:ntpd: time slew +0.000288s 2023-10-05T19:47:44.322 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-05T19:47:44.322 INFO:teuthology.orchestra.run.smithi118.stderr: 5 Oct 19:47:44 ntpd[22802]: can't open /var/log/ntpstats/loopstats.20231005: Permission denied 2023-10-05T19:47:44.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:44.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:44.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:44.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:44.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-05T19:47:44.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: can't open /var/log/ntpstats/rawstats.20231005: Permission denied 2023-10-05T19:47:44.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-05T19:47:44.323 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: can't open /var/log/ntpstats/peerstats.20231005: Permission denied 2023-10-05T19:47:44.324 INFO:teuthology.orchestra.run.smithi167.stdout: 5 Oct 19:47:44 ntpd[22857]: ntpd: time slew -0.000839 s 2023-10-05T19:47:44.324 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd: time slew -0.000839s 2023-10-05T19:47:44.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-05T19:47:44.324 INFO:teuthology.orchestra.run.smithi167.stderr: 5 Oct 19:47:44 ntpd[22857]: can't open /var/log/ntpstats/loopstats.20231005: Permission denied 2023-10-05T19:47:44.392 INFO:teuthology.orchestra.run.smithi167.stdout: remote refid st t when poll reach delay offset jitter 2023-10-05T19:47:44.393 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================== 2023-10-05T19:47:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:47:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:47:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:47:44.393 INFO:teuthology.orchestra.run.smithi167.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:47:44.408 INFO:teuthology.orchestra.run.smithi118.stdout: remote refid st t when poll reach delay offset jitter 2023-10-05T19:47:44.408 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================== 2023-10-05T19:47:44.408 INFO:teuthology.orchestra.run.smithi118.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:47:44.408 INFO:teuthology.orchestra.run.smithi118.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:47:44.409 INFO:teuthology.orchestra.run.smithi118.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:47:44.409 INFO:teuthology.orchestra.run.smithi118.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:47:44.410 INFO:teuthology.run_tasks:Running task install... 2023-10-05T19:47:44.421 DEBUG:teuthology.task.install:project ceph 2023-10-05T19:47:44.421 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90'}} 2023-10-05T19:47:44.421 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90'} 2023-10-05T19:47:44.422 INFO:teuthology.task.install:Using flavor: default 2023-10-05T19:47:44.428 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-05T19:47:44.428 INFO:teuthology.task.install:extra packages: [] 2023-10-05T19:47:44.429 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-key list | grep Ceph 2023-10-05T19:47:44.429 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-key list | grep Ceph 2023-10-05T19:47:44.525 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-05T19:47:44.526 INFO:teuthology.orchestra.run.smithi118.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-05T19:47:44.585 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-05T19:47:44.586 INFO:teuthology.orchestra.run.smithi118.stdout:uid [ unknown] Ceph.com (release key) 2023-10-05T19:47:44.587 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-10-05T19:47:44.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T19:47:44.591 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-05T19:47:44.591 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph.com (release key) 2023-10-05T19:47:44.592 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-10-05T19:47:44.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T19:47:44.736 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default/ 2023-10-05T19:47:44.736 INFO:teuthology.task.install.deb:Package version is 17.2.6-1278-g487ffcb5-1focal 2023-10-05T19:47:44.804 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default/ 2023-10-05T19:47:44.804 INFO:teuthology.task.install.deb:Package version is 17.2.6-1278-g487ffcb5-1focal 2023-10-05T19:47:44.905 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:47:44.905 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-05T19:47:44.910 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:47:44.910 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-05T19:47:44.921 DEBUG:teuthology.orchestra.run.smithi118:> sudo apt-get update 2023-10-05T19:47:44.927 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2023-10-05T19:47:45.085 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-05T19:47:45.111 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal InRelease 2023-10-05T19:47:45.118 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal InRelease 2023-10-05T19:47:45.133 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-05T19:47:45.139 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-05T19:47:45.156 INFO:teuthology.orchestra.run.smithi118.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal Release.gpg 2023-10-05T19:47:45.163 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal Release.gpg 2023-10-05T19:47:45.177 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-05T19:47:45.178 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-05T19:47:45.195 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-05T19:47:45.195 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main i386 Packages [3,372 B] 2023-10-05T19:47:45.213 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:6 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-05T19:47:45.216 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main i386 Packages [3,372 B] 2023-10-05T19:47:45.234 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-05T19:47:45.259 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-05T19:47:45.264 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-05T19:47:45.341 INFO:teuthology.orchestra.run.smithi118.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-05T19:47:45.350 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-05T19:47:45.737 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 28.4 kB in 1s (43.7 kB/s) 2023-10-05T19:47:45.844 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 28.4 kB in 1s (37.3 kB/s) 2023-10-05T19:47:46.764 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-10-05T19:47:46.791 DEBUG:teuthology.orchestra.run.smithi118:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1278-g487ffcb5-1focal cephadm=17.2.6-1278-g487ffcb5-1focal ceph-mds=17.2.6-1278-g487ffcb5-1focal ceph-mgr=17.2.6-1278-g487ffcb5-1focal ceph-common=17.2.6-1278-g487ffcb5-1focal ceph-fuse=17.2.6-1278-g487ffcb5-1focal ceph-test=17.2.6-1278-g487ffcb5-1focal ceph-volume=17.2.6-1278-g487ffcb5-1focal radosgw=17.2.6-1278-g487ffcb5-1focal python3-rados=17.2.6-1278-g487ffcb5-1focal python3-rgw=17.2.6-1278-g487ffcb5-1focal python3-cephfs=17.2.6-1278-g487ffcb5-1focal python3-rbd=17.2.6-1278-g487ffcb5-1focal libcephfs2=17.2.6-1278-g487ffcb5-1focal libcephfs-dev=17.2.6-1278-g487ffcb5-1focal librados2=17.2.6-1278-g487ffcb5-1focal librbd1=17.2.6-1278-g487ffcb5-1focal rbd-fuse=17.2.6-1278-g487ffcb5-1focal 2023-10-05T19:47:46.860 INFO:teuthology.orchestra.run.smithi118.stdout:Reading package lists... 2023-10-05T19:47:46.879 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2023-10-05T19:47:46.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1278-g487ffcb5-1focal cephadm=17.2.6-1278-g487ffcb5-1focal ceph-mds=17.2.6-1278-g487ffcb5-1focal ceph-mgr=17.2.6-1278-g487ffcb5-1focal ceph-common=17.2.6-1278-g487ffcb5-1focal ceph-fuse=17.2.6-1278-g487ffcb5-1focal ceph-test=17.2.6-1278-g487ffcb5-1focal ceph-volume=17.2.6-1278-g487ffcb5-1focal radosgw=17.2.6-1278-g487ffcb5-1focal python3-rados=17.2.6-1278-g487ffcb5-1focal python3-rgw=17.2.6-1278-g487ffcb5-1focal python3-cephfs=17.2.6-1278-g487ffcb5-1focal python3-rbd=17.2.6-1278-g487ffcb5-1focal libcephfs2=17.2.6-1278-g487ffcb5-1focal libcephfs-dev=17.2.6-1278-g487ffcb5-1focal librados2=17.2.6-1278-g487ffcb5-1focal librbd1=17.2.6-1278-g487ffcb5-1focal rbd-fuse=17.2.6-1278-g487ffcb5-1focal 2023-10-05T19:47:46.969 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2023-10-05T19:47:47.038 INFO:teuthology.orchestra.run.smithi118.stdout:Building dependency tree... 2023-10-05T19:47:47.039 INFO:teuthology.orchestra.run.smithi118.stdout:Reading state information... 2023-10-05T19:47:47.148 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2023-10-05T19:47:47.148 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2023-10-05T19:47:47.208 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages were automatically installed and are no longer required: 2023-10-05T19:47:47.209 INFO:teuthology.orchestra.run.smithi118.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-05T19:47:47.209 INFO:teuthology.orchestra.run.smithi118.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-05T19:47:47.209 INFO:teuthology.orchestra.run.smithi118.stdout:The following additional packages will be installed: 2023-10-05T19:47:47.209 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-05T19:47:47.211 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-05T19:47:47.211 INFO:teuthology.orchestra.run.smithi118.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-05T19:47:47.211 INFO:teuthology.orchestra.run.smithi118.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-10-05T19:47:47.212 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-10-05T19:47:47.213 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-10-05T19:47:47.213 INFO:teuthology.orchestra.run.smithi118.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-05T19:47:47.213 INFO:teuthology.orchestra.run.smithi118.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-10-05T19:47:47.213 INFO:teuthology.orchestra.run.smithi118.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-10-05T19:47:47.213 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2023-10-05T19:47:47.213 INFO:teuthology.orchestra.run.smithi118.stdout: socat xmlstarlet 2023-10-05T19:47:47.213 INFO:teuthology.orchestra.run.smithi118.stdout:Suggested packages: 2023-10-05T19:47:47.213 INFO:teuthology.orchestra.run.smithi118.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-05T19:47:47.213 INFO:teuthology.orchestra.run.smithi118.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-05T19:47:47.214 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-05T19:47:47.214 INFO:teuthology.orchestra.run.smithi118.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-05T19:47:47.214 INFO:teuthology.orchestra.run.smithi118.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-05T19:47:47.214 INFO:teuthology.orchestra.run.smithi118.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-05T19:47:47.214 INFO:teuthology.orchestra.run.smithi118.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-05T19:47:47.214 INFO:teuthology.orchestra.run.smithi118.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-05T19:47:47.214 INFO:teuthology.orchestra.run.smithi118.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-05T19:47:47.214 INFO:teuthology.orchestra.run.smithi118.stdout:Recommended packages: 2023-10-05T19:47:47.214 INFO:teuthology.orchestra.run.smithi118.stdout: btrfs-tools 2023-10-05T19:47:47.318 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2023-10-05T19:47:47.319 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-05T19:47:47.320 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-05T19:47:47.320 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2023-10-05T19:47:47.320 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-05T19:47:47.320 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-05T19:47:47.320 INFO:teuthology.orchestra.run.smithi167.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-05T19:47:47.320 INFO:teuthology.orchestra.run.smithi167.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-05T19:47:47.320 INFO:teuthology.orchestra.run.smithi167.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-05T19:47:47.322 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-05T19:47:47.322 INFO:teuthology.orchestra.run.smithi167.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-10-05T19:47:47.322 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-10-05T19:47:47.322 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2023-10-05T19:47:47.322 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-10-05T19:47:47.322 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-10-05T19:47:47.322 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout: socat xmlstarlet 2023-10-05T19:47:47.323 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout:Recommended packages: 2023-10-05T19:47:47.324 INFO:teuthology.orchestra.run.smithi167.stdout: btrfs-tools 2023-10-05T19:47:47.326 INFO:teuthology.orchestra.run.smithi118.stdout:The following NEW packages will be installed: 2023-10-05T19:47:47.326 INFO:teuthology.orchestra.run.smithi118.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-05T19:47:47.326 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-05T19:47:47.326 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-05T19:47:47.328 INFO:teuthology.orchestra.run.smithi118.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-10-05T19:47:47.328 INFO:teuthology.orchestra.run.smithi118.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-10-05T19:47:47.328 INFO:teuthology.orchestra.run.smithi118.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-10-05T19:47:47.328 INFO:teuthology.orchestra.run.smithi118.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2023-10-05T19:47:47.329 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2023-10-05T19:47:47.330 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-05T19:47:47.330 INFO:teuthology.orchestra.run.smithi118.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-05T19:47:47.330 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-05T19:47:47.330 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-05T19:47:47.330 INFO:teuthology.orchestra.run.smithi118.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-05T19:47:47.330 INFO:teuthology.orchestra.run.smithi118.stdout:The following packages will be upgraded: 2023-10-05T19:47:47.331 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 librbd1 2023-10-05T19:47:47.436 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2023-10-05T19:47:47.437 INFO:teuthology.orchestra.run.smithi167.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-05T19:47:47.437 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-05T19:47:47.437 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-05T19:47:47.437 INFO:teuthology.orchestra.run.smithi167.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-10-05T19:47:47.437 INFO:teuthology.orchestra.run.smithi167.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-10-05T19:47:47.437 INFO:teuthology.orchestra.run.smithi167.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-10-05T19:47:47.437 INFO:teuthology.orchestra.run.smithi167.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-10-05T19:47:47.440 INFO:teuthology.orchestra.run.smithi167.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2023-10-05T19:47:47.440 INFO:teuthology.orchestra.run.smithi167.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-10-05T19:47:47.440 INFO:teuthology.orchestra.run.smithi167.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-05T19:47:47.440 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-10-05T19:47:47.441 INFO:teuthology.orchestra.run.smithi167.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-10-05T19:47:47.441 INFO:teuthology.orchestra.run.smithi167.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-10-05T19:47:47.441 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-10-05T19:47:47.441 INFO:teuthology.orchestra.run.smithi167.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2023-10-05T19:47:47.441 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2023-10-05T19:47:47.441 INFO:teuthology.orchestra.run.smithi167.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-05T19:47:47.441 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2023-10-05T19:47:47.442 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2023-10-05T19:47:47.442 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-10-05T19:47:47.442 INFO:teuthology.orchestra.run.smithi167.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-05T19:47:47.442 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-05T19:47:47.442 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-05T19:47:47.442 INFO:teuthology.orchestra.run.smithi167.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-05T19:47:47.443 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages will be upgraded: 2023-10-05T19:47:47.443 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 librbd1 2023-10-05T19:47:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:2 upgraded, 108 newly installed, 0 to remove and 253 not upgraded. 2023-10-05T19:47:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 210 MB of archives. 2023-10-05T19:47:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 980 MB of additional disk space will be used. 2023-10-05T19:47:47.507 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-05T19:47:47.520 INFO:teuthology.orchestra.run.smithi118.stdout:2 upgraded, 108 newly installed, 0 to remove and 253 not upgraded. 2023-10-05T19:47:47.520 INFO:teuthology.orchestra.run.smithi118.stdout:Need to get 210 MB of archives. 2023-10-05T19:47:47.521 INFO:teuthology.orchestra.run.smithi118.stdout:After this operation, 980 MB of additional disk space will be used. 2023-10-05T19:47:47.521 INFO:teuthology.orchestra.run.smithi118.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-05T19:47:47.555 INFO:teuthology.orchestra.run.smithi118.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1278-g487ffcb5-1focal [3,501 kB] 2023-10-05T19:47:47.586 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1278-g487ffcb5-1focal [3,501 kB] 2023-10-05T19:47:47.601 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-05T19:47:47.603 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-05T19:47:47.613 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-05T19:47:47.620 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-05T19:47:47.648 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-05T19:47:47.649 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-05T19:47:47.656 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-05T19:47:47.692 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-05T19:47:47.694 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-05T19:47:47.703 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-05T19:47:47.705 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-05T19:47:47.706 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-05T19:47:47.708 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-05T19:47:47.708 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-05T19:47:47.709 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-05T19:47:47.710 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-05T19:47:47.711 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-05T19:47:47.730 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-05T19:47:47.731 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-05T19:47:47.731 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-05T19:47:47.733 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-05T19:47:47.733 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-05T19:47:47.733 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-05T19:47:47.734 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-05T19:47:47.735 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-05T19:47:47.737 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-05T19:47:47.752 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-05T19:47:47.753 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-05T19:47:47.758 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-05T19:47:47.771 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-05T19:47:47.772 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-05T19:47:47.773 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-05T19:47:47.775 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-05T19:47:47.779 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-05T19:47:47.780 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-05T19:47:47.781 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-05T19:47:47.790 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-05T19:47:47.792 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-05T19:47:47.792 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-05T19:47:47.810 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-05T19:47:47.811 INFO:teuthology.orchestra.run.smithi167.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-05T19:47:47.850 INFO:teuthology.orchestra.run.smithi167.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1278-g487ffcb5-1focal [3,555 kB] 2023-10-05T19:47:47.919 INFO:teuthology.orchestra.run.smithi118.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-05T19:47:47.925 INFO:teuthology.orchestra.run.smithi118.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-05T19:47:47.951 INFO:teuthology.orchestra.run.smithi167.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-05T19:47:47.970 INFO:teuthology.orchestra.run.smithi118.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-05T19:47:47.974 INFO:teuthology.orchestra.run.smithi167.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-05T19:47:47.976 INFO:teuthology.orchestra.run.smithi167.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-05T19:47:47.983 INFO:teuthology.orchestra.run.smithi118.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-05T19:47:48.009 INFO:teuthology.orchestra.run.smithi118.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1278-g487ffcb5-1focal [3,555 kB] 2023-10-05T19:47:48.059 INFO:teuthology.orchestra.run.smithi167.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1278-g487ffcb5-1focal [760 kB] 2023-10-05T19:47:48.059 INFO:teuthology.orchestra.run.smithi167.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-05T19:47:48.060 INFO:teuthology.orchestra.run.smithi167.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-05T19:47:48.061 INFO:teuthology.orchestra.run.smithi167.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-05T19:47:48.062 INFO:teuthology.orchestra.run.smithi167.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-05T19:47:48.063 INFO:teuthology.orchestra.run.smithi167.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-05T19:47:48.064 INFO:teuthology.orchestra.run.smithi167.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-05T19:47:48.065 INFO:teuthology.orchestra.run.smithi167.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-05T19:47:48.067 INFO:teuthology.orchestra.run.smithi167.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-05T19:47:48.068 INFO:teuthology.orchestra.run.smithi167.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-05T19:47:48.071 INFO:teuthology.orchestra.run.smithi167.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1278-g487ffcb5-1focal [412 kB] 2023-10-05T19:47:48.074 INFO:teuthology.orchestra.run.smithi167.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1278-g487ffcb5-1focal [22.5 kB] 2023-10-05T19:47:48.074 INFO:teuthology.orchestra.run.smithi167.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1278-g487ffcb5-1focal [200 kB] 2023-10-05T19:47:48.076 INFO:teuthology.orchestra.run.smithi167.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1278-g487ffcb5-1focal [47.2 kB] 2023-10-05T19:47:48.080 INFO:teuthology.orchestra.run.smithi167.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-05T19:47:48.085 INFO:teuthology.orchestra.run.smithi167.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-05T19:47:48.085 INFO:teuthology.orchestra.run.smithi167.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-05T19:47:48.092 INFO:teuthology.orchestra.run.smithi167.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1278-g487ffcb5-1focal [386 kB] 2023-10-05T19:47:48.101 INFO:teuthology.orchestra.run.smithi167.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-05T19:47:48.102 INFO:teuthology.orchestra.run.smithi167.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-05T19:47:48.104 INFO:teuthology.orchestra.run.smithi167.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1278-g487ffcb5-1focal [5,577 kB] 2023-10-05T19:47:48.107 INFO:teuthology.orchestra.run.smithi167.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-05T19:47:48.109 INFO:teuthology.orchestra.run.smithi118.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-05T19:47:48.110 INFO:teuthology.orchestra.run.smithi167.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-05T19:47:48.115 INFO:teuthology.orchestra.run.smithi118.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-05T19:47:48.132 INFO:teuthology.orchestra.run.smithi167.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-05T19:47:48.135 INFO:teuthology.orchestra.run.smithi167.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-05T19:47:48.144 INFO:teuthology.orchestra.run.smithi118.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-05T19:47:48.225 INFO:teuthology.orchestra.run.smithi167.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-05T19:47:48.227 INFO:teuthology.orchestra.run.smithi167.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-05T19:47:48.227 INFO:teuthology.orchestra.run.smithi167.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-05T19:47:48.228 INFO:teuthology.orchestra.run.smithi167.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-05T19:47:48.228 INFO:teuthology.orchestra.run.smithi167.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-05T19:47:48.229 INFO:teuthology.orchestra.run.smithi167.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-05T19:47:48.242 INFO:teuthology.orchestra.run.smithi167.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-05T19:47:48.242 INFO:teuthology.orchestra.run.smithi167.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-05T19:47:48.243 INFO:teuthology.orchestra.run.smithi167.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-05T19:47:48.247 INFO:teuthology.orchestra.run.smithi167.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-05T19:47:48.267 INFO:teuthology.orchestra.run.smithi167.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-05T19:47:48.268 INFO:teuthology.orchestra.run.smithi167.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-05T19:47:48.269 INFO:teuthology.orchestra.run.smithi167.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-05T19:47:48.270 INFO:teuthology.orchestra.run.smithi167.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-05T19:47:48.270 INFO:teuthology.orchestra.run.smithi118.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1278-g487ffcb5-1focal [760 kB] 2023-10-05T19:47:48.273 INFO:teuthology.orchestra.run.smithi167.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-05T19:47:48.274 INFO:teuthology.orchestra.run.smithi167.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-05T19:47:48.285 INFO:teuthology.orchestra.run.smithi118.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-05T19:47:48.293 INFO:teuthology.orchestra.run.smithi118.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-05T19:47:48.319 INFO:teuthology.orchestra.run.smithi118.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-05T19:47:48.336 INFO:teuthology.orchestra.run.smithi118.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1278-g487ffcb5-1focal [412 kB] 2023-10-05T19:47:48.369 INFO:teuthology.orchestra.run.smithi118.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1278-g487ffcb5-1focal [22.5 kB] 2023-10-05T19:47:48.370 INFO:teuthology.orchestra.run.smithi118.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1278-g487ffcb5-1focal [200 kB] 2023-10-05T19:47:48.393 INFO:teuthology.orchestra.run.smithi118.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1278-g487ffcb5-1focal [47.2 kB] 2023-10-05T19:47:48.398 INFO:teuthology.orchestra.run.smithi118.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1278-g487ffcb5-1focal [386 kB] 2023-10-05T19:47:48.421 INFO:teuthology.orchestra.run.smithi118.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1278-g487ffcb5-1focal [5,577 kB] 2023-10-05T19:47:48.466 INFO:teuthology.orchestra.run.smithi167.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1278-g487ffcb5-1focal [116 kB] 2023-10-05T19:47:48.469 INFO:teuthology.orchestra.run.smithi167.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1278-g487ffcb5-1focal [479 kB] 2023-10-05T19:47:48.498 INFO:teuthology.orchestra.run.smithi118.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-05T19:47:48.505 INFO:teuthology.orchestra.run.smithi167.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1278-g487ffcb5-1focal [27.7 MB] 2023-10-05T19:47:48.746 INFO:teuthology.orchestra.run.smithi118.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-05T19:47:48.865 INFO:teuthology.orchestra.run.smithi118.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1278-g487ffcb5-1focal [116 kB] 2023-10-05T19:47:48.874 INFO:teuthology.orchestra.run.smithi118.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1278-g487ffcb5-1focal [479 kB] 2023-10-05T19:47:48.911 INFO:teuthology.orchestra.run.smithi118.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1278-g487ffcb5-1focal [27.7 MB] 2023-10-05T19:47:48.940 INFO:teuthology.orchestra.run.smithi118.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-05T19:47:48.960 INFO:teuthology.orchestra.run.smithi118.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-05T19:47:48.974 INFO:teuthology.orchestra.run.smithi118.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-05T19:47:49.026 INFO:teuthology.orchestra.run.smithi118.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-05T19:47:49.033 INFO:teuthology.orchestra.run.smithi118.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-05T19:47:49.037 INFO:teuthology.orchestra.run.smithi118.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-05T19:47:49.041 INFO:teuthology.orchestra.run.smithi118.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-05T19:47:49.043 INFO:teuthology.orchestra.run.smithi118.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-05T19:47:49.055 INFO:teuthology.orchestra.run.smithi118.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-05T19:47:49.221 INFO:teuthology.orchestra.run.smithi118.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-05T19:47:49.305 INFO:teuthology.orchestra.run.smithi118.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-05T19:47:49.489 INFO:teuthology.orchestra.run.smithi118.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-05T19:47:49.524 INFO:teuthology.orchestra.run.smithi118.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-05T19:47:49.589 INFO:teuthology.orchestra.run.smithi118.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-05T19:47:49.628 INFO:teuthology.orchestra.run.smithi118.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-05T19:47:49.635 INFO:teuthology.orchestra.run.smithi118.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-05T19:47:49.745 INFO:teuthology.orchestra.run.smithi118.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-05T19:47:49.745 INFO:teuthology.orchestra.run.smithi118.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-05T19:47:49.749 INFO:teuthology.orchestra.run.smithi118.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-05T19:47:49.753 INFO:teuthology.orchestra.run.smithi118.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-05T19:47:49.929 INFO:teuthology.orchestra.run.smithi118.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-05T19:47:50.062 INFO:teuthology.orchestra.run.smithi167.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1278-g487ffcb5-1focal [6,450 kB] 2023-10-05T19:47:50.330 INFO:teuthology.orchestra.run.smithi167.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1278-g487ffcb5-1focal [221 kB] 2023-10-05T19:47:50.379 INFO:teuthology.orchestra.run.smithi118.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-05T19:47:50.379 INFO:teuthology.orchestra.run.smithi118.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-05T19:47:50.379 INFO:teuthology.orchestra.run.smithi167.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1278-g487ffcb5-1focal [152 kB] 2023-10-05T19:47:50.379 INFO:teuthology.orchestra.run.smithi167.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1278-g487ffcb5-1focal [1,591 kB] 2023-10-05T19:47:50.380 INFO:teuthology.orchestra.run.smithi118.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-05T19:47:50.428 INFO:teuthology.orchestra.run.smithi118.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-05T19:47:50.438 INFO:teuthology.orchestra.run.smithi167.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1278-g487ffcb5-1focal [7,845 kB] 2023-10-05T19:47:50.460 INFO:teuthology.orchestra.run.smithi118.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-05T19:47:50.488 INFO:teuthology.orchestra.run.smithi118.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-05T19:47:50.491 INFO:teuthology.orchestra.run.smithi118.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-05T19:47:50.499 INFO:teuthology.orchestra.run.smithi118.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-05T19:47:50.874 INFO:teuthology.orchestra.run.smithi167.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1278-g487ffcb5-1focal [28.7 MB] 2023-10-05T19:47:51.018 INFO:teuthology.orchestra.run.smithi118.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-05T19:47:51.041 INFO:teuthology.orchestra.run.smithi118.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-05T19:47:51.205 INFO:teuthology.orchestra.run.smithi118.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-05T19:47:51.330 INFO:teuthology.orchestra.run.smithi118.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1278-g487ffcb5-1focal [6,450 kB] 2023-10-05T19:47:51.703 INFO:teuthology.orchestra.run.smithi118.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1278-g487ffcb5-1focal [221 kB] 2023-10-05T19:47:51.724 INFO:teuthology.orchestra.run.smithi118.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1278-g487ffcb5-1focal [152 kB] 2023-10-05T19:47:51.737 INFO:teuthology.orchestra.run.smithi118.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1278-g487ffcb5-1focal [1,591 kB] 2023-10-05T19:47:51.893 INFO:teuthology.orchestra.run.smithi118.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-05T19:47:51.893 INFO:teuthology.orchestra.run.smithi118.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-05T19:47:51.895 INFO:teuthology.orchestra.run.smithi118.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-05T19:47:51.896 INFO:teuthology.orchestra.run.smithi118.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1278-g487ffcb5-1focal [7,845 kB] 2023-10-05T19:47:51.897 INFO:teuthology.orchestra.run.smithi118.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-05T19:47:51.898 INFO:teuthology.orchestra.run.smithi118.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-05T19:47:51.899 INFO:teuthology.orchestra.run.smithi118.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-05T19:47:51.900 INFO:teuthology.orchestra.run.smithi118.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-05T19:47:51.903 INFO:teuthology.orchestra.run.smithi118.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-05T19:47:51.904 INFO:teuthology.orchestra.run.smithi118.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-05T19:47:51.974 INFO:teuthology.orchestra.run.smithi118.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-05T19:47:52.146 INFO:teuthology.orchestra.run.smithi118.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-05T19:47:52.488 INFO:teuthology.orchestra.run.smithi167.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1278-g487ffcb5-1focal [3,928 B] 2023-10-05T19:47:52.489 INFO:teuthology.orchestra.run.smithi167.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1278-g487ffcb5-1focal [869 kB] 2023-10-05T19:47:52.504 INFO:teuthology.orchestra.run.smithi167.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1278-g487ffcb5-1focal [2,406 kB] 2023-10-05T19:47:52.521 INFO:teuthology.orchestra.run.smithi167.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1278-g487ffcb5-1focal [79.1 kB] 2023-10-05T19:47:52.522 INFO:teuthology.orchestra.run.smithi167.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1278-g487ffcb5-1focal [117 kB] 2023-10-05T19:47:52.526 INFO:teuthology.orchestra.run.smithi118.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-05T19:47:52.526 INFO:teuthology.orchestra.run.smithi167.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1278-g487ffcb5-1focal [1,760 kB] 2023-10-05T19:47:52.577 INFO:teuthology.orchestra.run.smithi118.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-05T19:47:52.601 INFO:teuthology.orchestra.run.smithi167.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1278-g487ffcb5-1focal [7,879 kB] 2023-10-05T19:47:52.612 INFO:teuthology.orchestra.run.smithi118.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-05T19:47:52.661 INFO:teuthology.orchestra.run.smithi118.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1278-g487ffcb5-1focal [28.7 MB] 2023-10-05T19:47:52.712 INFO:teuthology.orchestra.run.smithi118.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-05T19:47:52.758 INFO:teuthology.orchestra.run.smithi118.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-05T19:47:52.913 INFO:teuthology.orchestra.run.smithi118.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-05T19:47:52.924 INFO:teuthology.orchestra.run.smithi118.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-05T19:47:52.998 INFO:teuthology.orchestra.run.smithi167.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1278-g487ffcb5-1focal [4,044 B] 2023-10-05T19:47:52.998 INFO:teuthology.orchestra.run.smithi167.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1278-g487ffcb5-1focal [56.3 MB] 2023-10-05T19:47:53.071 INFO:teuthology.orchestra.run.smithi118.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-05T19:47:53.072 INFO:teuthology.orchestra.run.smithi118.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-05T19:47:53.072 INFO:teuthology.orchestra.run.smithi118.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-05T19:47:53.237 INFO:teuthology.orchestra.run.smithi118.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-05T19:47:53.320 INFO:teuthology.orchestra.run.smithi118.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-05T19:47:53.501 INFO:teuthology.orchestra.run.smithi118.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-05T19:47:53.832 INFO:teuthology.orchestra.run.smithi118.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-05T19:47:53.833 INFO:teuthology.orchestra.run.smithi118.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-05T19:47:53.840 INFO:teuthology.orchestra.run.smithi118.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-05T19:47:53.841 INFO:teuthology.orchestra.run.smithi118.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-05T19:47:53.849 INFO:teuthology.orchestra.run.smithi118.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-05T19:47:53.853 INFO:teuthology.orchestra.run.smithi118.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-05T19:47:53.854 INFO:teuthology.orchestra.run.smithi118.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-05T19:47:53.856 INFO:teuthology.orchestra.run.smithi118.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-05T19:47:54.030 INFO:teuthology.orchestra.run.smithi118.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-05T19:47:54.288 INFO:teuthology.orchestra.run.smithi118.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-05T19:47:55.519 INFO:teuthology.orchestra.run.smithi118.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1278-g487ffcb5-1focal [3,928 B] 2023-10-05T19:47:55.604 INFO:teuthology.orchestra.run.smithi118.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1278-g487ffcb5-1focal [869 kB] 2023-10-05T19:47:55.620 INFO:teuthology.orchestra.run.smithi118.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1278-g487ffcb5-1focal [2,406 kB] 2023-10-05T19:47:55.754 INFO:teuthology.orchestra.run.smithi118.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1278-g487ffcb5-1focal [79.1 kB] 2023-10-05T19:47:55.759 INFO:teuthology.orchestra.run.smithi118.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1278-g487ffcb5-1focal [117 kB] 2023-10-05T19:47:55.766 INFO:teuthology.orchestra.run.smithi118.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1278-g487ffcb5-1focal [1,760 kB] 2023-10-05T19:47:55.925 INFO:teuthology.orchestra.run.smithi118.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1278-g487ffcb5-1focal [7,879 kB] 2023-10-05T19:47:56.042 INFO:teuthology.orchestra.run.smithi167.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1278-g487ffcb5-1focal [229 kB] 2023-10-05T19:47:56.046 INFO:teuthology.orchestra.run.smithi167.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1278-g487ffcb5-1focal [21.9 kB] 2023-10-05T19:47:56.047 INFO:teuthology.orchestra.run.smithi167.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1278-g487ffcb5-1focal [17.1 MB] 2023-10-05T19:47:56.517 INFO:teuthology.orchestra.run.smithi118.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1278-g487ffcb5-1focal [4,044 B] 2023-10-05T19:47:56.517 INFO:teuthology.orchestra.run.smithi118.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1278-g487ffcb5-1focal [56.3 MB] 2023-10-05T19:47:56.873 INFO:teuthology.orchestra.run.smithi167.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1278-g487ffcb5-1focal [79.5 kB] 2023-10-05T19:47:57.517 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 210 MB in 9s (22.2 MB/s) 2023-10-05T19:47:57.693 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-05T19:47:57.749 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-05T19:47:57.753 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-05T19:47:57.825 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-05T19:47:58.105 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../001-librbd1_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:47:58.220 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librbd1 (17.2.6-1278-g487ffcb5-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-05T19:47:58.924 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../002-librados2_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:47:59.050 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librados2 (17.2.6-1278-g487ffcb5-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-05T19:47:59.160 INFO:teuthology.orchestra.run.smithi118.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1278-g487ffcb5-1focal [229 kB] 2023-10-05T19:47:59.165 INFO:teuthology.orchestra.run.smithi118.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1278-g487ffcb5-1focal [21.9 kB] 2023-10-05T19:47:59.165 INFO:teuthology.orchestra.run.smithi118.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1278-g487ffcb5-1focal [17.1 MB] 2023-10-05T19:47:59.720 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs2. 2023-10-05T19:47:59.739 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../003-libcephfs2_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:47:59.755 INFO:teuthology.orchestra.run.smithi118.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-10-04-1333-quincy/487ffcb5ddb60d29c5688d1a457e812b1b697b90/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1278-g487ffcb5-1focal [79.5 kB] 2023-10-05T19:47:59.778 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:00.140 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rados. 2023-10-05T19:48:00.159 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../004-python3-rados_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:00.198 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rados (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:00.365 INFO:teuthology.orchestra.run.smithi118.stdout:Fetched 210 MB in 12s (16.9 MB/s) 2023-10-05T19:48:00.502 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-05T19:48:00.543 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-05T19:48:00.558 INFO:teuthology.orchestra.run.smithi118.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-05T19:48:00.558 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:00.562 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-05T19:48:00.601 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-argparse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:00.634 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-05T19:48:00.878 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cephfs. 2023-10-05T19:48:00.897 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../006-python3-cephfs_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:00.937 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cephfs (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:00.949 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../001-librbd1_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:01.097 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librbd1 (17.2.6-1278-g487ffcb5-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-05T19:48:01.265 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-05T19:48:01.281 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:01.314 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-common (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:01.601 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-prettytable. 2023-10-05T19:48:01.617 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2023-10-05T19:48:01.660 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-05T19:48:01.818 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../002-librados2_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:01.943 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librados2 (17.2.6-1278-g487ffcb5-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-05T19:48:01.945 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rbd. 2023-10-05T19:48:01.963 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../009-python3-rbd_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:02.004 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rbd (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:02.598 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs2. 2023-10-05T19:48:02.614 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../003-libcephfs2_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:02.632 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-05T19:48:02.649 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-05T19:48:02.656 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:02.690 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-05T19:48:03.026 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rados. 2023-10-05T19:48:03.044 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../004-python3-rados_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:03.058 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-05T19:48:03.078 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-05T19:48:03.083 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rados (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:03.111 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-05T19:48:03.432 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-05T19:48:03.451 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-05T19:48:03.453 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-05T19:48:03.472 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:03.508 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-05T19:48:03.511 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-argparse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:03.797 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cephfs. 2023-10-05T19:48:03.814 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../006-python3-cephfs_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:03.855 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cephfs (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:03.891 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-05T19:48:03.909 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-05T19:48:03.949 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-05T19:48:04.209 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-05T19:48:04.226 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:04.292 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-ceph-common (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:04.294 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-05T19:48:04.312 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-05T19:48:04.352 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-05T19:48:04.682 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-prettytable. 2023-10-05T19:48:04.701 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2023-10-05T19:48:04.812 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-05T19:48:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-05T19:48:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-05T19:48:04.909 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:48:05.157 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rbd. 2023-10-05T19:48:05.174 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../009-python3-rbd_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:05.215 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rbd (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:05.460 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-05T19:48:05.477 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-05T19:48:05.518 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:48:05.610 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-05T19:48:05.627 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-05T19:48:05.694 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-05T19:48:05.888 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-05T19:48:05.907 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-05T19:48:05.947 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:48:06.095 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-05T19:48:06.111 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-05T19:48:06.148 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-05T19:48:06.325 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-05T19:48:06.341 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-05T19:48:06.408 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-05T19:48:06.511 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-05T19:48:06.529 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-05T19:48:06.569 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-05T19:48:06.703 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librgw2. 2023-10-05T19:48:06.721 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../019-librgw2_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:06.753 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librgw2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:06.971 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-05T19:48:06.987 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-05T19:48:07.029 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-05T19:48:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-05T19:48:07.433 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-05T19:48:07.499 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-05T19:48:07.505 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rgw. 2023-10-05T19:48:07.525 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../020-python3-rgw_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:07.589 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rgw (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:07.942 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liboath0. 2023-10-05T19:48:07.962 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-05T19:48:07.986 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-05T19:48:08.000 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-05T19:48:08.003 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-05T19:48:08.055 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:48:08.295 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libradosstriper1. 2023-10-05T19:48:08.315 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../022-libradosstriper1_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:08.345 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libradosstriper1 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:08.565 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-05T19:48:08.582 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-05T19:48:08.623 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:48:08.823 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-common. 2023-10-05T19:48:08.840 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../023-ceph-common_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:08.881 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-common (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:09.010 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-05T19:48:09.026 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-05T19:48:09.068 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:48:09.463 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-05T19:48:09.479 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-05T19:48:09.522 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-05T19:48:09.959 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package librgw2. 2023-10-05T19:48:09.975 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../019-librgw2_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:10.050 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking librgw2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:10.803 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rgw. 2023-10-05T19:48:10.820 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../020-python3-rgw_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:10.853 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rgw (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:11.231 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liboath0. 2023-10-05T19:48:11.246 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-05T19:48:11.289 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-05T19:48:11.613 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-base. 2023-10-05T19:48:11.629 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../024-ceph-base_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:11.642 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libradosstriper1. 2023-10-05T19:48:11.659 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../022-libradosstriper1_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:11.681 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-base (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:11.700 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libradosstriper1 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:12.221 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-common. 2023-10-05T19:48:12.236 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../023-ceph-common_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:12.279 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-common (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:12.718 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cryptography. 2023-10-05T19:48:12.737 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-05T19:48:12.776 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-05T19:48:13.164 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-openssl. 2023-10-05T19:48:13.184 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-05T19:48:13.222 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-05T19:48:13.508 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-05T19:48:13.525 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:13.566 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:13.938 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-05T19:48:13.956 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-05T19:48:13.996 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-05T19:48:14.308 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-05T19:48:14.324 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-05T19:48:14.366 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-05T19:48:14.736 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-natsort. 2023-10-05T19:48:14.752 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../030-python3-natsort_7.0.1-1_all.deb ... 2023-10-05T19:48:14.794 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-05T19:48:15.019 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-base. 2023-10-05T19:48:15.035 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../024-ceph-base_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:15.087 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-base (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:15.115 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jwt. 2023-10-05T19:48:15.132 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../031-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-05T19:48:15.194 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-05T19:48:15.510 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-logutils. 2023-10-05T19:48:15.528 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../032-python3-logutils_0.3.3-7_all.deb ... 2023-10-05T19:48:15.568 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-05T19:48:15.888 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-05T19:48:15.905 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../033-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-05T19:48:15.962 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-05T19:48:16.256 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cryptography. 2023-10-05T19:48:16.266 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-mako. 2023-10-05T19:48:16.276 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-05T19:48:16.281 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../034-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-05T19:48:16.324 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-05T19:48:16.342 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-05T19:48:16.627 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-05T19:48:16.644 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../035-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-05T19:48:16.685 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-05T19:48:16.737 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-openssl. 2023-10-05T19:48:16.754 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-05T19:48:16.794 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-05T19:48:16.996 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-05T19:48:17.015 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../036-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-05T19:48:17.055 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-05T19:48:17.081 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-05T19:48:17.098 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:17.139 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:17.360 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webob. 2023-10-05T19:48:17.377 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../037-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-05T19:48:17.418 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-05T19:48:17.511 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-05T19:48:17.527 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-05T19:48:17.569 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-05T19:48:17.897 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-05T19:48:17.914 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-05T19:48:17.955 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-05T19:48:18.377 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-natsort. 2023-10-05T19:48:18.396 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../030-python3-natsort_7.0.1-1_all.deb ... 2023-10-05T19:48:18.430 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-05T19:48:18.442 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-05T19:48:18.447 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../038-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-05T19:48:18.564 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-05T19:48:18.788 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jwt. 2023-10-05T19:48:18.804 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../031-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-05T19:48:18.846 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-05T19:48:18.891 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-bs4. 2023-10-05T19:48:18.906 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../039-python3-bs4_4.8.2-1_all.deb ... 2023-10-05T19:48:18.949 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-05T19:48:19.158 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-logutils. 2023-10-05T19:48:19.175 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../032-python3-logutils_0.3.3-7_all.deb ... 2023-10-05T19:48:19.216 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-05T19:48:19.319 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-waitress. 2023-10-05T19:48:19.339 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../040-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-05T19:48:19.380 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-05T19:48:19.536 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-05T19:48:19.555 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../033-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-05T19:48:19.594 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-05T19:48:19.706 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-tempita. 2023-10-05T19:48:19.721 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-6_all.deb ... 2023-10-05T19:48:19.764 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-05T19:48:19.922 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-mako. 2023-10-05T19:48:19.938 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../034-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-05T19:48:19.980 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-05T19:48:20.084 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-paste. 2023-10-05T19:48:20.100 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../042-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-05T19:48:20.150 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-05T19:48:20.462 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-05T19:48:20.480 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-05T19:48:20.520 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-05T19:48:20.823 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-05T19:48:20.840 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../044-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-05T19:48:20.881 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-05T19:48:21.035 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-05T19:48:21.053 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../035-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-05T19:48:21.084 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-05T19:48:21.235 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webtest. 2023-10-05T19:48:21.254 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../045-python3-webtest_2.0.32-2_all.deb ... 2023-10-05T19:48:21.293 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-05T19:48:21.404 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-05T19:48:21.419 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../036-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-05T19:48:21.462 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-05T19:48:21.612 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pecan. 2023-10-05T19:48:21.631 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../046-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-05T19:48:21.671 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-05T19:48:21.799 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webob. 2023-10-05T19:48:21.815 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../037-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-05T19:48:21.857 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-05T19:48:22.026 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-05T19:48:22.044 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../047-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-05T19:48:22.084 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-05T19:48:22.160 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-05T19:48:22.178 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../038-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-05T19:48:22.210 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-05T19:48:22.454 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-05T19:48:22.470 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../048-libsqlite3-mod-ceph_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:22.512 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:22.580 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-bs4. 2023-10-05T19:48:22.596 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../039-python3-bs4_4.8.2-1_all.deb ... 2023-10-05T19:48:22.638 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-05T19:48:22.865 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr. 2023-10-05T19:48:22.884 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../049-ceph-mgr_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:22.923 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-waitress. 2023-10-05T19:48:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../040-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-05T19:48:23.111 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-05T19:48:23.435 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mon. 2023-10-05T19:48:23.453 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../050-ceph-mon_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:23.461 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-tempita. 2023-10-05T19:48:23.478 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-6_all.deb ... 2023-10-05T19:48:23.493 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mon (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:23.519 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-05T19:48:23.889 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-paste. 2023-10-05T19:48:23.906 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../042-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-05T19:48:23.947 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-05T19:48:24.335 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-05T19:48:24.352 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-05T19:48:24.393 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-05T19:48:24.664 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-osd. 2023-10-05T19:48:24.680 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../051-ceph-osd_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:24.722 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-osd (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:24.729 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-05T19:48:24.746 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../044-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-05T19:48:24.787 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-05T19:48:25.116 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webtest. 2023-10-05T19:48:25.131 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../045-python3-webtest_2.0.32-2_all.deb ... 2023-10-05T19:48:25.199 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-05T19:48:25.494 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pecan. 2023-10-05T19:48:25.513 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../046-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-05T19:48:25.577 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-05T19:48:25.957 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-05T19:48:25.974 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../047-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-05T19:48:26.015 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-05T19:48:26.377 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-05T19:48:26.393 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../048-libsqlite3-mod-ceph_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:26.435 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:26.830 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr. 2023-10-05T19:48:26.846 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../049-ceph-mgr_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:26.888 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:27.384 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mon. 2023-10-05T19:48:27.401 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../050-ceph-mon_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:27.441 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mon (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:27.684 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph. 2023-10-05T19:48:27.701 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../052-ceph_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:27.742 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:28.053 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-fuse. 2023-10-05T19:48:28.071 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../053-ceph-fuse_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:28.111 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-fuse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:28.539 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mds. 2023-10-05T19:48:28.557 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../054-ceph-mds_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:28.598 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mds (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:28.656 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-osd. 2023-10-05T19:48:28.676 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../051-ceph-osd_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:28.739 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-osd (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:29.159 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephadm. 2023-10-05T19:48:29.176 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../055-cephadm_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:29.217 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephadm (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:29.603 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jinja2. 2023-10-05T19:48:29.623 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2_all.deb ... 2023-10-05T19:48:29.661 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-05T19:48:29.981 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-05T19:48:30.000 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:30.039 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:30.368 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-05T19:48:30.387 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../058-python3-repoze.lru_0.7-2_all.deb ... 2023-10-05T19:48:30.426 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-05T19:48:30.704 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjs-underscore. 2023-10-05T19:48:30.720 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../059-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-05T19:48:30.762 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-05T19:48:31.039 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-05T19:48:31.056 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-05T19:48:31.123 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-05T19:48:31.442 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-routes. 2023-10-05T19:48:31.460 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../061-python3-routes_2.4.1-2_all.deb ... 2023-10-05T19:48:31.508 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-05T19:48:31.659 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph. 2023-10-05T19:48:31.675 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../052-ceph_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:31.740 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:31.862 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-05T19:48:31.878 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:31.920 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:32.103 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-fuse. 2023-10-05T19:48:32.122 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../053-ceph-fuse_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:32.161 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-fuse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:32.407 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-decorator. 2023-10-05T19:48:32.423 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../063-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-05T19:48:32.465 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-05T19:48:32.598 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mds. 2023-10-05T19:48:32.617 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../054-ceph-mds_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:32.656 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mds (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:32.768 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-05T19:48:32.785 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../064-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-05T19:48:32.851 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-05T19:48:33.148 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package cephadm. 2023-10-05T19:48:33.168 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../055-cephadm_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:33.170 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-scipy. 2023-10-05T19:48:33.191 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../065-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-05T19:48:33.209 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking cephadm (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:33.229 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-05T19:48:33.562 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-jinja2. 2023-10-05T19:48:33.578 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2_all.deb ... 2023-10-05T19:48:33.621 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-05T19:48:33.974 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-05T19:48:33.990 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:34.032 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:34.377 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-05T19:48:34.392 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../058-python3-repoze.lru_0.7-2_all.deb ... 2023-10-05T19:48:34.435 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-05T19:48:34.713 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjs-underscore. 2023-10-05T19:48:34.730 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../059-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-05T19:48:34.771 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-05T19:48:34.846 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-05T19:48:34.864 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../066-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-05T19:48:34.904 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-05T19:48:35.099 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-05T19:48:35.114 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-05T19:48:35.157 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-05T19:48:35.466 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-joblib. 2023-10-05T19:48:35.487 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../067-python3-joblib_0.14.0-3_all.deb ... 2023-10-05T19:48:35.493 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-routes. 2023-10-05T19:48:35.512 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../061-python3-routes_2.4.1-2_all.deb ... 2023-10-05T19:48:35.524 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-05T19:48:35.553 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-05T19:48:35.896 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-05T19:48:35.912 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:35.937 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn. 2023-10-05T19:48:35.953 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../068-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-05T19:48:35.987 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:35.995 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-05T19:48:36.712 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-05T19:48:36.732 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:36.770 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:36.975 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-decorator. 2023-10-05T19:48:36.992 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../063-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-05T19:48:37.033 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-05T19:48:37.377 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-05T19:48:37.394 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../064-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-05T19:48:37.435 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-05T19:48:37.780 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-scipy. 2023-10-05T19:48:37.798 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../065-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-05T19:48:37.838 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-05T19:48:37.865 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cachetools. 2023-10-05T19:48:37.883 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../070-python3-cachetools_4.0.0-1_all.deb ... 2023-10-05T19:48:37.915 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-05T19:48:38.202 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-05T19:48:38.220 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-05T19:48:38.260 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-05T19:48:38.572 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-05T19:48:38.591 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-05T19:48:38.629 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-05T19:48:38.966 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rsa. 2023-10-05T19:48:38.982 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../073-python3-rsa_4.0-3_all.deb ... 2023-10-05T19:48:39.024 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-05T19:48:39.181 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-05T19:48:39.198 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../066-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-05T19:48:39.239 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-05T19:48:39.344 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-google-auth. 2023-10-05T19:48:39.364 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../074-python3-google-auth_1.5.1-2_all.deb ... 2023-10-05T19:48:39.402 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-05T19:48:39.697 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-blinker. 2023-10-05T19:48:39.714 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../075-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-05T19:48:39.747 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-05T19:48:39.809 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-joblib. 2023-10-05T19:48:39.826 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../067-python3-joblib_0.14.0-3_all.deb ... 2023-10-05T19:48:39.867 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-05T19:48:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-05T19:48:40.058 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../076-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-05T19:48:40.100 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-05T19:48:40.255 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-sklearn. 2023-10-05T19:48:40.271 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../068-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-05T19:48:40.312 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-05T19:48:40.437 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-05T19:48:40.454 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../077-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-05T19:48:40.520 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-05T19:48:40.831 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-websocket. 2023-10-05T19:48:40.849 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../078-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-05T19:48:40.890 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-05T19:48:41.088 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-05T19:48:41.107 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:41.179 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:41.218 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-05T19:48:41.234 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../079-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-05T19:48:41.276 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-05T19:48:41.831 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-05T19:48:41.849 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../080-ceph-mgr-k8sevents_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:41.889 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:42.311 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-05T19:48:42.329 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../081-libonig5_6.9.4-1_amd64.deb ... 2023-10-05T19:48:42.357 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-cachetools. 2023-10-05T19:48:42.369 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-05T19:48:42.377 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../070-python3-cachetools_4.0.0-1_all.deb ... 2023-10-05T19:48:42.415 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-05T19:48:42.723 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-05T19:48:42.726 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-05T19:48:42.739 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../082-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-05T19:48:42.745 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-05T19:48:42.784 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-05T19:48:42.806 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-05T19:48:43.067 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package jq. 2023-10-05T19:48:43.083 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../083-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-05T19:48:43.125 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-05T19:48:43.147 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-05T19:48:43.163 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-05T19:48:43.205 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-05T19:48:43.412 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package socat. 2023-10-05T19:48:43.431 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../084-socat_1.7.3.3-2_amd64.deb ... 2023-10-05T19:48:43.470 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-05T19:48:43.541 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-rsa. 2023-10-05T19:48:43.558 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../073-python3-rsa_4.0-3_all.deb ... 2023-10-05T19:48:43.599 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-05T19:48:43.774 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package xmlstarlet. 2023-10-05T19:48:43.790 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-05T19:48:43.832 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-05T19:48:43.944 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-google-auth. 2023-10-05T19:48:43.962 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../074-python3-google-auth_1.5.1-2_all.deb ... 2023-10-05T19:48:44.011 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-05T19:48:44.204 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-test. 2023-10-05T19:48:44.221 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../086-ceph-test_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:44.262 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-test (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:44.364 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-blinker. 2023-10-05T19:48:44.380 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../075-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-05T19:48:44.447 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-05T19:48:44.733 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-05T19:48:44.753 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../076-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-05T19:48:44.816 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-05T19:48:45.170 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-05T19:48:45.187 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../077-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-05T19:48:45.228 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-05T19:48:45.564 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-websocket. 2023-10-05T19:48:45.584 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../078-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-05T19:48:45.622 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-05T19:48:45.959 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-05T19:48:45.975 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../079-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-05T19:48:46.017 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-05T19:48:46.581 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-05T19:48:46.598 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../080-ceph-mgr-k8sevents_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:46.655 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:47.069 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-05T19:48:47.087 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../081-libonig5_6.9.4-1_amd64.deb ... 2023-10-05T19:48:47.127 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-05T19:48:47.506 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-05T19:48:47.523 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../082-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-05T19:48:47.564 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-05T19:48:47.908 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package jq. 2023-10-05T19:48:47.926 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../083-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-05T19:48:47.966 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-05T19:48:48.261 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package socat. 2023-10-05T19:48:48.281 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../084-socat_1.7.3.3-2_amd64.deb ... 2023-10-05T19:48:48.319 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-05T19:48:48.673 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package xmlstarlet. 2023-10-05T19:48:48.691 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-05T19:48:48.756 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-05T19:48:49.128 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-test. 2023-10-05T19:48:49.149 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../086-ceph-test_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:49.186 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-test (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:49.340 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-volume. 2023-10-05T19:48:49.360 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../087-ceph-volume_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:49.390 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-volume (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:49.721 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-05T19:48:49.738 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../088-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-05T19:48:49.804 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-05T19:48:50.267 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-05T19:48:50.285 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../089-libcephfs-dev_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:50.316 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs-dev (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:50.712 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package nvme-cli. 2023-10-05T19:48:50.732 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-05T19:48:50.787 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-05T19:48:51.150 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-05T19:48:51.168 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../091-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-05T19:48:51.208 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-05T19:48:52.879 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-05T19:48:52.896 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../092-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-05T19:48:52.938 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-05T19:48:53.248 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-05T19:48:53.268 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../093-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-05T19:48:53.305 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-05T19:48:53.634 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-attr. 2023-10-05T19:48:53.650 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../094-python3-attr_19.3.0-2_all.deb ... 2023-10-05T19:48:53.692 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-05T19:48:54.028 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webencodings. 2023-10-05T19:48:54.046 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../095-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-05T19:48:54.086 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-05T19:48:54.389 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-html5lib. 2023-10-05T19:48:54.397 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package ceph-volume. 2023-10-05T19:48:54.406 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../096-python3-html5lib_1.0.1-2_all.deb ... 2023-10-05T19:48:54.415 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../087-ceph-volume_17.2.6-1278-g487ffcb5-1focal_all.deb ... 2023-10-05T19:48:54.447 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-05T19:48:54.448 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking ceph-volume (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:54.809 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-05T19:48:54.826 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../097-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-05T19:48:54.845 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-05T19:48:54.862 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../088-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-05T19:48:54.866 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-05T19:48:54.903 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-05T19:48:55.378 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-packaging. 2023-10-05T19:48:55.397 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../098-python3-packaging_20.3-1_all.deb ... 2023-10-05T19:48:55.436 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-05T19:48:55.465 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-05T19:48:55.483 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../089-libcephfs-dev_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:55.523 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libcephfs-dev (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:55.756 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastescript. 2023-10-05T19:48:55.776 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2023-10-05T19:48:55.814 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-05T19:48:55.943 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package nvme-cli. 2023-10-05T19:48:55.962 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-05T19:48:56.019 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-05T19:48:56.126 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pluggy. 2023-10-05T19:48:56.143 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2023-10-05T19:48:56.184 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-05T19:48:56.357 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-05T19:48:56.374 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../091-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-05T19:48:56.440 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-05T19:48:56.503 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-psutil. 2023-10-05T19:48:56.524 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-05T19:48:56.561 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-05T19:48:56.914 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-py. 2023-10-05T19:48:56.933 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-05T19:48:56.972 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-05T19:48:57.309 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-05T19:48:57.326 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-05T19:48:57.367 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-05T19:48:57.688 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-05T19:48:57.708 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-05T19:48:57.745 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-05T19:48:58.065 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pytest. 2023-10-05T19:48:58.085 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2023-10-05T19:48:58.132 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-05T19:48:58.194 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-05T19:48:58.215 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../092-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-05T19:48:58.277 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-05T19:48:58.469 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplejson. 2023-10-05T19:48:58.486 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-05T19:48:58.526 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-05T19:48:58.622 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-05T19:48:58.641 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../093-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-05T19:48:58.679 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-05T19:48:58.813 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-05T19:48:58.832 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-05T19:48:58.873 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-05T19:48:59.018 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-attr. 2023-10-05T19:48:59.035 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../094-python3-attr_19.3.0-2_all.deb ... 2023-10-05T19:48:59.077 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-05T19:48:59.429 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-webencodings. 2023-10-05T19:48:59.449 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../095-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-05T19:48:59.489 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-05T19:48:59.634 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package radosgw. 2023-10-05T19:48:59.651 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../108-radosgw_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:48:59.693 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking radosgw (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:48:59.790 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-html5lib. 2023-10-05T19:48:59.807 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../096-python3-html5lib_1.0.1-2_all.deb ... 2023-10-05T19:48:59.839 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-05T19:49:00.193 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-05T19:49:00.210 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../097-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-05T19:49:00.268 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-05T19:49:00.705 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-packaging. 2023-10-05T19:49:00.723 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../098-python3-packaging_20.3-1_all.deb ... 2023-10-05T19:49:00.771 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-05T19:49:01.116 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pastescript. 2023-10-05T19:49:01.134 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2023-10-05T19:49:01.174 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-05T19:49:01.404 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package rbd-fuse. 2023-10-05T19:49:01.421 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../109-rbd-fuse_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:49:01.462 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking rbd-fuse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:01.494 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pluggy. 2023-10-05T19:49:01.514 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2023-10-05T19:49:01.552 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-05T19:49:01.793 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-05T19:49:01.897 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-psutil. 2023-10-05T19:49:01.915 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-05T19:49:01.955 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-05T19:49:02.112 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-05T19:49:02.230 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-05T19:49:02.334 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-py. 2023-10-05T19:49:02.351 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-05T19:49:02.356 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-05T19:49:02.466 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-05T19:49:02.566 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephadm (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:02.820 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-05T19:49:02.838 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-05T19:49:02.904 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-05T19:49:03.169 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user cephadm....done 2023-10-05T19:49:03.240 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-05T19:49:03.261 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-05T19:49:03.298 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-05T19:49:03.355 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-05T19:49:03.482 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-05T19:49:03.602 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-pytest. 2023-10-05T19:49:03.622 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2023-10-05T19:49:03.659 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-05T19:49:03.859 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-05T19:49:04.021 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package python3-simplejson. 2023-10-05T19:49:04.041 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-05T19:49:04.079 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-05T19:49:04.135 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-05T19:49:04.252 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-05T19:49:04.366 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-05T19:49:04.378 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-05T19:49:04.383 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-05T19:49:04.425 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-05T19:49:04.734 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-05T19:49:05.204 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package radosgw. 2023-10-05T19:49:05.220 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../108-radosgw_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:49:05.261 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-05T19:49:05.262 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking radosgw (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:05.566 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-05T19:49:05.856 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-05T19:49:06.157 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-05T19:49:06.433 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-argparse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:06.734 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-05T19:49:06.854 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-05T19:49:07.090 INFO:teuthology.orchestra.run.smithi118.stdout:Selecting previously unselected package rbd-fuse. 2023-10-05T19:49:07.118 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing to unpack .../109-rbd-fuse_17.2.6-1278-g487ffcb5-1focal_amd64.deb ... 2023-10-05T19:49:07.130 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-05T19:49:07.148 INFO:teuthology.orchestra.run.smithi118.stdout:Unpacking rbd-fuse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:07.415 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-05T19:49:07.540 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-05T19:49:07.900 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-05T19:49:07.950 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-05T19:49:08.168 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-05T19:49:08.241 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-05T19:49:08.367 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-05T19:49:08.461 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-05T19:49:08.551 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-05T19:49:08.745 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up cephadm (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:08.787 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-05T19:49:09.080 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-05T19:49:09.406 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-05T19:49:09.431 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user cephadm....done 2023-10-05T19:49:09.627 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-05T19:49:09.699 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-05T19:49:09.753 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-05T19:49:10.125 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-05T19:49:10.138 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-05T19:49:10.251 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-05T19:49:10.352 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-05T19:49:10.431 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-05T19:49:10.557 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-05T19:49:10.637 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-05T19:49:10.704 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-05T19:49:11.039 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-05T19:49:11.047 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-05T19:49:11.423 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-05T19:49:11.475 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-05T19:49:11.776 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-05T19:49:11.800 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-05T19:49:11.926 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-common (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:12.087 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-05T19:49:12.228 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:49:12.363 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-05T19:49:12.371 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-05T19:49:12.697 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-argparse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:12.714 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-05T19:49:12.840 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-05T19:49:12.952 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-05T19:49:13.023 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-05T19:49:13.152 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-05T19:49:13.254 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-05T19:49:13.419 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-05T19:49:13.571 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:49:13.712 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-05T19:49:13.731 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-05T19:49:13.857 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-05T19:49:13.863 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-05T19:49:14.204 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-05T19:49:14.231 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-05T19:49:14.479 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-05T19:49:14.507 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-05T19:49:14.776 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-05T19:49:14.782 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-05T19:49:14.915 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-05T19:49:15.160 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-05T19:49:15.191 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-05T19:49:15.476 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-05T19:49:15.478 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-05T19:49:15.752 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-05T19:49:15.837 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-05T19:49:16.135 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-05T19:49:16.139 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-05T19:49:16.388 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-05T19:49:16.415 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-05T19:49:16.516 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-05T19:49:16.541 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-05T19:49:16.667 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-05T19:49:16.867 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-05T19:49:16.985 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-05T19:49:17.227 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-05T19:49:17.353 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-05T19:49:17.387 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-05T19:49:17.479 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-05T19:49:17.764 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-05T19:49:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-05T19:49:18.106 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librados2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:18.115 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-05T19:49:18.216 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-ceph-common (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:18.257 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-05T19:49:18.536 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:49:18.670 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-05T19:49:19.068 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-05T19:49:19.174 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-05T19:49:19.301 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-05T19:49:19.586 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-05T19:49:19.704 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:19.830 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-05T19:49:19.913 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:49:19.973 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-05T19:49:20.038 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-05T19:49:20.189 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-05T19:49:20.325 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-05T19:49:20.519 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-05T19:49:20.626 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-05T19:49:20.796 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-05T19:49:20.927 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:49:21.053 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-05T19:49:21.113 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-05T19:49:21.273 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-05T19:49:21.429 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:21.555 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-05T19:49:21.574 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-05T19:49:21.893 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-05T19:49:21.899 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libradosstriper1 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:22.033 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-05T19:49:22.193 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-05T19:49:22.376 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-05T19:49:22.590 INFO:teuthology.orchestra.run.smithi118.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-05T19:49:22.873 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-05T19:49:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-05T19:49:23.351 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-05T19:49:23.465 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librbd1 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:23.590 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-05T19:49:23.702 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-05T19:49:23.717 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-05T19:49:23.828 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-05T19:49:23.843 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-05T19:49:23.954 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-05T19:49:23.968 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-05T19:49:24.295 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-05T19:49:24.354 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-05T19:49:24.421 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-05T19:49:24.640 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librados2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:24.738 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-modules-core (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:24.815 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-05T19:49:24.864 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-fuse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:25.088 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-05T19:49:25.088 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-05T19:49:25.499 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs-dev (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:25.752 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-05T19:49:26.054 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-05T19:49:26.271 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:26.380 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-05T19:49:26.397 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-05T19:49:26.549 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-05T19:49:26.749 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rados (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:26.901 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librgw2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:26.934 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-05T19:49:27.027 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rbd (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:27.144 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up rbd-fuse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:27.226 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-05T19:49:27.270 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-05T19:49:27.544 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-05T19:49:27.571 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-05T19:49:27.670 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-05T19:49:27.873 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rgw (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:27.999 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cephfs (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:28.005 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:28.131 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-05T19:49:28.152 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-05T19:49:28.466 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libradosstriper1 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:28.626 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-05T19:49:28.960 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-05T19:49:29.072 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-common (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:29.625 INFO:teuthology.orchestra.run.smithi167.stdout:Adding group ceph....done 2023-10-05T19:49:29.991 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librbd1 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:30.027 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user ceph....done 2023-10-05T19:49:30.117 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-05T19:49:30.212 INFO:teuthology.orchestra.run.smithi167.stdout:Setting system user ceph properties....done 2023-10-05T19:49:30.234 INFO:teuthology.orchestra.run.smithi167.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-05T19:49:30.260 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-05T19:49:30.388 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-05T19:49:30.410 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-05T19:49:30.537 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-05T19:49:30.718 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-05T19:49:30.838 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-05T19:49:30.964 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-05T19:49:31.158 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-test (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:31.283 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up radosgw (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:31.458 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-modules-core (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:31.458 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-fuse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:31.553 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-05T19:49:31.601 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-05T19:49:31.676 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-05T19:49:31.677 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-05T19:49:32.142 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up libcephfs-dev (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:32.213 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-base (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:32.354 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-05T19:49:32.586 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-05T19:49:32.697 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-05T19:49:33.023 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mds (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:33.048 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-05T19:49:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-05T19:49:33.255 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-05T19:49:33.480 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rados (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:33.619 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up librgw2 (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:33.683 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:33.745 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rbd (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:33.896 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up rbd-fuse (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:33.932 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-05T19:49:33.932 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-05T19:49:34.022 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-05T19:49:34.324 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-05T19:49:34.393 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-osd (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:34.634 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-rgw (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:34.760 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-cephfs (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-05T19:49:34.892 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-05T19:49:34.908 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-05T19:49:35.328 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:35.454 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:35.622 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mon (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:35.806 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-common (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:35.828 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-05T19:49:35.828 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-05T19:49:36.258 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-cephadm (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:36.392 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:36.425 INFO:teuthology.orchestra.run.smithi118.stdout:Adding group ceph....done 2023-10-05T19:49:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-dashboard (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:36.706 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-volume (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:36.819 INFO:teuthology.orchestra.run.smithi118.stdout:Adding system user ceph....done 2023-10-05T19:49:36.832 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-05T19:49:36.984 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-05T19:49:36.995 INFO:teuthology.orchestra.run.smithi118.stdout:Setting system user ceph properties....done 2023-10-05T19:49:37.019 INFO:teuthology.orchestra.run.smithi118.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-05T19:49:37.169 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-05T19:49:37.285 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-05T19:49:37.483 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-05T19:49:37.934 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-test (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:38.070 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up radosgw (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:38.394 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-05T19:49:38.394 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-05T19:49:39.056 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-base (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:39.461 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-05T19:49:39.950 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mds (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:40.186 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-05T19:49:40.186 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-05T19:49:40.213 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-05T19:49:40.702 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:40.760 INFO:teuthology.orchestra.run.smithi167.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-05T19:49:40.762 DEBUG:teuthology.parallel:result is None 2023-10-05T19:49:40.936 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-05T19:49:40.937 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-05T19:49:41.387 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-osd (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:41.891 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-05T19:49:41.891 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-05T19:49:42.355 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:42.514 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:42.657 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mon (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:42.929 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-05T19:49:42.929 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-05T19:49:43.384 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-cephadm (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:43.561 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:43.720 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-mgr-dashboard (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:44.266 INFO:teuthology.orchestra.run.smithi118.stdout:Setting up ceph-volume (17.2.6-1278-g487ffcb5-1focal) ... 2023-10-05T19:49:44.403 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-05T19:49:44.589 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-05T19:49:44.856 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-05T19:49:47.676 INFO:teuthology.orchestra.run.smithi118.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-05T19:49:48.298 INFO:teuthology.orchestra.run.smithi118.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-05T19:49:48.301 DEBUG:teuthology.parallel:result is None 2023-10-05T19:49:48.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T19:49:48.441 DEBUG:teuthology.orchestra.run.smithi118:> dpkg-query -W -f '${Version}' ceph 2023-10-05T19:49:48.464 INFO:teuthology.orchestra.run.smithi118.stdout:17.2.6-1278-g487ffcb5-1focal 2023-10-05T19:49:48.465 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1278-g487ffcb5-1focal 2023-10-05T19:49:48.465 INFO:teuthology.task.install:The correct ceph version 17.2.6-1278-g487ffcb5-1focal is installed. 2023-10-05T19:49:48.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=487ffcb5ddb60d29c5688d1a457e812b1b697b90 2023-10-05T19:49:48.603 DEBUG:teuthology.orchestra.run.smithi167:> dpkg-query -W -f '${Version}' ceph 2023-10-05T19:49:48.627 INFO:teuthology.orchestra.run.smithi167.stdout:17.2.6-1278-g487ffcb5-1focal 2023-10-05T19:49:48.627 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1278-g487ffcb5-1focal 2023-10-05T19:49:48.627 INFO:teuthology.task.install:The correct ceph version 17.2.6-1278-g487ffcb5-1focal is installed. 2023-10-05T19:49:48.627 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-05T19:49:48.628 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:48.628 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T19:49:48.644 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:48.644 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T19:49:48.685 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-05T19:49:48.685 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:48.685 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T19:49:48.701 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T19:49:48.715 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:48.716 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T19:49:48.732 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T19:49:48.745 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-05T19:49:48.746 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:48.746 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T19:49:48.774 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T19:49:48.784 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:48.784 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T19:49:48.796 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T19:49:48.853 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-05T19:49:48.853 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:48.853 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T19:49:48.869 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T19:49:48.925 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:48.925 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T19:49:48.941 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T19:49:48.951 INFO:teuthology.run_tasks:Running task ceph... 2023-10-05T19:49:49.017 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-05T19:49:49.018 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2023-10-05T19:49:49.020 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2023-10-05T19:49:49.036 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-05T19:49:49.036 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-05T19:49:49.076 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-05T19:49:49.092 INFO:tasks.ceph:Creating extra log directories... 2023-10-05T19:49:49.092 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-05T19:49:49.094 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-05T19:49:49.156 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-05T19:49:49.156 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-05T19:49:49.156 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765', 'branch': 'wip-yuri2-testing-2023-10-04-1333-quincy', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7411765', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2023-10-04-1333-quincy'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'workunit': {'branch': 'wip-yuri2-testing-2023-10-04-1333-quincy', 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 880, 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'rgw', 'suite_branch': 'wip-yuri2-testing-2023-10-04-1333-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_487ffcb5ddb60d29c5688d1a457e812b1b697b90/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'targets': {'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '487ffcb5ddb60d29c5688d1a457e812b1b697b90', 'wait-for-scrub': False, 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_14:30:58', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-05T19:49:49.157 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-05T19:49:49.159 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-05T19:49:49.165 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2023-10-05T19:49:49.167 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2023-10-05T19:49:49.221 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:49.221 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T19:49:49.228 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T19:49:49.228 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2023-10-05T19:49:49.278 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T19:49:49.278 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T19:49:49.278 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-10-05T19:49:49.278 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T19:49:49.278 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-05 19:46:07.818881271 +0000 2023-10-05T19:49:49.278 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-05 19:46:07.558887263 +0000 2023-10-05T19:49:49.278 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-05 19:46:07.558887263 +0000 2023-10-05T19:49:49.279 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-05T19:49:49.279 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T19:49:49.291 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-05T19:49:49.291 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-05T19:49:49.291 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.00030028 s, 1.7 MB/s 2023-10-05T19:49:49.292 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T19:49:49.299 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2023-10-05T19:49:49.304 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T19:49:49.304 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T19:49:49.305 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-10-05T19:49:49.305 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T19:49:49.305 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-05 19:46:08.322869654 +0000 2023-10-05T19:49:49.305 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-05 19:46:08.046876015 +0000 2023-10-05T19:49:49.305 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-05 19:46:08.046876015 +0000 2023-10-05T19:49:49.305 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-05T19:49:49.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T19:49:49.359 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-05T19:49:49.360 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-05T19:49:49.360 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000273408 s, 1.9 MB/s 2023-10-05T19:49:49.360 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T19:49:49.369 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2023-10-05T19:49:49.375 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T19:49:49.375 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T19:49:49.375 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-10-05T19:49:49.375 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T19:49:49.375 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-05 19:46:08.778859142 +0000 2023-10-05T19:49:49.375 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-05 19:46:08.506865413 +0000 2023-10-05T19:49:49.375 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-05 19:46:08.506865413 +0000 2023-10-05T19:49:49.376 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-05T19:49:49.376 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T19:49:49.388 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-05T19:49:49.388 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-05T19:49:49.388 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000298284 s, 1.7 MB/s 2023-10-05T19:49:49.389 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T19:49:49.439 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2023-10-05T19:49:49.446 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T19:49:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T19:49:49.447 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 6h/6d Inode: 376 Links: 1 2023-10-05T19:49:49.447 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T19:49:49.447 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2023-10-05 19:46:09.282847525 +0000 2023-10-05T19:49:49.447 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2023-10-05 19:46:08.982854441 +0000 2023-10-05T19:49:49.447 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2023-10-05 19:46:08.982854441 +0000 2023-10-05T19:49:49.447 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: - 2023-10-05T19:49:49.447 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T19:49:49.458 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2023-10-05T19:49:49.458 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2023-10-05T19:49:49.458 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.00030745 s, 1.7 MB/s 2023-10-05T19:49:49.459 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T19:49:49.511 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-10-05T19:49:49.512 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:49.512 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T19:49:49.519 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T19:49:49.519 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2023-10-05T19:49:49.526 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T19:49:49.526 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T19:49:49.526 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-10-05T19:49:49.526 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T19:49:49.526 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-10-05 19:46:07.148066863 +0000 2023-10-05T19:49:49.526 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-10-05 19:46:06.868073305 +0000 2023-10-05T19:49:49.527 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-10-05 19:46:06.868073305 +0000 2023-10-05T19:49:49.527 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2023-10-05T19:49:49.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T19:49:49.540 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-10-05T19:49:49.540 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-10-05T19:49:49.540 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000389925 s, 1.3 MB/s 2023-10-05T19:49:49.541 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T19:49:49.549 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2023-10-05T19:49:49.596 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T19:49:49.597 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T19:49:49.597 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 367 Links: 1 2023-10-05T19:49:49.597 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T19:49:49.597 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-10-05 19:46:07.632055728 +0000 2023-10-05T19:49:49.597 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-10-05 19:46:07.360061986 +0000 2023-10-05T19:49:49.597 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-10-05 19:46:07.360061986 +0000 2023-10-05T19:49:49.597 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2023-10-05T19:49:49.597 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T19:49:49.610 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-10-05T19:49:49.610 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-10-05T19:49:49.610 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000399371 s, 1.3 MB/s 2023-10-05T19:49:49.611 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T19:49:49.620 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2023-10-05T19:49:49.669 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T19:49:49.669 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T19:49:49.669 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-10-05T19:49:49.669 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T19:49:49.669 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-10-05 19:46:08.132044226 +0000 2023-10-05T19:49:49.669 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-10-05 19:46:07.840050944 +0000 2023-10-05T19:49:49.669 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-10-05 19:46:07.840050944 +0000 2023-10-05T19:49:49.669 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2023-10-05T19:49:49.670 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T19:49:49.681 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-10-05T19:49:49.681 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-10-05T19:49:49.681 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000389634 s, 1.3 MB/s 2023-10-05T19:49:49.682 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T19:49:49.691 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2023-10-05T19:49:49.697 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T19:49:49.697 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T19:49:49.697 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-10-05T19:49:49.697 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T19:49:49.697 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2023-10-05 19:46:08.624032905 +0000 2023-10-05T19:49:49.697 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2023-10-05 19:46:08.352039164 +0000 2023-10-05T19:49:49.697 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2023-10-05 19:46:08.352039164 +0000 2023-10-05T19:49:49.698 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2023-10-05T19:49:49.698 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T19:49:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2023-10-05T19:49:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2023-10-05T19:49:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000420168 s, 1.2 MB/s 2023-10-05T19:49:49.712 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T19:49:49.762 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-10-05T19:49:49.762 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-10-05T19:49:49.762 INFO:tasks.ceph:Generating config... 2023-10-05T19:49:49.763 INFO:tasks.ceph:[client] debug ms = 1 2023-10-05T19:49:49.763 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2023-10-05T19:49:49.763 INFO:tasks.ceph:[client] debug rgw = 20 2023-10-05T19:49:49.764 INFO:tasks.ceph:[client] setgroup = ceph 2023-10-05T19:49:49.764 INFO:tasks.ceph:[client] setuser = ceph 2023-10-05T19:49:49.764 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-05T19:49:49.764 INFO:tasks.ceph:[osd] debug objclass = 20 2023-10-05T19:49:49.764 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-05T19:49:49.764 INFO:tasks.ceph:[osd] osd objectstore = filestore 2023-10-05T19:49:49.764 INFO:tasks.ceph:[osd] osd sloppy crc = True 2023-10-05T19:49:49.764 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-05T19:49:49.764 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-05T19:49:49.764 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-05T19:49:49.764 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-05T19:49:49.765 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-05T19:49:49.765 INFO:tasks.ceph:Setting up mon.a... 2023-10-05T19:49:49.765 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-05T19:49:49.799 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.keyring 2023-10-05T19:49:49.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-05T19:49:49.839 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-05T19:49:49.899 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.118')] 2023-10-05T19:49:49.900 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.118'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2023-10-05T19:49:49.900 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:49.900 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-05T19:49:49.905 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.118 --print /home/ubuntu/cephtest/ceph.monmap 2023-10-05T19:49:49.978 INFO:teuthology.orchestra.run.smithi118.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:49:49.979 INFO:teuthology.orchestra.run.smithi118.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:49:49.979 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-05T19:49:49.979 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: generated fsid 3d9357fa-146c-4f86-b124-205784953dac 2023-10-05T19:49:49.979 INFO:teuthology.orchestra.run.smithi118.stdout:setting min_mon_release = octopus 2023-10-05T19:49:49.979 INFO:teuthology.orchestra.run.smithi118.stdout:epoch 0 2023-10-05T19:49:49.980 INFO:teuthology.orchestra.run.smithi118.stdout:fsid 3d9357fa-146c-4f86-b124-205784953dac 2023-10-05T19:49:49.980 INFO:teuthology.orchestra.run.smithi118.stdout:last_changed 2023-10-05T19:49:49.976961+0000 2023-10-05T19:49:49.980 INFO:teuthology.orchestra.run.smithi118.stdout:created 2023-10-05T19:49:49.976961+0000 2023-10-05T19:49:49.980 INFO:teuthology.orchestra.run.smithi118.stdout:min_mon_release 15 (octopus) 2023-10-05T19:49:49.980 INFO:teuthology.orchestra.run.smithi118.stdout:election_strategy: 1 2023-10-05T19:49:49.980 INFO:teuthology.orchestra.run.smithi118.stdout:0: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.a 2023-10-05T19:49:49.980 INFO:teuthology.orchestra.run.smithi118.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-10-05T19:49:49.981 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-05T19:49:49.985 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3d9357fa-146c-4f86-b124-205784953dac... 2023-10-05T19:49:49.986 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-05T19:49:49.988 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-05T19:49:50.019 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2023-10-05T19:49:50.019 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2023-10-05T19:49:50.019 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-05T19:49:50.019 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2023-10-05T19:49:50.019 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.019 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2023-10-05T19:49:50.019 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.020 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2023-10-05T19:49:50.021 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2023-10-05T19:49:50.022 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = 172.21.15.118 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 3d9357fa-146c-4f86-b124-205784953dac 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2023-10-05T19:49:50.023 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.024 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-10-05T19:49:50.025 INFO:teuthology.orchestra.run.smithi118.stdout: debug objclass = 20 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = filestore 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: osd sloppy crc = True 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-10-05T19:49:50.026 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2023-10-05T19:49:50.027 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-05T19:49:50.028 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2023-10-05T19:49:50.029 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2023-10-05T19:49:50.030 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-05T19:49:50.030 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-05T19:49:50.030 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2023-10-05T19:49:50.030 INFO:teuthology.orchestra.run.smithi118.stdout: rgw gc obj min wait = 15 2023-10-05T19:49:50.030 INFO:teuthology.orchestra.run.smithi118.stdout: debug rgw = 20 2023-10-05T19:49:50.030 INFO:teuthology.orchestra.run.smithi118.stdout: setgroup = ceph 2023-10-05T19:49:50.030 INFO:teuthology.orchestra.run.smithi118.stdout: setuser = ceph 2023-10-05T19:49:50.030 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2023-10-05T19:49:50.032 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2023-10-05T19:49:50.032 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2023-10-05T19:49:50.032 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-05T19:49:50.032 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2023-10-05T19:49:50.032 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.032 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2023-10-05T19:49:50.032 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.032 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2023-10-05T19:49:50.032 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.033 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2023-10-05T19:49:50.033 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2023-10-05T19:49:50.033 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.033 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2023-10-05T19:49:50.033 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2023-10-05T19:49:50.033 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2023-10-05T19:49:50.034 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = 172.21.15.118 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = 3d9357fa-146c-4f86-b124-205784953dac 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2023-10-05T19:49:50.036 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2023-10-05T19:49:50.038 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug objclass = 20 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = filestore 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd sloppy crc = True 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-10-05T19:49:50.039 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2023-10-05T19:49:50.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: rgw gc obj min wait = 15 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: debug rgw = 20 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: setgroup = ceph 2023-10-05T19:49:50.042 INFO:teuthology.orchestra.run.smithi167.stdout: setuser = ceph 2023-10-05T19:49:50.043 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2023-10-05T19:49:50.043 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-05T19:49:50.043 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-05T19:49:50.125 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-05T19:49:50.125 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:50.125 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-05T19:49:50.132 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:50.132 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-05T19:49:50.138 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2023-10-05T19:49:50.138 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:50.138 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-05T19:49:50.139 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-05T19:49:50.163 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:50.163 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-05T19:49:50.169 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T19:49:50.169 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:50.169 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-05T19:49:50.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-05T19:49:50.197 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:50.197 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-05T19:49:50.202 INFO:tasks.ceph:Setting up mon nodes... 2023-10-05T19:49:50.202 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-05T19:49:50.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-05T19:49:50.242 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-05T19:49:50.245 INFO:tasks.ceph:Setting up mds nodes... 2023-10-05T19:49:50.245 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-05T19:49:50.245 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-05T19:49:50.322 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-05T19:49:50.334 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-05T19:49:50.335 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-10-05T19:49:50.335 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-05T19:49:50.351 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-10-05T19:49:50.351 INFO:tasks.ceph:role: osd.0 2023-10-05T19:49:50.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-05T19:49:50.351 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-05T19:49:50.394 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T19:49:50.394 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T19:49:50.394 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T19:49:50.394 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 2023-10-05T19:49:50.394 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T19:49:50.395 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2023-10-05T19:49:50.395 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T19:49:50.395 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-05T19:49:50.395 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T19:49:50.395 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T19:49:50.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2023-10-05T19:49:50.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-05T19:49:50.417 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-05T19:49:50.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:49:50.425 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: /sbin/restorecon: command not found 2023-10-05T19:49:50.426 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T19:49:50.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:50.538+0000 7fb5ab3b93c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-05T19:49:50.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:50.538+0000 7fb5ab3b93c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-05T19:49:50.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:50.550+0000 7fb5ab3b93c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:50.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:50.550+0000 7fb5ab3b93c0 -1 journal FileJournal::_open_file : zeroing journal 2023-10-05T19:49:50.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:50.626+0000 7fb5ab3b93c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:50.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:50.626+0000 7fb5ab3b93c0 -1 journal do_read_entry(4096): bad header magic 2023-10-05T19:49:50.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:50.626+0000 7fb5ab3b93c0 -1 journal do_read_entry(4096): bad header magic 2023-10-05T19:49:50.646 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-05T19:49:50.660 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-05T19:49:50.677 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-10-05T19:49:50.677 INFO:tasks.ceph:role: osd.1 2023-10-05T19:49:50.677 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T19:49:50.677 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-05T19:49:51.208 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T19:49:51.208 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T19:49:51.208 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T19:49:51.208 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 2023-10-05T19:49:51.209 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T19:49:51.209 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-10-05T19:49:51.209 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T19:49:51.209 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-05T19:49:51.209 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T19:49:51.209 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T19:49:51.210 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-10-05T19:49:51.210 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-10-05T19:49:51.312 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-05T19:49:51.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:49:51.322 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2023-10-05T19:49:51.322 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-05T19:49:51.333 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-10-05T19:49:51.334 INFO:tasks.ceph:role: osd.2 2023-10-05T19:49:51.334 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T19:49:51.334 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-05T19:49:51.852 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T19:49:51.853 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T19:49:51.853 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T19:49:51.853 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 2023-10-05T19:49:51.853 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T19:49:51.853 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-10-05T19:49:51.853 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T19:49:51.853 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-05T19:49:51.853 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T19:49:51.853 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T19:49:51.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-10-05T19:49:51.855 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2023-10-05T19:49:51.901 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-05T19:49:51.910 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2023-10-05T19:49:51.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:49:51.911 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-05T19:49:51.967 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-10-05T19:49:51.967 INFO:tasks.ceph:role: osd.3 2023-10-05T19:49:51.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T19:49:51.967 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-05T19:49:52.438 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T19:49:52.438 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T19:49:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T19:49:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 2023-10-05T19:49:52.439 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T19:49:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2023-10-05T19:49:52.439 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T19:49:52.439 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-05T19:49:52.439 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T19:49:52.439 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T19:49:52.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2023-10-05T19:49:52.440 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2023-10-05T19:49:52.496 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-05T19:49:52.509 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2023-10-05T19:49:52.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:49:52.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T19:49:52.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.566+0000 7f331bef53c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-05T19:49:52.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.566+0000 7f331bef53c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-05T19:49:52.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.594+0000 7f331bef53c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:52.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.594+0000 7f331bef53c0 -1 journal FileJournal::_open_file : zeroing journal 2023-10-05T19:49:52.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.862+0000 7f331bef53c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:52.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.862+0000 7f331bef53c0 -1 journal do_read_entry(4096): bad header magic 2023-10-05T19:49:52.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.862+0000 7f331bef53c0 -1 journal do_read_entry(4096): bad header magic 2023-10-05T19:49:52.894 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-05T19:49:52.910 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T19:49:52.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.938+0000 7f1cf7c523c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-05T19:49:52.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.942+0000 7f1cf7c523c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-05T19:49:52.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.974+0000 7f1cf7c523c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:52.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:52.974+0000 7f1cf7c523c0 -1 journal FileJournal::_open_file : zeroing journal 2023-10-05T19:49:53.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.238+0000 7f1cf7c523c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:53.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.242+0000 7f1cf7c523c0 -1 journal do_read_entry(4096): bad header magic 2023-10-05T19:49:53.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.242+0000 7f1cf7c523c0 -1 journal do_read_entry(4096): bad header magic 2023-10-05T19:49:53.289 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-05T19:49:53.303 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T19:49:53.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.338+0000 7f6b974633c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-05T19:49:53.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.338+0000 7f6b974633c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-05T19:49:53.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.370+0000 7f6b974633c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:53.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.374+0000 7f6b974633c0 -1 journal FileJournal::_open_file : zeroing journal 2023-10-05T19:49:53.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.626+0000 7f6b974633c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:53.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.626+0000 7f6b974633c0 -1 journal do_read_entry(4096): bad header magic 2023-10-05T19:49:53.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:53.626+0000 7f6b974633c0 -1 journal do_read_entry(4096): bad header magic 2023-10-05T19:49:53.670 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-05T19:49:53.730 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-05T19:49:53.730 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:53.730 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-05T19:49:53.746 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:53.747 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-05T19:49:53.762 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:53.763 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-05T19:49:53.777 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:53.777 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-05T19:49:53.788 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:53.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-05T19:49:53.845 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:53.846 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-05T19:49:53.852 INFO:tasks.ceph:Adding keys to all mons... 2023-10-05T19:49:53.852 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-05T19:49:53.867 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2023-10-05T19:49:53.867 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBeEx9lM4hSIBAABSjhz+N/ITiM2FpK9rQ9EQ== 2023-10-05T19:49:53.867 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2023-10-05T19:49:53.867 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBeEx9l4xNMDhAADjwWwQkrSLOi+uxr4skOBw== 2023-10-05T19:49:53.867 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2023-10-05T19:49:53.867 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBgEx9lrsb/IRAALAbOlfToX59WDUNzJvRprw== 2023-10-05T19:49:53.868 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2023-10-05T19:49:53.868 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBgEx9lqEktOBAAi3SFpQSQDgY8RdGITfDluQ== 2023-10-05T19:49:53.868 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2023-10-05T19:49:53.868 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBhEx9lm4lGFBAAjvzb7SxTEprpPfcetly3lQ== 2023-10-05T19:49:53.868 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2023-10-05T19:49:53.868 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQBeEx9l4hYIExAAW2vcluOCox6ndypJWXb4Iw== 2023-10-05T19:49:53.869 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T19:49:53.913 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-05T19:49:53.950 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T19:49:53.991 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T19:49:54.079 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T19:49:54.119 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-05T19:49:54.164 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-05T19:49:54.165 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-05T19:49:54.175 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-05T19:49:54.229 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-05T19:49:54.242 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-05T19:49:54.246 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-05T19:49:54.246 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-05T19:49:54.246 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-05T19:49:54.248 INFO:tasks.ceph.mon.a:Started 2023-10-05T19:49:54.248 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-05T19:49:54.249 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-05T19:49:54.249 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-05T19:49:54.251 INFO:tasks.ceph.mgr.x:Started 2023-10-05T19:49:54.251 INFO:tasks.ceph:Setting crush tunables to default 2023-10-05T19:49:54.251 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd crush tunables default 2023-10-05T19:49:54.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82f58f700 1 Processor -- start 2023-10-05T19:49:54.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82f58f700 1 -- start start 2023-10-05T19:49:54.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82f58f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 0x7fb82812aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:54.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82f58f700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb828125c10 con 0x7fb828067930 2023-10-05T19:49:54.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82f58f700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb828098460 con 0x7fb828126550 2023-10-05T19:49:54.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82cb2a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 0x7fb82812aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:54.349 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82cb2a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 0x7fb82812aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42036/0 (socket says 172.21.15.118:42036) 2023-10-05T19:49:54.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82cb2a700 1 -- 172.21.15.118:0/3672137082 learned_addr learned my addr 172.21.15.118:0/3672137082 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:49:54.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82cb2a700 1 -- 172.21.15.118:0/3672137082 >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 msgr2=0x7fb82812aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-05T19:49:54.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82cb2a700 1 -- 172.21.15.118:0/3672137082 >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 msgr2=0x7fb82812aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-05T19:49:54.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82cb2a700 1 --2- 172.21.15.118:0/3672137082 >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 0x7fb82812aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-05T19:49:54.350 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.341+0000 7fb82cb2a700 1 --2- 172.21.15.118:0/3672137082 >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 0x7fb82812aec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-05T19:49:54.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007853122 0 0) 0x7fb828125c10 con 0x7fb828067930 2023-10-05T19:49:54.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb814003570 con 0x7fb828067930 2023-10-05T19:49:54.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 492420180 0 0) 0x7fb814003570 con 0x7fb828067930 2023-10-05T19:49:54.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 msgr2=0x7fb82812aec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-05T19:49:54.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 --2- 172.21.15.118:0/3672137082 >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 0x7fb82812aec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:54.381 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828098110 con 0x7fb828067930 2023-10-05T19:49:54.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 <== mon.0 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 4042465134 0 0) 0x7fb8240015b0 con 0x7fb828067930 2023-10-05T19:49:54.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 >> v1:172.21.15.118:6789/0 conn(0x7fb828067930 legacy=0x7fb828125e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:54.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 --2- 172.21.15.118:0/3672137082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb814003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:54.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb828098460 con 0x7fb814003a60 2023-10-05T19:49:54.382 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb82d32b700 1 --2- 172.21.15.118:0/3672137082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb814003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:54.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb82d32b700 1 -- 172.21.15.118:0/3672137082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb814003570 con 0x7fb814003a60 2023-10-05T19:49:54.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb82d32b700 1 --2- 172.21.15.118:0/3672137082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb814003e50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb824001050 tx=0x7fb824002e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fcae2cd62dd0af server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:54.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb82400ca60 con 0x7fb814003a60 2023-10-05T19:49:54.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82400cc00 con 0x7fb814003a60 2023-10-05T19:49:54.383 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.373+0000 7fb81ffff700 1 -- 172.21.15.118:0/3672137082 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb82400cdb0 con 0x7fb814003a60 2023-10-05T19:49:54.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 -- 172.21.15.118:0/3672137082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 msgr2=0x7fb814003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:54.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 --2- 172.21.15.118:0/3672137082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb814003e50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb824001050 tx=0x7fb824002e70 comp rx=0 tx=0).stop 2023-10-05T19:49:54.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 -- 172.21.15.118:0/3672137082 shutdown_connections 2023-10-05T19:49:54.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 --2- 172.21.15.118:0/3672137082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb814003e50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:54.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 --2- 172.21.15.118:0/3672137082 >> v2:172.21.15.118:3300/0 conn(0x7fb828126550 0x7fb82812aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:54.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 -- 172.21.15.118:0/3672137082 >> 172.21.15.118:0/3672137082 conn(0x7fb828096870 msgr2=0x7fb8280952b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:54.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 -- 172.21.15.118:0/3672137082 shutdown_connections 2023-10-05T19:49:54.384 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 -- 172.21.15.118:0/3672137082 wait complete. 2023-10-05T19:49:54.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 Processor -- start 2023-10-05T19:49:54.385 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 -- start start 2023-10-05T19:49:54.386 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb828092080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:54.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82f58f700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb828120b00 con 0x7fb814003a60 2023-10-05T19:49:54.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82d32b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb828092080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:54.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82d32b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb828092080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42054/0 (socket says 172.21.15.118:42054) 2023-10-05T19:49:54.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.377+0000 7fb82d32b700 1 -- 172.21.15.118:0/1454449026 learned_addr learned my addr 172.21.15.118:0/1454449026 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:49:54.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb82d32b700 1 -- 172.21.15.118:0/1454449026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828121020 con 0x7fb814003a60 2023-10-05T19:49:54.387 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb82d32b700 1 --2- 172.21.15.118:0/1454449026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb828092080 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb8240079f0 tx=0x7fb824017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:54.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb81d7fa700 1 -- 172.21.15.118:0/1454449026 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb82400ca60 con 0x7fb814003a60 2023-10-05T19:49:54.388 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb81d7fa700 1 -- 172.21.15.118:0/1454449026 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb824021070 con 0x7fb814003a60 2023-10-05T19:49:54.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb82f58f700 1 -- 172.21.15.118:0/1454449026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb828120d10 con 0x7fb814003a60 2023-10-05T19:49:54.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb81d7fa700 1 -- 172.21.15.118:0/1454449026 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb824007a50 con 0x7fb814003a60 2023-10-05T19:49:54.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb82f58f700 1 -- 172.21.15.118:0/1454449026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82811f180 con 0x7fb814003a60 2023-10-05T19:49:54.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb81d7fa700 1 -- 172.21.15.118:0/1454449026 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb824023030 con 0x7fb814003a60 2023-10-05T19:49:54.389 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb81d7fa700 1 -- 172.21.15.118:0/1454449026 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb82402f440 con 0x7fb814003a60 2023-10-05T19:49:54.390 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.381+0000 7fb82f58f700 1 -- 172.21.15.118:0/1454449026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82805ecb0 con 0x7fb814003a60 2023-10-05T19:49:54.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.389+0000 7fb81d7fa700 1 -- 172.21.15.118:0/1454449026 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fb824012420 con 0x7fb814003a60 2023-10-05T19:49:54.466 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.457+0000 7fb82f58f700 1 -- 172.21.15.118:0/1454449026 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb828126980 con 0x7fb814003a60 2023-10-05T19:49:54.471 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.461+0000 7fb81d7fa700 1 -- 172.21.15.118:0/1454449026 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb82402f6a0 con 0x7fb814003a60 2023-10-05T19:49:54.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.465+0000 7fb82f58f700 1 -- 172.21.15.118:0/1454449026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 msgr2=0x7fb828092080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:54.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.465+0000 7fb82f58f700 1 --2- 172.21.15.118:0/1454449026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb828092080 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb8240079f0 tx=0x7fb824017000 comp rx=0 tx=0).stop 2023-10-05T19:49:54.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.465+0000 7fb82f58f700 1 -- 172.21.15.118:0/1454449026 shutdown_connections 2023-10-05T19:49:54.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.465+0000 7fb82f58f700 1 --2- 172.21.15.118:0/1454449026 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb814003a60 0x7fb828092080 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:54.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.465+0000 7fb82f58f700 1 -- 172.21.15.118:0/1454449026 >> 172.21.15.118:0/1454449026 conn(0x7fb828096870 msgr2=0x7fb8280952b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:54.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.465+0000 7fb82f58f700 1 -- 172.21.15.118:0/1454449026 shutdown_connections 2023-10-05T19:49:54.473 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:54.465+0000 7fb82f58f700 1 -- 172.21.15.118:0/1454449026 wait complete. 2023-10-05T19:49:54.474 INFO:teuthology.orchestra.run.smithi118.stderr:adjusted tunables profile to default 2023-10-05T19:49:54.489 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-05T19:49:54.489 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2023-10-05T19:49:54.489 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-05T19:49:54.498 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:54.498 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-05T19:49:54.515 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:54.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-05T19:49:54.561 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:54.553+0000 7fb24b12d000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T19:49:54.573 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2023-10-05T19:49:54.573 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-05T19:49:54.585 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new c3f11994-670e-4caa-8693-e9021d7bd47f 0 2023-10-05T19:49:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6ddb59e700 1 Processor -- start 2023-10-05T19:49:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6ddb59e700 1 -- start start 2023-10-05T19:49:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6ddb59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6ddc10e370 0x7f6ddc10e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6ddb59e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc10ed10 con 0x7f6ddc1092c0 2023-10-05T19:49:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6ddb59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc04c3e0 con 0x7f6ddc10e370 2023-10-05T19:49:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6dda59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6ddc10e370 0x7f6ddc10e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6dd9d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f6ddc1092c0 0x7f6ddc109740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50332/0 (socket says 172.21.15.167:50332) 2023-10-05T19:49:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6dda59c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6ddc10e370 0x7f6ddc10e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:33626/0 (socket says 172.21.15.167:33626) 2023-10-05T19:49:54.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6dd9d9b700 1 -- 172.21.15.167:0/2165675338 learned_addr learned my addr 172.21.15.167:0/2165675338 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:49:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6dda59c700 1 -- 172.21.15.167:0/2165675338 >> v1:172.21.15.118:6789/0 conn(0x7f6ddc1092c0 legacy=0x7f6ddc109740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6dda59c700 1 -- 172.21.15.167:0/2165675338 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc109e50 con 0x7f6ddc10e370 2023-10-05T19:49:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.677+0000 7f6dda59c700 1 --2- 172.21.15.167:0/2165675338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc10e370 0x7f6ddc10e740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009860 tx=0x7f6dcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10985b8e42e4b55e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6dd959a700 1 -- 172.21.15.167:0/2165675338 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dcc00b680 con 0x7f6ddc10e370 2023-10-05T19:49:54.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6dd959a700 1 -- 172.21.15.167:0/2165675338 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc00b7e0 con 0x7f6ddc10e370 2023-10-05T19:49:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6dd959a700 1 -- 172.21.15.167:0/2165675338 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dcc00b990 con 0x7f6ddc10e370 2023-10-05T19:49:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 -- 172.21.15.167:0/2165675338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc10e370 msgr2=0x7f6ddc10e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 --2- 172.21.15.167:0/2165675338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc10e370 0x7f6ddc10e740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009860 tx=0x7f6dcc0091a0 comp rx=0 tx=0).stop 2023-10-05T19:49:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 -- 172.21.15.167:0/2165675338 shutdown_connections 2023-10-05T19:49:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 --2- 172.21.15.167:0/2165675338 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc10e370 0x7f6ddc10e740 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 -- 172.21.15.167:0/2165675338 >> 172.21.15.167:0/2165675338 conn(0x7f6ddc06bbf0 msgr2=0x7f6ddc06e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 -- 172.21.15.167:0/2165675338 shutdown_connections 2023-10-05T19:49:54.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 -- 172.21.15.167:0/2165675338 wait complete. 2023-10-05T19:49:54.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 Processor -- start 2023-10-05T19:49:54.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 -- start start 2023-10-05T19:49:54.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc1092c0 0x7f6ddc11cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:54.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6ddb59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc10d0f0 con 0x7f6ddc1092c0 2023-10-05T19:49:54.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6dda59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc1092c0 0x7f6ddc11cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6dda59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc1092c0 0x7f6ddc11cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:33628/0 (socket says 172.21.15.167:33628) 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6dda59c700 1 -- 172.21.15.167:0/488915344 learned_addr learned my addr 172.21.15.167:0/488915344 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6dda59c700 1 -- 172.21.15.167:0/488915344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009420 con 0x7f6ddc1092c0 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6dda59c700 1 --2- 172.21.15.167:0/488915344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc1092c0 0x7f6ddc11cfe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0093f0 tx=0x7f6dcc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.681+0000 7f6dca7fc700 1 -- 172.21.15.167:0/488915344 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dcc011cf0 con 0x7f6ddc1092c0 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.685+0000 7f6dca7fc700 1 -- 172.21.15.167:0/488915344 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc020070 con 0x7f6ddc1092c0 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.685+0000 7f6ddb59e700 1 -- 172.21.15.167:0/488915344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc11d610 con 0x7f6ddc1092c0 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.685+0000 7f6dca7fc700 1 -- 172.21.15.167:0/488915344 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6dcc01b450 con 0x7f6ddc1092c0 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.685+0000 7f6ddb59e700 1 -- 172.21.15.167:0/488915344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc11da80 con 0x7f6ddc1092c0 2023-10-05T19:49:54.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.685+0000 7f6dca7fc700 1 -- 172.21.15.167:0/488915344 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6dcc022030 con 0x7f6ddc1092c0 2023-10-05T19:49:54.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.685+0000 7f6dca7fc700 1 -- 172.21.15.167:0/488915344 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6dcc01c7a0 con 0x7f6ddc1092c0 2023-10-05T19:49:54.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.685+0000 7f6ddb59e700 1 -- 172.21.15.167:0/488915344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc05ecb0 con 0x7f6ddc1092c0 2023-10-05T19:49:54.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.689+0000 7f6dca7fc700 1 -- 172.21.15.167:0/488915344 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f6dcc006cb0 con 0x7f6ddc1092c0 2023-10-05T19:49:54.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.761+0000 7f6ddb59e700 1 -- 172.21.15.167:0/488915344 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c3f11994-670e-4caa-8693-e9021d7bd47f", "id": 0} v 0) v1 -- 0x7f6ddc10e370 con 0x7f6ddc1092c0 2023-10-05T19:49:54.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.769+0000 7f6dca7fc700 1 -- 172.21.15.167:0/488915344 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3f11994-670e-4caa-8693-e9021d7bd47f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6dcc01bac0 con 0x7f6ddc1092c0 2023-10-05T19:49:54.775 INFO:teuthology.orchestra.run.smithi167.stdout:0 2023-10-05T19:49:54.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.769+0000 7f6ddb59e700 1 -- 172.21.15.167:0/488915344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc1092c0 msgr2=0x7f6ddc11cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:54.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.769+0000 7f6ddb59e700 1 --2- 172.21.15.167:0/488915344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc1092c0 0x7f6ddc11cfe0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0093f0 tx=0x7f6dcc016000 comp rx=0 tx=0).stop 2023-10-05T19:49:54.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.769+0000 7f6ddb59e700 1 -- 172.21.15.167:0/488915344 shutdown_connections 2023-10-05T19:49:54.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.769+0000 7f6ddb59e700 1 --2- 172.21.15.167:0/488915344 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ddc1092c0 0x7f6ddc11cfe0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:54.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.769+0000 7f6ddb59e700 1 -- 172.21.15.167:0/488915344 >> 172.21.15.167:0/488915344 conn(0x7f6ddc06bbf0 msgr2=0x7f6ddc06e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:54.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.769+0000 7f6ddb59e700 1 -- 172.21.15.167:0/488915344 shutdown_connections 2023-10-05T19:49:54.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.769+0000 7f6ddb59e700 1 -- 172.21.15.167:0/488915344 wait complete. 2023-10-05T19:49:54.788 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new b60451bf-0be1-4f42-8ac8-59e525b1ed5d 1 2023-10-05T19:49:54.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.885+0000 7f259820e700 1 Processor -- start 2023-10-05T19:49:54.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.885+0000 7f259820e700 1 -- start start 2023-10-05T19:49:54.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.885+0000 7f259820e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2590112120 0x7f2590114500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:54.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.885+0000 7f259820e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2590114a70 con 0x7f259010f4d0 2023-10-05T19:49:54.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.885+0000 7f259820e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2590063af0 con 0x7f2590112120 2023-10-05T19:49:54.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.885+0000 7f25957a9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2590112120 0x7f2590114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:54.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.885+0000 7f25957a9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2590112120 0x7f2590114500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:33642/0 (socket says 172.21.15.167:33642) 2023-10-05T19:49:54.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.885+0000 7f25957a9700 1 -- 172.21.15.167:0/4262944614 learned_addr learned my addr 172.21.15.167:0/4262944614 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:49:54.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.885+0000 7f2595faa700 1 --1- 172.21.15.167:0/4262944614 >> v1:172.21.15.118:6789/0 conn(0x7f259010f4d0 0x7f259010f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50344/0 (socket says 172.21.15.167:50344) 2023-10-05T19:49:54.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f25957a9700 1 -- 172.21.15.167:0/4262944614 >> v1:172.21.15.118:6789/0 conn(0x7f259010f4d0 legacy=0x7f259010f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:54.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f25957a9700 1 -- 172.21.15.167:0/4262944614 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590115c40 con 0x7f2590112120 2023-10-05T19:49:54.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f25957a9700 1 --2- 172.21.15.167:0/4262944614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2590112120 0x7f2590114500 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2580009930 tx=0x7f2580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9eac779622146f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:54.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f2594fa8700 1 -- 172.21.15.167:0/4262944614 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f258000b860 con 0x7f2590112120 2023-10-05T19:49:54.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f2594fa8700 1 -- 172.21.15.167:0/4262944614 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258000b9c0 con 0x7f2590112120 2023-10-05T19:49:54.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f2594fa8700 1 -- 172.21.15.167:0/4262944614 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f258000bb50 con 0x7f2590112120 2023-10-05T19:49:54.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 -- 172.21.15.167:0/4262944614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2590112120 msgr2=0x7f2590114500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:54.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 --2- 172.21.15.167:0/4262944614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2590112120 0x7f2590114500 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2580009930 tx=0x7f2580009250 comp rx=0 tx=0).stop 2023-10-05T19:49:54.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 -- 172.21.15.167:0/4262944614 shutdown_connections 2023-10-05T19:49:54.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 --2- 172.21.15.167:0/4262944614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2590112120 0x7f2590114500 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:54.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 -- 172.21.15.167:0/4262944614 >> 172.21.15.167:0/4262944614 conn(0x7f259006bcb0 msgr2=0x7f259006e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:54.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 -- 172.21.15.167:0/4262944614 shutdown_connections 2023-10-05T19:49:54.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 -- 172.21.15.167:0/4262944614 wait complete. 2023-10-05T19:49:54.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 Processor -- start 2023-10-05T19:49:54.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 -- start start 2023-10-05T19:49:54.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259010f4d0 0x7f259011e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:54.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.889+0000 7f259820e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2590111a90 con 0x7f259010f4d0 2023-10-05T19:49:54.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2595faa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259010f4d0 0x7f259011e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:54.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2595faa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259010f4d0 0x7f259011e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:33650/0 (socket says 172.21.15.167:33650) 2023-10-05T19:49:54.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2595faa700 1 -- 172.21.15.167:0/2103950243 learned_addr learned my addr 172.21.15.167:0/2103950243 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:49:54.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2595faa700 1 -- 172.21.15.167:0/2103950243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800094f0 con 0x7f259010f4d0 2023-10-05T19:49:54.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2595faa700 1 --2- 172.21.15.167:0/2103950243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259010f4d0 0x7f259011e120 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c690 tx=0x7f258c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:54.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2585ffb700 1 -- 172.21.15.167:0/2103950243 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f258c005b90 con 0x7f259010f4d0 2023-10-05T19:49:54.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f259820e700 1 -- 172.21.15.167:0/2103950243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259011e7b0 con 0x7f259010f4d0 2023-10-05T19:49:54.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2585ffb700 1 -- 172.21.15.167:0/2103950243 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c005cf0 con 0x7f259010f4d0 2023-10-05T19:49:54.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f259820e700 1 -- 172.21.15.167:0/2103950243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259011ec00 con 0x7f259010f4d0 2023-10-05T19:49:54.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2585ffb700 1 -- 172.21.15.167:0/2103950243 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f258c0070d0 con 0x7f259010f4d0 2023-10-05T19:49:54.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2585ffb700 1 -- 172.21.15.167:0/2103950243 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f258c0074b0 con 0x7f259010f4d0 2023-10-05T19:49:54.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f2585ffb700 1 -- 172.21.15.167:0/2103950243 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f258c012400 con 0x7f259010f4d0 2023-10-05T19:49:54.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.893+0000 7f259820e700 1 -- 172.21.15.167:0/2103950243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259005ecb0 con 0x7f259010f4d0 2023-10-05T19:49:54.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.901+0000 7f2585ffb700 1 -- 172.21.15.167:0/2103950243 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f258c021060 con 0x7f259010f4d0 2023-10-05T19:49:54.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.973+0000 7f259820e700 1 -- 172.21.15.167:0/2103950243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b60451bf-0be1-4f42-8ac8-59e525b1ed5d", "id": 1} v 0) v1 -- 0x7f2590112120 con 0x7f259010f4d0 2023-10-05T19:49:54.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.981+0000 7f2585ffb700 1 -- 172.21.15.167:0/2103950243 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b60451bf-0be1-4f42-8ac8-59e525b1ed5d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f258c02a0b0 con 0x7f259010f4d0 2023-10-05T19:49:54.986 INFO:teuthology.orchestra.run.smithi167.stdout:1 2023-10-05T19:49:54.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.981+0000 7f259820e700 1 -- 172.21.15.167:0/2103950243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259010f4d0 msgr2=0x7f259011e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:54.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.981+0000 7f259820e700 1 --2- 172.21.15.167:0/2103950243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259010f4d0 0x7f259011e120 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c690 tx=0x7f258c007f40 comp rx=0 tx=0).stop 2023-10-05T19:49:54.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.981+0000 7f259820e700 1 -- 172.21.15.167:0/2103950243 shutdown_connections 2023-10-05T19:49:54.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.981+0000 7f259820e700 1 --2- 172.21.15.167:0/2103950243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f259010f4d0 0x7f259011e120 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:54.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.981+0000 7f259820e700 1 -- 172.21.15.167:0/2103950243 >> 172.21.15.167:0/2103950243 conn(0x7f259006bcb0 msgr2=0x7f25901124f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:54.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.981+0000 7f259820e700 1 -- 172.21.15.167:0/2103950243 shutdown_connections 2023-10-05T19:49:54.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:54.981+0000 7f259820e700 1 -- 172.21.15.167:0/2103950243 wait complete. 2023-10-05T19:49:54.999 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 38ec3ae8-cc65-4596-b2f0-996cd54b59a8 2 2023-10-05T19:49:55.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.097+0000 7f61e3447700 1 Processor -- start 2023-10-05T19:49:55.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 -- start start 2023-10-05T19:49:55.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f61dc10f1b0 0x7f61dc10f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:55.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc10fc40 con 0x7f61dc109e80 2023-10-05T19:49:55.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc063ad0 con 0x7f61dc10f1b0 2023-10-05T19:49:55.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e2445700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f61dc10f1b0 0x7f61dc10f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:55.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e2445700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f61dc10f1b0 0x7f61dc10f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:33654/0 (socket says 172.21.15.167:33654) 2023-10-05T19:49:55.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e2445700 1 -- 172.21.15.167:0/2650411624 learned_addr learned my addr 172.21.15.167:0/2650411624 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:49:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e2445700 1 -- 172.21.15.167:0/2650411624 >> v1:172.21.15.118:6789/0 conn(0x7f61dc109e80 legacy=0x7f61dc10a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e2445700 1 -- 172.21.15.167:0/2650411624 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc10aa30 con 0x7f61dc10f1b0 2023-10-05T19:49:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e2445700 1 --2- 172.21.15.167:0/2650411624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc10f1b0 0x7f61dc10f580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f61d8009930 tx=0x7f61d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be8c4118d9ffc9d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:55.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e1443700 1 -- 172.21.15.167:0/2650411624 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d800b860 con 0x7f61dc10f1b0 2023-10-05T19:49:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e1443700 1 -- 172.21.15.167:0/2650411624 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d800b9c0 con 0x7f61dc10f1b0 2023-10-05T19:49:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e1443700 1 -- 172.21.15.167:0/2650411624 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d800bb50 con 0x7f61dc10f1b0 2023-10-05T19:49:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 -- 172.21.15.167:0/2650411624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc10f1b0 msgr2=0x7f61dc10f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:55.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 --2- 172.21.15.167:0/2650411624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc10f1b0 0x7f61dc10f580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f61d8009930 tx=0x7f61d8009250 comp rx=0 tx=0).stop 2023-10-05T19:49:55.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 -- 172.21.15.167:0/2650411624 shutdown_connections 2023-10-05T19:49:55.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 --2- 172.21.15.167:0/2650411624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc10f1b0 0x7f61dc10f580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:55.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 -- 172.21.15.167:0/2650411624 >> 172.21.15.167:0/2650411624 conn(0x7f61dc06b0b0 msgr2=0x7f61dc06d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:55.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 -- 172.21.15.167:0/2650411624 shutdown_connections 2023-10-05T19:49:55.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.101+0000 7f61e3447700 1 -- 172.21.15.167:0/2650411624 wait complete. 2023-10-05T19:49:55.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e3447700 1 Processor -- start 2023-10-05T19:49:55.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e3447700 1 -- start start 2023-10-05T19:49:55.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e3447700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc109e80 0x7f61dc11f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:55.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e3447700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc06d430 con 0x7f61dc109e80 2023-10-05T19:49:55.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e2445700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc109e80 0x7f61dc11f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:55.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e2445700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc109e80 0x7f61dc11f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:33660/0 (socket says 172.21.15.167:33660) 2023-10-05T19:49:55.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e2445700 1 -- 172.21.15.167:0/1793503818 learned_addr learned my addr 172.21.15.167:0/1793503818 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:49:55.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e2445700 1 -- 172.21.15.167:0/1793503818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d80094f0 con 0x7f61dc109e80 2023-10-05T19:49:55.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e2445700 1 --2- 172.21.15.167:0/1793503818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc109e80 0x7f61dc11f070 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61d8009290 tx=0x7f61d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:55.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61d27fc700 1 -- 172.21.15.167:0/1793503818 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d800bd50 con 0x7f61dc109e80 2023-10-05T19:49:55.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61d27fc700 1 -- 172.21.15.167:0/1793503818 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d8020070 con 0x7f61dc109e80 2023-10-05T19:49:55.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e3447700 1 -- 172.21.15.167:0/1793503818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc11f6a0 con 0x7f61dc109e80 2023-10-05T19:49:55.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61d27fc700 1 -- 172.21.15.167:0/1793503818 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61d801b450 con 0x7f61dc109e80 2023-10-05T19:49:55.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61e3447700 1 -- 172.21.15.167:0/1793503818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc11fa90 con 0x7f61dc109e80 2023-10-05T19:49:55.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61d27fc700 1 -- 172.21.15.167:0/1793503818 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f61d8022030 con 0x7f61dc109e80 2023-10-05T19:49:55.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.105+0000 7f61d27fc700 1 -- 172.21.15.167:0/1793503818 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f61d801c880 con 0x7f61dc109e80 2023-10-05T19:49:55.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.109+0000 7f61e3447700 1 -- 172.21.15.167:0/1793503818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc05ecb0 con 0x7f61dc109e80 2023-10-05T19:49:55.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.113+0000 7f61d27fc700 1 -- 172.21.15.167:0/1793503818 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f61d801c450 con 0x7f61dc109e80 2023-10-05T19:49:55.206 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:55.201+0000 7fb24b12d000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T19:49:55.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.213+0000 7f61e3447700 1 -- 172.21.15.167:0/1793503818 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "38ec3ae8-cc65-4596-b2f0-996cd54b59a8", "id": 2} v 0) v1 -- 0x7f61dc10f1b0 con 0x7f61dc109e80 2023-10-05T19:49:55.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.217+0000 7f61d27fc700 1 -- 172.21.15.167:0/1793503818 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38ec3ae8-cc65-4596-b2f0-996cd54b59a8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f61d801c5f0 con 0x7f61dc109e80 2023-10-05T19:49:55.226 INFO:teuthology.orchestra.run.smithi167.stdout:2 2023-10-05T19:49:55.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.221+0000 7f61e3447700 1 -- 172.21.15.167:0/1793503818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc109e80 msgr2=0x7f61dc11f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:55.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.221+0000 7f61e3447700 1 --2- 172.21.15.167:0/1793503818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc109e80 0x7f61dc11f070 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f61d8009290 tx=0x7f61d8016000 comp rx=0 tx=0).stop 2023-10-05T19:49:55.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.221+0000 7f61e3447700 1 -- 172.21.15.167:0/1793503818 shutdown_connections 2023-10-05T19:49:55.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.221+0000 7f61e3447700 1 --2- 172.21.15.167:0/1793503818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f61dc109e80 0x7f61dc11f070 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:55.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.221+0000 7f61e3447700 1 -- 172.21.15.167:0/1793503818 >> 172.21.15.167:0/1793503818 conn(0x7f61dc06b0b0 msgr2=0x7f61dc06d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:55.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.221+0000 7f61e3447700 1 -- 172.21.15.167:0/1793503818 shutdown_connections 2023-10-05T19:49:55.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.221+0000 7f61e3447700 1 -- 172.21.15.167:0/1793503818 wait complete. 2023-10-05T19:49:55.238 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 840e7308-39d6-4524-ac13-f91a77125e7e 3 2023-10-05T19:49:55.264 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:55.257+0000 7fb24b12d000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T19:49:55.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 Processor -- start 2023-10-05T19:49:55.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 -- start start 2023-10-05T19:49:55.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5428113270 0x7f5428115650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:55.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5428115b90 con 0x7f5428110540 2023-10-05T19:49:55.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542804c3e0 con 0x7f5428113270 2023-10-05T19:49:55.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f541ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5428113270 0x7f5428115650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:55.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f541ffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5428113270 0x7f5428115650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:33674/0 (socket says 172.21.15.167:33674) 2023-10-05T19:49:55.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f541ffff700 1 -- 172.21.15.167:0/4031063416 learned_addr learned my addr 172.21.15.167:0/4031063416 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:49:55.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f541ffff700 1 -- 172.21.15.167:0/4031063416 >> v1:172.21.15.118:6789/0 conn(0x7f5428110540 legacy=0x7f5428110910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:55.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f541ffff700 1 -- 172.21.15.167:0/4031063416 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5428116d30 con 0x7f5428113270 2023-10-05T19:49:55.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f541ffff700 1 --2- 172.21.15.167:0/4031063416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428113270 0x7f5428115650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5418009930 tx=0x7f5418009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59764196dfc09d03 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:55.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f541f7fe700 1 -- 172.21.15.167:0/4031063416 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f541800b860 con 0x7f5428113270 2023-10-05T19:49:55.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f541f7fe700 1 -- 172.21.15.167:0/4031063416 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541800b9c0 con 0x7f5428113270 2023-10-05T19:49:55.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f541f7fe700 1 -- 172.21.15.167:0/4031063416 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f541800bb50 con 0x7f5428113270 2023-10-05T19:49:55.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 -- 172.21.15.167:0/4031063416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428113270 msgr2=0x7f5428115650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:55.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 --2- 172.21.15.167:0/4031063416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428113270 0x7f5428115650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5418009930 tx=0x7f5418009250 comp rx=0 tx=0).stop 2023-10-05T19:49:55.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 -- 172.21.15.167:0/4031063416 shutdown_connections 2023-10-05T19:49:55.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 --2- 172.21.15.167:0/4031063416 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428113270 0x7f5428115650 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:55.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 -- 172.21.15.167:0/4031063416 >> 172.21.15.167:0/4031063416 conn(0x7f542806b370 msgr2=0x7f542806d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:55.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 -- 172.21.15.167:0/4031063416 shutdown_connections 2023-10-05T19:49:55.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.337+0000 7f542df55700 1 -- 172.21.15.167:0/4031063416 wait complete. 2023-10-05T19:49:55.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542df55700 1 Processor -- start 2023-10-05T19:49:55.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542df55700 1 -- start start 2023-10-05T19:49:55.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542df55700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428110540 0x7f54281197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542df55700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5428112bd0 con 0x7f5428110540 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542cf53700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428110540 0x7f54281197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542cf53700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428110540 0x7f54281197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:33688/0 (socket says 172.21.15.167:33688) 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542cf53700 1 -- 172.21.15.167:0/2394749754 learned_addr learned my addr 172.21.15.167:0/2394749754 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542cf53700 1 -- 172.21.15.167:0/2394749754 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180094f0 con 0x7f5428110540 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542cf53700 1 --2- 172.21.15.167:0/2394749754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428110540 0x7f54281197c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f542400c490 tx=0x7f542400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f541cff9700 1 -- 172.21.15.167:0/2394749754 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5424011590 con 0x7f5428110540 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f541cff9700 1 -- 172.21.15.167:0/2394749754 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54240116f0 con 0x7f5428110540 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f541cff9700 1 -- 172.21.15.167:0/2394749754 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54240119e0 con 0x7f5428110540 2023-10-05T19:49:55.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542df55700 1 -- 172.21.15.167:0/2394749754 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5428119e50 con 0x7f5428110540 2023-10-05T19:49:55.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542df55700 1 -- 172.21.15.167:0/2394749754 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542811a2a0 con 0x7f5428110540 2023-10-05T19:49:55.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f541cff9700 1 -- 172.21.15.167:0/2394749754 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f542401c440 con 0x7f5428110540 2023-10-05T19:49:55.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f541cff9700 1 -- 172.21.15.167:0/2394749754 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f5424011dc0 con 0x7f5428110540 2023-10-05T19:49:55.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.341+0000 7f542df55700 1 -- 172.21.15.167:0/2394749754 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542806ed00 con 0x7f5428110540 2023-10-05T19:49:55.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.349+0000 7f541cff9700 1 -- 172.21.15.167:0/2394749754 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f542806ed00 con 0x7f5428110540 2023-10-05T19:49:55.404 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:55.397+0000 7fb24b12d000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T19:49:55.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.445+0000 7f542df55700 1 -- 172.21.15.167:0/2394749754 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "840e7308-39d6-4524-ac13-f91a77125e7e", "id": 3} v 0) v1 -- 0x7f5428115eb0 con 0x7f5428110540 2023-10-05T19:49:55.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.453+0000 7f541cff9700 1 -- 172.21.15.167:0/2394749754 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "840e7308-39d6-4524-ac13-f91a77125e7e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5424017070 con 0x7f5428110540 2023-10-05T19:49:55.458 INFO:teuthology.orchestra.run.smithi167.stdout:3 2023-10-05T19:49:55.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.453+0000 7f542df55700 1 -- 172.21.15.167:0/2394749754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428110540 msgr2=0x7f54281197c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:55.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.453+0000 7f542df55700 1 --2- 172.21.15.167:0/2394749754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428110540 0x7f54281197c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f542400c490 tx=0x7f542400c850 comp rx=0 tx=0).stop 2023-10-05T19:49:55.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.453+0000 7f542df55700 1 -- 172.21.15.167:0/2394749754 shutdown_connections 2023-10-05T19:49:55.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.453+0000 7f542df55700 1 --2- 172.21.15.167:0/2394749754 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5428110540 0x7f54281197c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:55.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.453+0000 7f542df55700 1 -- 172.21.15.167:0/2394749754 >> 172.21.15.167:0/2394749754 conn(0x7f542806b370 msgr2=0x7f5428113640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:55.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.453+0000 7f542df55700 1 -- 172.21.15.167:0/2394749754 shutdown_connections 2023-10-05T19:49:55.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:49:55.453+0000 7f542df55700 1 -- 172.21.15.167:0/2394749754 wait complete. 2023-10-05T19:49:55.471 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-05T19:49:55.471 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-05T19:49:55.474 INFO:tasks.ceph.osd.0:Started 2023-10-05T19:49:55.474 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-05T19:49:55.474 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-05T19:49:55.476 INFO:tasks.ceph.osd.1:Started 2023-10-05T19:49:55.476 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-05T19:49:55.476 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-05T19:49:55.478 INFO:tasks.ceph.osd.2:Started 2023-10-05T19:49:55.478 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-05T19:49:55.478 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-05T19:49:55.480 INFO:tasks.ceph.osd.3:Started 2023-10-05T19:49:55.480 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T19:49:55.540 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-10-05T19:49:55.533+0000 7fd3d57863c0 -1 Falling back to public interface 2023-10-05T19:49:55.545 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-10-05T19:49:55.537+0000 7f5a788f43c0 -1 Falling back to public interface 2023-10-05T19:49:55.551 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-10-05T19:49:55.545+0000 7f112ffe43c0 -1 Falling back to public interface 2023-10-05T19:49:55.553 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-10-05T19:49:55.545+0000 7fd3d57863c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:55.553 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-10-05T19:49:55.545+0000 7fd3d57863c0 -1 journal do_read_entry(8192): bad header magic 2023-10-05T19:49:55.553 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-10-05T19:49:55.545+0000 7fd3d57863c0 -1 journal do_read_entry(8192): bad header magic 2023-10-05T19:49:55.554 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-10-05T19:49:55.545+0000 7f94bab193c0 -1 Falling back to public interface 2023-10-05T19:49:55.558 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-10-05T19:49:55.553+0000 7fd3d57863c0 -1 osd.3 0 log_to_monitors true 2023-10-05T19:49:55.566 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-10-05T19:49:55.557+0000 7f5a788f43c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:55.566 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-10-05T19:49:55.561+0000 7f5a788f43c0 -1 journal do_read_entry(8192): bad header magic 2023-10-05T19:49:55.566 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-10-05T19:49:55.561+0000 7f5a788f43c0 -1 journal do_read_entry(8192): bad header magic 2023-10-05T19:49:55.571 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-10-05T19:49:55.565+0000 7f5a788f43c0 -1 osd.1 0 log_to_monitors true 2023-10-05T19:49:55.572 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-10-05T19:49:55.565+0000 7f94bab193c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:55.572 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-10-05T19:49:55.565+0000 7f94bab193c0 -1 journal do_read_entry(8192): bad header magic 2023-10-05T19:49:55.572 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-10-05T19:49:55.565+0000 7f94bab193c0 -1 journal do_read_entry(8192): bad header magic 2023-10-05T19:49:55.573 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-10-05T19:49:55.565+0000 7f112ffe43c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2023-10-05T19:49:55.573 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-10-05T19:49:55.565+0000 7f112ffe43c0 -1 journal do_read_entry(8192): bad header magic 2023-10-05T19:49:55.573 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-10-05T19:49:55.565+0000 7f112ffe43c0 -1 journal do_read_entry(8192): bad header magic 2023-10-05T19:49:55.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd188522700 1 Processor -- start 2023-10-05T19:49:55.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd188522700 1 -- start start 2023-10-05T19:49:55.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd188522700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd180090b80 0x7fd18012b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd188522700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1800916f0 con 0x7fd180093ef0 2023-10-05T19:49:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd188522700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd180066b70 con 0x7fd180090b80 2023-10-05T19:49:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd185abd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd180090b80 0x7fd18012b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd185abd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd180090b80 0x7fd18012b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42078/0 (socket says 172.21.15.118:42078) 2023-10-05T19:49:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd185abd700 1 -- 172.21.15.118:0/1310892288 learned_addr learned my addr 172.21.15.118:0/1310892288 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:49:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd1862be700 1 --1- 172.21.15.118:0/1310892288 >> v1:172.21.15.118:6789/0 conn(0x7fd180093ef0 0x7fd180090470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:42634/0 (socket says 172.21.15.118:42634) 2023-10-05T19:49:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd185abd700 1 -- 172.21.15.118:0/1310892288 >> v1:172.21.15.118:6789/0 conn(0x7fd180093ef0 legacy=0x7fd180090470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-05T19:49:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd185abd700 1 -- 172.21.15.118:0/1310892288 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd180093930 con 0x7fd180090b80 2023-10-05T19:49:55.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd185abd700 1 --2- 172.21.15.118:0/1310892288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 0x7fd18012b1b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd17800d120 tx=0x7fd17800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fdc45698d3fdd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:55.580 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-10-05T19:49:55.573+0000 7f112ffe43c0 -1 osd.2 0 log_to_monitors true 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd1852bc700 1 -- 172.21.15.118:0/1310892288 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd178010070 con 0x7fd180090b80 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd1852bc700 1 -- 172.21.15.118:0/1310892288 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17800de00 con 0x7fd180090b80 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.569+0000 7fd1852bc700 1 -- 172.21.15.118:0/1310892288 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd17800b250 con 0x7fd180090b80 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.573+0000 7fd188522700 1 -- 172.21.15.118:0/1310892288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 msgr2=0x7fd18012b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.573+0000 7fd188522700 1 --2- 172.21.15.118:0/1310892288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 0x7fd18012b1b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd17800d120 tx=0x7fd17800ba50 comp rx=0 tx=0).stop 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.573+0000 7fd188522700 1 -- 172.21.15.118:0/1310892288 shutdown_connections 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.573+0000 7fd188522700 1 --2- 172.21.15.118:0/1310892288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 0x7fd18012b1b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.573+0000 7fd188522700 1 -- 172.21.15.118:0/1310892288 >> 172.21.15.118:0/1310892288 conn(0x7fd180094aa0 msgr2=0x7fd180094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.573+0000 7fd188522700 1 -- 172.21.15.118:0/1310892288 shutdown_connections 2023-10-05T19:49:55.581 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.573+0000 7fd188522700 1 -- 172.21.15.118:0/1310892288 wait complete. 2023-10-05T19:49:55.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.573+0000 7fd188522700 1 Processor -- start 2023-10-05T19:49:55.583 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd188522700 1 -- start start 2023-10-05T19:49:55.583 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-10-05T19:49:55.577+0000 7f94bab193c0 -1 osd.0 0 log_to_monitors true 2023-10-05T19:49:55.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd188522700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 0x7fd18008aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:55.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd188522700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18008ef00 con 0x7fd180090b80 2023-10-05T19:49:55.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1862be700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 0x7fd18008aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:55.584 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1862be700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 0x7fd18008aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42086/0 (socket says 172.21.15.118:42086) 2023-10-05T19:49:55.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1862be700 1 -- 172.21.15.118:0/1845112966 learned_addr learned my addr 172.21.15.118:0/1845112966 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:49:55.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1862be700 1 -- 172.21.15.118:0/1845112966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17800bcf0 con 0x7fd180090b80 2023-10-05T19:49:55.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1862be700 1 --2- 172.21.15.118:0/1845112966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 0x7fd18008aa40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd17000c4e0 tx=0x7fd170007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:55.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1767fc700 1 -- 172.21.15.118:0/1845112966 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd170007540 con 0x7fd180090b80 2023-10-05T19:49:55.585 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1767fc700 1 -- 172.21.15.118:0/1845112966 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700076c0 con 0x7fd180090b80 2023-10-05T19:49:55.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1767fc700 1 -- 172.21.15.118:0/1845112966 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1700059c0 con 0x7fd180090b80 2023-10-05T19:49:55.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd188522700 1 -- 172.21.15.118:0/1845112966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18008e1c0 con 0x7fd180090b80 2023-10-05T19:49:55.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd188522700 1 -- 172.21.15.118:0/1845112966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18008af80 con 0x7fd180090b80 2023-10-05T19:49:55.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1767fc700 1 -- 172.21.15.118:0/1845112966 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd17001c440 con 0x7fd180090b80 2023-10-05T19:49:55.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd1767fc700 1 -- 172.21.15.118:0/1845112966 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fd170005da0 con 0x7fd180090b80 2023-10-05T19:49:55.586 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.577+0000 7fd188522700 1 -- 172.21.15.118:0/1845112966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18008e350 con 0x7fd180090b80 2023-10-05T19:49:55.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.581+0000 7fd1767fc700 1 -- 172.21.15.118:0/1845112966 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fd170017070 con 0x7fd180090b80 2023-10-05T19:49:55.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.645+0000 7fd188522700 1 -- 172.21.15.118:0/1845112966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd18005ecb0 con 0x7fd180090b80 2023-10-05T19:49:55.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.645+0000 7fd1767fc700 1 -- 172.21.15.118:0/1845112966 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7fd17001c9f0 con 0x7fd180090b80 2023-10-05T19:49:55.652 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:49:55.652 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":6,"fsid":"3d9357fa-146c-4f86-b124-205784953dac","created":"2023-10-05T19:49:54.360690+0000","modified":"2023-10-05T19:49:55.451738+0000","last_up_change":"0.000000","last_in_change":"2023-10-05T19:49:55.451738+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c3f11994-670e-4caa-8693-e9021d7bd47f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b60451bf-0be1-4f42-8ac8-59e525b1ed5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"38ec3ae8-cc65-4596-b2f0-996cd54b59a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"840e7308-39d6-4524-ac13-f91a77125e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T19:49:55.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.645+0000 7fd188522700 1 -- 172.21.15.118:0/1845112966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 msgr2=0x7fd18008aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:55.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.645+0000 7fd188522700 1 --2- 172.21.15.118:0/1845112966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 0x7fd18008aa40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd17000c4e0 tx=0x7fd170007f90 comp rx=0 tx=0).stop 2023-10-05T19:49:55.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.645+0000 7fd188522700 1 -- 172.21.15.118:0/1845112966 shutdown_connections 2023-10-05T19:49:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.645+0000 7fd188522700 1 --2- 172.21.15.118:0/1845112966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd180090b80 0x7fd18008aa40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.645+0000 7fd188522700 1 -- 172.21.15.118:0/1845112966 >> 172.21.15.118:0/1845112966 conn(0x7fd180094aa0 msgr2=0x7fd18006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.645+0000 7fd188522700 1 -- 172.21.15.118:0/1845112966 shutdown_connections 2023-10-05T19:49:55.654 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:49:55.645+0000 7fd188522700 1 -- 172.21.15.118:0/1845112966 wait complete. 2023-10-05T19:49:55.664 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-05T19:49:55.664 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-05T19:49:55.669 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:55.661+0000 7fb24b12d000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T19:49:55.719 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:55.713+0000 7fb24b12d000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T19:49:55.905 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:55.897+0000 7fb24b12d000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T19:49:55.970 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:55.965+0000 7fb24b12d000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T19:49:56.032 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:56.025+0000 7fb24b12d000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T19:49:56.067 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-05T19:49:56.170 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.161+0000 7f4f722dc700 1 Processor -- start 2023-10-05T19:49:56.170 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.161+0000 7f4f722dc700 1 -- start start 2023-10-05T19:49:56.172 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.161+0000 7f4f722dc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4f6c091400 0x7f4f6c0917d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:56.172 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.161+0000 7f4f722dc700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c0930b0 con 0x7f4f6c091d10 2023-10-05T19:49:56.172 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.161+0000 7f4f722dc700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c092780 con 0x7f4f6c091400 2023-10-05T19:49:56.172 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.161+0000 7f4f70ad9700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f4f6c091d10 0x7f4f6c12b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:42646/0 (socket says 172.21.15.118:42646) 2023-10-05T19:49:56.172 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.161+0000 7f4f70ad9700 1 -- 172.21.15.118:0/2342252755 learned_addr learned my addr 172.21.15.118:0/2342252755 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:49:56.173 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.161+0000 7f4f712da700 1 --2- 172.21.15.118:0/2342252755 >> v2:172.21.15.118:3300/0 conn(0x7f4f6c091400 0x7f4f6c0917d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:56.173 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f5ffff700 1 -- 172.21.15.118:0/2342252755 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717893633 0 0) 0x7f4f6c0930b0 con 0x7f4f6c091d10 2023-10-05T19:49:56.173 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f5ffff700 1 -- 172.21.15.118:0/2342252755 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f58003570 con 0x7f4f6c091d10 2023-10-05T19:49:56.173 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f712da700 1 -- 172.21.15.118:0/2342252755 >> v1:172.21.15.118:6789/0 conn(0x7f4f6c091d10 legacy=0x7f4f6c12b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:56.173 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f712da700 1 -- 172.21.15.118:0/2342252755 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c093800 con 0x7f4f6c091400 2023-10-05T19:49:56.173 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f712da700 1 --2- 172.21.15.118:0/2342252755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 0x7f4f6c0917d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009890 tx=0x7f4f680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d9fb5a64a34a03 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:56.174 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f5ffff700 1 -- 172.21.15.118:0/2342252755 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f68011630 con 0x7f4f6c091400 2023-10-05T19:49:56.174 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f5ffff700 1 -- 172.21.15.118:0/2342252755 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68011790 con 0x7f4f6c091400 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f5ffff700 1 -- 172.21.15.118:0/2342252755 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f68011920 con 0x7f4f6c091400 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 -- 172.21.15.118:0/2342252755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 msgr2=0x7f4f6c0917d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 --2- 172.21.15.118:0/2342252755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 0x7f4f6c0917d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009890 tx=0x7f4f680091a0 comp rx=0 tx=0).stop 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 -- 172.21.15.118:0/2342252755 shutdown_connections 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 --2- 172.21.15.118:0/2342252755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 0x7f4f6c0917d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 -- 172.21.15.118:0/2342252755 >> 172.21.15.118:0/2342252755 conn(0x7f4f6c096bb0 msgr2=0x7f4f6c096f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 -- 172.21.15.118:0/2342252755 shutdown_connections 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 -- 172.21.15.118:0/2342252755 wait complete. 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 Processor -- start 2023-10-05T19:49:56.175 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 -- start start 2023-10-05T19:49:56.177 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 0x7f4f6c08c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:49:56.177 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.165+0000 7f4f722dc700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c08e200 con 0x7f4f6c091400 2023-10-05T19:49:56.177 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f712da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 0x7f4f6c08c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:49:56.177 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f712da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 0x7f4f6c08c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:42134/0 (socket says 172.21.15.118:42134) 2023-10-05T19:49:56.177 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f712da700 1 -- 172.21.15.118:0/2775237536 learned_addr learned my addr 172.21.15.118:0/2775237536 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:49:56.177 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f712da700 1 -- 172.21.15.118:0/2775237536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f68009420 con 0x7f4f6c091400 2023-10-05T19:49:56.177 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f712da700 1 --2- 172.21.15.118:0/2775237536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 0x7f4f6c08c6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f680093f0 tx=0x7f4f68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:49:56.177 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f5d7fa700 1 -- 172.21.15.118:0/2775237536 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f68011630 con 0x7f4f6c091400 2023-10-05T19:49:56.178 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f5d7fa700 1 -- 172.21.15.118:0/2775237536 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68020070 con 0x7f4f6c091400 2023-10-05T19:49:56.178 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f722dc700 1 -- 172.21.15.118:0/2775237536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c0902d0 con 0x7f4f6c091400 2023-10-05T19:49:56.178 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f5d7fa700 1 -- 172.21.15.118:0/2775237536 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4f68027480 con 0x7f4f6c091400 2023-10-05T19:49:56.178 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f722dc700 1 -- 172.21.15.118:0/2775237536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c08f410 con 0x7f4f6c091400 2023-10-05T19:49:56.178 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f5d7fa700 1 -- 172.21.15.118:0/2775237536 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4f68027860 con 0x7f4f6c091400 2023-10-05T19:49:56.178 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f5d7fa700 1 -- 172.21.15.118:0/2775237536 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f4f68022070 con 0x7f4f6c091400 2023-10-05T19:49:56.178 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.169+0000 7f4f722dc700 1 -- 172.21.15.118:0/2775237536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c08ff20 con 0x7f4f6c091400 2023-10-05T19:49:56.180 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.173+0000 7f4f5d7fa700 1 -- 172.21.15.118:0/2775237536 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f4f68027ca0 con 0x7f4f6c091400 2023-10-05T19:49:56.245 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.237+0000 7f4f722dc700 1 -- 172.21.15.118:0/2775237536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f6c05ecb0 con 0x7f4f6c091400 2023-10-05T19:49:56.245 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.237+0000 7f4f5d7fa700 1 -- 172.21.15.118:0/2775237536 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f4f68027e40 con 0x7f4f6c091400 2023-10-05T19:49:56.246 INFO:teuthology.misc.health.smithi118.stdout: 2023-10-05T19:49:56.246 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":6,"fsid":"3d9357fa-146c-4f86-b124-205784953dac","created":"2023-10-05T19:49:54.360690+0000","modified":"2023-10-05T19:49:55.451738+0000","last_up_change":"0.000000","last_in_change":"2023-10-05T19:49:55.451738+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c3f11994-670e-4caa-8693-e9021d7bd47f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b60451bf-0be1-4f42-8ac8-59e525b1ed5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"38ec3ae8-cc65-4596-b2f0-996cd54b59a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"840e7308-39d6-4524-ac13-f91a77125e7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T19:49:56.247 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.237+0000 7f4f722dc700 1 -- 172.21.15.118:0/2775237536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 msgr2=0x7f4f6c08c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:49:56.247 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.237+0000 7f4f722dc700 1 --2- 172.21.15.118:0/2775237536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 0x7f4f6c08c6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f680093f0 tx=0x7f4f68016000 comp rx=0 tx=0).stop 2023-10-05T19:49:56.247 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.237+0000 7f4f722dc700 1 -- 172.21.15.118:0/2775237536 shutdown_connections 2023-10-05T19:49:56.247 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.237+0000 7f4f722dc700 1 --2- 172.21.15.118:0/2775237536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f6c091400 0x7f4f6c08c6f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:49:56.247 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.237+0000 7f4f722dc700 1 -- 172.21.15.118:0/2775237536 >> 172.21.15.118:0/2775237536 conn(0x7f4f6c096bb0 msgr2=0x7f4f6c098840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:49:56.247 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.237+0000 7f4f722dc700 1 -- 172.21.15.118:0/2775237536 shutdown_connections 2023-10-05T19:49:56.247 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:49:56.237+0000 7f4f722dc700 1 -- 172.21.15.118:0/2775237536 wait complete. 2023-10-05T19:49:56.257 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-05T19:49:56.415 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:56.409+0000 7fb24b12d000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T19:49:56.525 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:56.517+0000 7fb24b12d000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T19:49:56.815 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:56.809+0000 7fb24b12d000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T19:49:56.976 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:56.969+0000 7fb24b12d000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T19:49:57.057 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:57.049+0000 7fb24b12d000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T19:49:57.113 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:57.105+0000 7fb24b12d000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T19:49:57.169 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:57.161+0000 7fb24b12d000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T19:49:57.466 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-10-05T19:49:57.461+0000 7f112bfa7700 -1 osd.2 0 waiting for initial osdmap 2023-10-05T19:49:57.467 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-10-05T19:49:57.461+0000 7f5a748b7700 -1 osd.1 0 waiting for initial osdmap 2023-10-05T19:49:57.467 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-10-05T19:49:57.461+0000 7fd3d1749700 -1 osd.3 0 waiting for initial osdmap 2023-10-05T19:49:57.467 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-10-05T19:49:57.457+0000 7f94b6adc700 -1 osd.0 0 waiting for initial osdmap 2023-10-05T19:49:57.470 INFO:tasks.ceph.osd.0.smithi118.stderr:2023-10-05T19:49:57.461+0000 7f94b3087700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T19:49:57.470 INFO:tasks.ceph.osd.3.smithi167.stderr:2023-10-05T19:49:57.465+0000 7fd3cdcf4700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T19:49:57.474 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:57.469+0000 7fb24b12d000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T19:49:57.498 INFO:tasks.ceph.osd.2.smithi167.stderr:2023-10-05T19:49:57.493+0000 7f1128552700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T19:49:57.499 INFO:tasks.ceph.osd.1.smithi167.stderr:2023-10-05T19:49:57.493+0000 7f5a70e62700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T19:49:57.532 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:57.525+0000 7fb24b12d000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T19:49:57.596 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:57.589+0000 7fb24b12d000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T19:49:57.755 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:57.749+0000 7fb24b12d000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T19:49:57.821 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:57.813+0000 7fb24b12d000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T19:49:58.522 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:58.513+0000 7fb24b12d000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T19:49:59.563 INFO:tasks.ceph.mgr.x.smithi167.stderr:2023-10-05T19:49:59.557+0000 7fb234225700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-05T19:50:02.661 DEBUG:teuthology.orchestra.run.smithi118:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-05T19:50:02.762 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.753+0000 7f8d91546700 1 Processor -- start 2023-10-05T19:50:02.763 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.753+0000 7f8d91546700 1 -- start start 2023-10-05T19:50:02.763 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.753+0000 7f8d91546700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d8c095ba0 0x7f8d8c090430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:02.763 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.753+0000 7f8d91546700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c0965d0 con 0x7f8d8c090970 2023-10-05T19:50:02.763 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.753+0000 7f8d91546700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c06f700 con 0x7f8d8c095ba0 2023-10-05T19:50:02.764 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d83fff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8d8c090970 0x7f8d8c091400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39296/0 (socket says 172.21.15.118:39296) 2023-10-05T19:50:02.764 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8bfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8d8c095ba0 0x7f8d8c090430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:02.764 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d83fff700 1 -- 172.21.15.118:0/2966249758 learned_addr learned my addr 172.21.15.118:0/2966249758 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:02.764 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8b7fe700 1 -- 172.21.15.118:0/2966249758 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499228377 0 0) 0x7f8d8c0965d0 con 0x7f8d8c090970 2023-10-05T19:50:02.764 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8b7fe700 1 -- 172.21.15.118:0/2966249758 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d78003570 con 0x7f8d8c090970 2023-10-05T19:50:02.764 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8b7fe700 1 -- 172.21.15.118:0/2966249758 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 47921164 0 0) 0x7f8d78003570 con 0x7f8d8c090970 2023-10-05T19:50:02.765 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8bfff700 1 -- 172.21.15.118:0/2966249758 >> v1:172.21.15.118:6789/0 conn(0x7f8d8c090970 legacy=0x7f8d8c091400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:02.765 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8bfff700 1 -- 172.21.15.118:0/2966249758 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c092c30 con 0x7f8d8c095ba0 2023-10-05T19:50:02.765 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8bfff700 1 --2- 172.21.15.118:0/2966249758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c095ba0 0x7f8d8c090430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009890 tx=0x7f8d7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4335f1fd886df751 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:02.765 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8b7fe700 1 -- 172.21.15.118:0/2966249758 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d740015b0 con 0x7f8d8c095ba0 2023-10-05T19:50:02.765 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8b7fe700 1 -- 172.21.15.118:0/2966249758 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c011630 con 0x7f8d8c095ba0 2023-10-05T19:50:02.766 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d8b7fe700 1 -- 172.21.15.118:0/2966249758 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c0117c0 con 0x7f8d8c095ba0 2023-10-05T19:50:02.766 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d91546700 1 -- 172.21.15.118:0/2966249758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c095ba0 msgr2=0x7f8d8c090430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:02.766 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d91546700 1 --2- 172.21.15.118:0/2966249758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c095ba0 0x7f8d8c090430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009890 tx=0x7f8d7c0091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:02.766 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d91546700 1 -- 172.21.15.118:0/2966249758 shutdown_connections 2023-10-05T19:50:02.767 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d91546700 1 --2- 172.21.15.118:0/2966249758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c095ba0 0x7f8d8c090430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:02.767 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d91546700 1 -- 172.21.15.118:0/2966249758 >> 172.21.15.118:0/2966249758 conn(0x7f8d8c096bb0 msgr2=0x7f8d8c096fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:02.767 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d91546700 1 -- 172.21.15.118:0/2966249758 shutdown_connections 2023-10-05T19:50:02.767 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d91546700 1 -- 172.21.15.118:0/2966249758 wait complete. 2023-10-05T19:50:02.767 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d91546700 1 Processor -- start 2023-10-05T19:50:02.767 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.757+0000 7f8d91546700 1 -- start start 2023-10-05T19:50:02.769 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d91546700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c090970 0x7f8d8c08dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:02.769 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d91546700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c08f6d0 con 0x7f8d8c090970 2023-10-05T19:50:02.769 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d8bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c090970 0x7f8d8c08dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:02.769 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d8bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c090970 0x7f8d8c08dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57328/0 (socket says 172.21.15.118:57328) 2023-10-05T19:50:02.769 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d8bfff700 1 -- 172.21.15.118:0/2227510654 learned_addr learned my addr 172.21.15.118:0/2227510654 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:02.769 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d8bfff700 1 -- 172.21.15.118:0/2227510654 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c009420 con 0x7f8d8c090970 2023-10-05T19:50:02.769 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d8bfff700 1 --2- 172.21.15.118:0/2227510654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c090970 0x7f8d8c08dab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c096000 tx=0x7f8d7c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:02.770 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d88ff9700 1 -- 172.21.15.118:0/2227510654 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c0117a0 con 0x7f8d8c090970 2023-10-05T19:50:02.770 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d88ff9700 1 -- 172.21.15.118:0/2227510654 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c01be80 con 0x7f8d8c090970 2023-10-05T19:50:02.770 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c08eb60 con 0x7f8d8c090970 2023-10-05T19:50:02.770 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d88ff9700 1 -- 172.21.15.118:0/2227510654 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c01c450 con 0x7f8d8c090970 2023-10-05T19:50:02.771 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.761+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c11fb40 con 0x7f8d8c090970 2023-10-05T19:50:02.771 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.765+0000 7f8d88ff9700 1 -- 172.21.15.118:0/2227510654 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 40273+0+0 (secure 0 0 0) 0x7f8d7c01c650 con 0x7f8d8c090970 2023-10-05T19:50:02.771 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.765+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c05ecb0 con 0x7f8d8c090970 2023-10-05T19:50:02.772 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.765+0000 7f8d88ff9700 1 --2- 172.21.15.118:0/2227510654 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8d6c032300 0x7f8d6c0347b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:02.772 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.765+0000 7f8d88ff9700 1 -- 172.21.15.118:0/2227510654 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3125+0+0 (secure 0 0 0) 0x7f8d7c044e90 con 0x7f8d8c090970 2023-10-05T19:50:02.772 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.765+0000 7f8d83fff700 1 --2- 172.21.15.118:0/2227510654 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8d6c032300 0x7f8d6c0347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:02.773 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.765+0000 7f8d83fff700 1 --2- 172.21.15.118:0/2227510654 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8d6c032300 0x7f8d6c0347b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d74001440 tx=0x7f8d74001110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:02.782 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.773+0000 7f8d88ff9700 1 -- 172.21.15.118:0/2227510654 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f8d7c025590 con 0x7f8d8c090970 2023-10-05T19:50:02.943 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.933+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d8c093700 con 0x7f8d8c090970 2023-10-05T19:50:02.944 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d88ff9700 1 -- 172.21.15.118:0/2227510654 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7471 (secure 0 0 0) 0x7f8d7c021020 con 0x7f8d8c090970 2023-10-05T19:50:02.944 INFO:teuthology.misc.health.smithi118.stdout: 2023-10-05T19:50:02.944 INFO:teuthology.misc.health.smithi118.stdout:{"epoch":12,"fsid":"3d9357fa-146c-4f86-b124-205784953dac","created":"2023-10-05T19:49:54.360690+0000","modified":"2023-10-05T19:50:01.482370+0000","last_up_change":"2023-10-05T19:49:58.460378+0000","last_in_change":"2023-10-05T19:49:55.451738+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T19:49:58.615025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c3f11994-670e-4caa-8693-e9021d7bd47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":26580},{"type":"v1","addr":"172.21.15.118:6801","nonce":26580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":26580},{"type":"v1","addr":"172.21.15.118:6803","nonce":26580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":26580},{"type":"v1","addr":"172.21.15.118:6807","nonce":26580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":26580},{"type":"v1","addr":"172.21.15.118:6805","nonce":26580}]},"public_addr":"172.21.15.118:6801/26580","cluster_addr":"172.21.15.118:6803/26580","heartbeat_back_addr":"172.21.15.118:6807/26580","heartbeat_front_addr":"172.21.15.118:6805/26580","state":["exists","up"]},{"osd":1,"uuid":"b60451bf-0be1-4f42-8ac8-59e525b1ed5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":26775},{"type":"v1","addr":"172.21.15.167:6809","nonce":26775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":26775},{"type":"v1","addr":"172.21.15.167:6811","nonce":26775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":26775},{"type":"v1","addr":"172.21.15.167:6815","nonce":26775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":26775},{"type":"v1","addr":"172.21.15.167:6813","nonce":26775}]},"public_addr":"172.21.15.167:6809/26775","cluster_addr":"172.21.15.167:6811/26775","heartbeat_back_addr":"172.21.15.167:6815/26775","heartbeat_front_addr":"172.21.15.167:6813/26775","state":["exists","up"]},{"osd":2,"uuid":"38ec3ae8-cc65-4596-b2f0-996cd54b59a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":26774},{"type":"v1","addr":"172.21.15.167:6817","nonce":26774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":26774},{"type":"v1","addr":"172.21.15.167:6819","nonce":26774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":26774},{"type":"v1","addr":"172.21.15.167:6823","nonce":26774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":26774},{"type":"v1","addr":"172.21.15.167:6821","nonce":26774}]},"public_addr":"172.21.15.167:6817/26774","cluster_addr":"172.21.15.167:6819/26774","heartbeat_back_addr":"172.21.15.167:6823/26774","heartbeat_front_addr":"172.21.15.167:6821/26774","state":["exists","up"]},{"osd":3,"uuid":"840e7308-39d6-4524-ac13-f91a77125e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":26773},{"type":"v1","addr":"172.21.15.167:6801","nonce":26773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":26773},{"type":"v1","addr":"172.21.15.167:6803","nonce":26773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":26773},{"type":"v1","addr":"172.21.15.167:6807","nonce":26773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":26773},{"type":"v1","addr":"172.21.15.167:6805","nonce":26773}]},"public_addr":"172.21.15.167:6801/26773","cluster_addr":"172.21.15.167:6803/26773","heartbeat_back_addr":"172.21.15.167:6807/26773","heartbeat_front_addr":"172.21.15.167:6805/26773","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.583291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.564146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.533170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.558782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T19:50:02.946 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8d6c032300 msgr2=0x7f8d6c0347b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:02.946 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 --2- 172.21.15.118:0/2227510654 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8d6c032300 0x7f8d6c0347b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d74001440 tx=0x7f8d74001110 comp rx=0 tx=0).stop 2023-10-05T19:50:02.947 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c090970 msgr2=0x7f8d8c08dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:02.947 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 --2- 172.21.15.118:0/2227510654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c090970 0x7f8d8c08dab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c096000 tx=0x7f8d7c016000 comp rx=0 tx=0).stop 2023-10-05T19:50:02.947 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 shutdown_connections 2023-10-05T19:50:02.947 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 --2- 172.21.15.118:0/2227510654 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8d6c032300 0x7f8d6c0347b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:02.947 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 --2- 172.21.15.118:0/2227510654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d8c090970 0x7f8d8c08dab0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:02.947 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 >> 172.21.15.118:0/2227510654 conn(0x7f8d8c096bb0 msgr2=0x7f8d8c06cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:02.947 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 shutdown_connections 2023-10-05T19:50:02.947 INFO:teuthology.misc.health.smithi118.stderr:2023-10-05T19:50:02.937+0000 7f8d91546700 1 -- 172.21.15.118:0/2227510654 wait complete. 2023-10-05T19:50:02.956 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-05T19:50:02.956 INFO:tasks.ceph:Creating RBD pool 2023-10-05T19:50:02.957 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-05T19:50:03.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.053+0000 7f66316b4700 1 Processor -- start 2023-10-05T19:50:03.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.053+0000 7f66316b4700 1 -- start start 2023-10-05T19:50:03.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f662c090c00 0x7f662c090fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:03.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662c069740 con 0x7f662c091510 2023-10-05T19:50:03.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662c069580 con 0x7f662c090c00 2023-10-05T19:50:03.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662bfff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f662c090c00 0x7f662c090fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:03.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662b7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f662c091510 0x7f662c129e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39302/0 (socket says 172.21.15.118:39302) 2023-10-05T19:50:03.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662b7fe700 1 -- 172.21.15.118:0/2208964142 learned_addr learned my addr 172.21.15.118:0/2208964142 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:03.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662bfff700 1 -- 172.21.15.118:0/2208964142 >> v1:172.21.15.118:6789/0 conn(0x7f662c091510 legacy=0x7f662c129e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:03.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662bfff700 1 -- 172.21.15.118:0/2208964142 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c08f910 con 0x7f662c090c00 2023-10-05T19:50:03.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662bfff700 1 --2- 172.21.15.118:0/2208964142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 0x7f662c090fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6620009850 tx=0x7f66200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6321af44e46e653a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662affd700 1 -- 172.21.15.118:0/2208964142 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f662000b680 con 0x7f662c090c00 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662affd700 1 -- 172.21.15.118:0/2208964142 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662000b800 con 0x7f662c090c00 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662affd700 1 -- 172.21.15.118:0/2208964142 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f662000baf0 con 0x7f662c090c00 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 -- 172.21.15.118:0/2208964142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 msgr2=0x7f662c090fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 --2- 172.21.15.118:0/2208964142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 0x7f662c090fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6620009850 tx=0x7f66200091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 -- 172.21.15.118:0/2208964142 shutdown_connections 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 --2- 172.21.15.118:0/2208964142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 0x7f662c090fd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 -- 172.21.15.118:0/2208964142 >> 172.21.15.118:0/2208964142 conn(0x7f662c0987a0 msgr2=0x7f662c095c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 -- 172.21.15.118:0/2208964142 shutdown_connections 2023-10-05T19:50:03.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 -- 172.21.15.118:0/2208964142 wait complete. 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 Processor -- start 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 -- start start 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 0x7f662c08c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f66316b4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c08e560 con 0x7f662c090c00 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 0x7f662c08c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 0x7f662c08c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57356/0 (socket says 172.21.15.118:57356) 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662bfff700 1 -- 172.21.15.118:0/1040185507 learned_addr learned my addr 172.21.15.118:0/1040185507 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662bfff700 1 -- 172.21.15.118:0/1040185507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200093c0 con 0x7f662c090c00 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.057+0000 7f662bfff700 1 --2- 172.21.15.118:0/1040185507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 0x7f662c08c8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6620000c00 tx=0x7f6620016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f6613fff700 1 -- 172.21.15.118:0/1040185507 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6620024470 con 0x7f662c090c00 2023-10-05T19:50:03.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f6613fff700 1 -- 172.21.15.118:0/1040185507 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66200245f0 con 0x7f662c090c00 2023-10-05T19:50:03.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c08d9f0 con 0x7f662c090c00 2023-10-05T19:50:03.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f6613fff700 1 -- 172.21.15.118:0/1040185507 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66200247a0 con 0x7f662c090c00 2023-10-05T19:50:03.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c11d410 con 0x7f662c090c00 2023-10-05T19:50:03.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f6613fff700 1 -- 172.21.15.118:0/1040185507 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 4) v1 ==== 40273+0+0 (secure 0 0 0) 0x7f6620021070 con 0x7f662c090c00 2023-10-05T19:50:03.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f6613fff700 1 --2- 172.21.15.118:0/1040185507 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6618032340 0x7f66180347f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:03.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f6613fff700 1 -- 172.21.15.118:0/1040185507 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3125+0+0 (secure 0 0 0) 0x7f6620045430 con 0x7f662c090c00 2023-10-05T19:50:03.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662c11d6c0 con 0x7f662c090c00 2023-10-05T19:50:03.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f662b7fe700 1 --2- 172.21.15.118:0/1040185507 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6618032340 0x7f66180347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:03.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.061+0000 7f662b7fe700 1 --2- 172.21.15.118:0/1040185507 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6618032340 0x7f66180347f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f661c0016a0 tx=0x7f661c007b30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:03.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.065+0000 7f6613fff700 1 -- 172.21.15.118:0/1040185507 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f662c11d6c0 con 0x7f662c090c00 2023-10-05T19:50:03.235 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.225+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f662c11d6c0 con 0x7f662c090c00 2023-10-05T19:50:03.507 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.497+0000 7f6613fff700 1 -- 172.21.15.118:0/1040185507 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f662001a7e0 con 0x7f662c090c00 2023-10-05T19:50:03.509 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.501+0000 7f6613fff700 1 -- 172.21.15.118:0/1040185507 <== mon.0 v2:172.21.15.118:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7f6620043d90 con 0x7f662c090c00 2023-10-05T19:50:03.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.505+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6618032340 msgr2=0x7f66180347f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:03.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.505+0000 7f66316b4700 1 --2- 172.21.15.118:0/1040185507 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6618032340 0x7f66180347f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f661c0016a0 tx=0x7f661c007b30 comp rx=0 tx=0).stop 2023-10-05T19:50:03.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.505+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 msgr2=0x7f662c08c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:03.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.505+0000 7f66316b4700 1 --2- 172.21.15.118:0/1040185507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 0x7f662c08c8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6620000c00 tx=0x7f6620016000 comp rx=0 tx=0).stop 2023-10-05T19:50:03.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.505+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 shutdown_connections 2023-10-05T19:50:03.515 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.505+0000 7f66316b4700 1 --2- 172.21.15.118:0/1040185507 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6618032340 0x7f66180347f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:03.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.505+0000 7f66316b4700 1 --2- 172.21.15.118:0/1040185507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f662c090c00 0x7f662c08c8d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:03.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.505+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 >> 172.21.15.118:0/1040185507 conn(0x7f662c0987a0 msgr2=0x7f662c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:03.516 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.509+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 shutdown_connections 2023-10-05T19:50:03.517 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.509+0000 7f66316b4700 1 -- 172.21.15.118:0/1040185507 wait complete. 2023-10-05T19:50:03.518 INFO:teuthology.orchestra.run.smithi118.stderr:pool 'rbd' created 2023-10-05T19:50:03.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-05T19:50:03.642 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.633+0000 7ff5f354d700 1 Processor -- start 2023-10-05T19:50:03.642 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.633+0000 7ff5f354d700 1 -- start start 2023-10-05T19:50:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.633+0000 7ff5f354d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5ec090b00 0x7ff5ec125880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.633+0000 7ff5f354d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec0915b0 con 0x7ff5ec125370 2023-10-05T19:50:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.633+0000 7ff5f354d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec091840 con 0x7ff5ec090b00 2023-10-05T19:50:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.633+0000 7ff5f1d4a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff5ec090b00 0x7ff5ec125880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:03.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.633+0000 7ff5f254b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff5ec125370 0x7ff5ec08f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39304/0 (socket says 172.21.15.118:39304) 2023-10-05T19:50:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.633+0000 7ff5f254b700 1 -- 172.21.15.118:0/3020831995 learned_addr learned my addr 172.21.15.118:0/3020831995 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f1d4a700 1 -- 172.21.15.118:0/3020831995 >> v1:172.21.15.118:6789/0 conn(0x7ff5ec125370 legacy=0x7ff5ec08f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:03.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f1d4a700 1 -- 172.21.15.118:0/3020831995 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec091ed0 con 0x7ff5ec090b00 2023-10-05T19:50:03.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f1549700 1 -- 172.21.15.118:0/3020831995 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621577068 0 0) 0x7ff5ec0915b0 con 0x7ff5ec125370 2023-10-05T19:50:03.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f1d4a700 1 --2- 172.21.15.118:0/3020831995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 0x7ff5ec125880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009860 tx=0x7ff5dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112d6abc34bf619d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:03.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f1549700 1 -- 172.21.15.118:0/3020831995 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5dc00b680 con 0x7ff5ec090b00 2023-10-05T19:50:03.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f1549700 1 -- 172.21.15.118:0/3020831995 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc00b7e0 con 0x7ff5ec090b00 2023-10-05T19:50:03.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f1549700 1 -- 172.21.15.118:0/3020831995 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5dc00b990 con 0x7ff5ec090b00 2023-10-05T19:50:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f354d700 1 -- 172.21.15.118:0/3020831995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 msgr2=0x7ff5ec125880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f354d700 1 --2- 172.21.15.118:0/3020831995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 0x7ff5ec125880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009860 tx=0x7ff5dc0091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f354d700 1 -- 172.21.15.118:0/3020831995 shutdown_connections 2023-10-05T19:50:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f354d700 1 --2- 172.21.15.118:0/3020831995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 0x7ff5ec125880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f354d700 1 -- 172.21.15.118:0/3020831995 >> 172.21.15.118:0/3020831995 conn(0x7ff5ec095ba0 msgr2=0x7ff5ec095fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f354d700 1 -- 172.21.15.118:0/3020831995 shutdown_connections 2023-10-05T19:50:03.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f354d700 1 -- 172.21.15.118:0/3020831995 wait complete. 2023-10-05T19:50:03.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f354d700 1 Processor -- start 2023-10-05T19:50:03.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.637+0000 7ff5f354d700 1 -- start start 2023-10-05T19:50:03.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f354d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 0x7ff5ec137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:03.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f354d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec137d00 con 0x7ff5ec090b00 2023-10-05T19:50:03.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f254b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 0x7ff5ec137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:03.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f254b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 0x7ff5ec137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57378/0 (socket says 172.21.15.118:57378) 2023-10-05T19:50:03.648 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f254b700 1 -- 172.21.15.118:0/2841092481 learned_addr learned my addr 172.21.15.118:0/2841092481 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f254b700 1 -- 172.21.15.118:0/2841092481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc009420 con 0x7ff5ec090b00 2023-10-05T19:50:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f254b700 1 --2- 172.21.15.118:0/2841092481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 0x7ff5ec137f30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c710 tx=0x7ff5e0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5ea7fc700 1 -- 172.21.15.118:0/2841092481 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5e0005c50 con 0x7ff5ec090b00 2023-10-05T19:50:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5ea7fc700 1 -- 172.21.15.118:0/2841092481 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e0005db0 con 0x7ff5ec090b00 2023-10-05T19:50:03.650 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec08ba80 con 0x7ff5ec090b00 2023-10-05T19:50:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5ea7fc700 1 -- 172.21.15.118:0/2841092481 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5e0007250 con 0x7ff5ec090b00 2023-10-05T19:50:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec08b640 con 0x7ff5ec090b00 2023-10-05T19:50:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5ea7fc700 1 -- 172.21.15.118:0/2841092481 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff5e00074c0 con 0x7ff5ec090b00 2023-10-05T19:50:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5ea7fc700 1 --2- 172.21.15.118:0/2841092481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff5d8032390 0x7ff5d8034840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5ea7fc700 1 -- 172.21.15.118:0/2841092481 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3467+0+0 (secure 0 0 0) 0x7ff5e0042f80 con 0x7ff5ec090b00 2023-10-05T19:50:03.651 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ec05ecb0 con 0x7ff5ec090b00 2023-10-05T19:50:03.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.641+0000 7ff5f1d4a700 1 --2- 172.21.15.118:0/2841092481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff5d8032390 0x7ff5d8034840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:03.652 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.645+0000 7ff5f1d4a700 1 --2- 172.21.15.118:0/2841092481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff5d8032390 0x7ff5d8034840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc000c00 tx=0x7ff5dc016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:03.663 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.657+0000 7ff5ea7fc700 1 -- 172.21.15.118:0/2841092481 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7ff5e00192c0 con 0x7ff5ec090b00 2023-10-05T19:50:03.829 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:03.821+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff5ec06eeb0 con 0x7ff5ec090b00 2023-10-05T19:50:04.512 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.505+0000 7ff5ea7fc700 1 -- 172.21.15.118:0/2841092481 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff5e0010300 con 0x7ff5ec090b00 2023-10-05T19:50:04.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff5d8032390 msgr2=0x7ff5d8034840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:04.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 --2- 172.21.15.118:0/2841092481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff5d8032390 0x7ff5d8034840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc000c00 tx=0x7ff5dc016000 comp rx=0 tx=0).stop 2023-10-05T19:50:04.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 msgr2=0x7ff5ec137f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:04.518 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 --2- 172.21.15.118:0/2841092481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 0x7ff5ec137f30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c710 tx=0x7ff5e0007d90 comp rx=0 tx=0).stop 2023-10-05T19:50:04.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 shutdown_connections 2023-10-05T19:50:04.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 --2- 172.21.15.118:0/2841092481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff5d8032390 0x7ff5d8034840 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:04.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 --2- 172.21.15.118:0/2841092481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff5ec090b00 0x7ff5ec137f30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:04.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 >> 172.21.15.118:0/2841092481 conn(0x7ff5ec095ba0 msgr2=0x7ff5ec092690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:04.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 shutdown_connections 2023-10-05T19:50:04.519 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.509+0000 7ff5f354d700 1 -- 172.21.15.118:0/2841092481 wait complete. 2023-10-05T19:50:04.520 INFO:teuthology.orchestra.run.smithi118.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-05T19:50:04.532 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-05T19:50:04.533 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-05T19:50:04.533 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-05T19:50:04.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-05T19:50:04.534 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-05T19:50:04.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.629+0000 7ff196de7700 1 Processor -- start 2023-10-05T19:50:04.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.629+0000 7ff196de7700 1 -- start start 2023-10-05T19:50:04.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.629+0000 7ff196de7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff190069b80 0x7ff19012bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:04.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.629+0000 7ff196de7700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19006ad50 con 0x7ff1900690a0 2023-10-05T19:50:04.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.629+0000 7ff196de7700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19004bb20 con 0x7ff190069b80 2023-10-05T19:50:04.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.629+0000 7ff1955e4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff190069b80 0x7ff19012bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:04.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.629+0000 7ff1955e4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff190069b80 0x7ff19012bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57386/0 (socket says 172.21.15.118:57386) 2023-10-05T19:50:04.639 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.629+0000 7ff1955e4700 1 -- 172.21.15.118:0/3654511288 learned_addr learned my addr 172.21.15.118:0/3654511288 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff1955e4700 1 -- 172.21.15.118:0/3654511288 >> v1:172.21.15.118:6789/0 conn(0x7ff1900690a0 legacy=0x7ff190069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff1955e4700 1 -- 172.21.15.118:0/3654511288 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19006a930 con 0x7ff190069b80 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff1955e4700 1 --2- 172.21.15.118:0/3654511288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff190069b80 0x7ff19012bf20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009ea0 tx=0x7ff18c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a420ccac3a4a4cd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff194de3700 1 -- 172.21.15.118:0/3654511288 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff18c00e070 con 0x7ff190069b80 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff194de3700 1 -- 172.21.15.118:0/3654511288 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c00ba90 con 0x7ff190069b80 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff194de3700 1 -- 172.21.15.118:0/3654511288 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff18c0092e0 con 0x7ff190069b80 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 -- 172.21.15.118:0/3654511288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff190069b80 msgr2=0x7ff19012bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 --2- 172.21.15.118:0/3654511288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff190069b80 0x7ff19012bf20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009ea0 tx=0x7ff18c009840 comp rx=0 tx=0).stop 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 -- 172.21.15.118:0/3654511288 shutdown_connections 2023-10-05T19:50:04.641 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 --2- 172.21.15.118:0/3654511288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff190069b80 0x7ff19012bf20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:04.642 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 -- 172.21.15.118:0/3654511288 >> 172.21.15.118:0/3654511288 conn(0x7ff190096e30 msgr2=0x7ff190097200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:04.642 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 -- 172.21.15.118:0/3654511288 shutdown_connections 2023-10-05T19:50:04.642 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 -- 172.21.15.118:0/3654511288 wait complete. 2023-10-05T19:50:04.642 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 Processor -- start 2023-10-05T19:50:04.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 -- start start 2023-10-05T19:50:04.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1900690a0 0x7ff190135990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:04.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff196de7700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19008dc90 con 0x7ff1900690a0 2023-10-05T19:50:04.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff195de5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1900690a0 0x7ff190135990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:04.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff195de5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1900690a0 0x7ff190135990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57394/0 (socket says 172.21.15.118:57394) 2023-10-05T19:50:04.643 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.633+0000 7ff195de5700 1 -- 172.21.15.118:0/1933907891 learned_addr learned my addr 172.21.15.118:0/1933907891 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:04.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff195de5700 1 -- 172.21.15.118:0/1933907891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c009ae0 con 0x7ff1900690a0 2023-10-05T19:50:04.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff195de5700 1 --2- 172.21.15.118:0/1933907891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1900690a0 0x7ff190135990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff18000c490 tx=0x7ff18000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:04.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff185ffb700 1 -- 172.21.15.118:0/1933907891 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff180011590 con 0x7ff1900690a0 2023-10-05T19:50:04.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff185ffb700 1 -- 172.21.15.118:0/1933907891 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1800116f0 con 0x7ff1900690a0 2023-10-05T19:50:04.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19011df00 con 0x7ff1900690a0 2023-10-05T19:50:04.644 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff185ffb700 1 -- 172.21.15.118:0/1933907891 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1800119e0 con 0x7ff1900690a0 2023-10-05T19:50:04.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19008e340 con 0x7ff1900690a0 2023-10-05T19:50:04.645 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff185ffb700 1 -- 172.21.15.118:0/1933907891 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff180011b40 con 0x7ff1900690a0 2023-10-05T19:50:04.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19008fe60 con 0x7ff1900690a0 2023-10-05T19:50:04.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff185ffb700 1 --2- 172.21.15.118:0/1933907891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1740323e0 0x7ff174034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:04.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff185ffb700 1 -- 172.21.15.118:0/1933907891 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3478+0+0 (secure 0 0 0) 0x7ff180042f00 con 0x7ff1900690a0 2023-10-05T19:50:04.646 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.637+0000 7ff1955e4700 1 --2- 172.21.15.118:0/1933907891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1740323e0 0x7ff174034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:04.647 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.641+0000 7ff1955e4700 1 --2- 172.21.15.118:0/1933907891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1740323e0 0x7ff174034890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009880 tx=0x7ff18c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:04.653 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.645+0000 7ff185ffb700 1 -- 172.21.15.118:0/1933907891 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7ff18000fac0 con 0x7ff1900690a0 2023-10-05T19:50:04.851 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.841+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff19005ecb0 con 0x7ff1900690a0 2023-10-05T19:50:04.854 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.845+0000 7ff185ffb700 1 -- 172.21.15.118:0/1933907891 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+77919 (secure 0 0 0) 0x7ff180017070 con 0x7ff1900690a0 2023-10-05T19:50:04.856 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:50:04.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1740323e0 msgr2=0x7ff174034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:04.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 --2- 172.21.15.118:0/1933907891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1740323e0 0x7ff174034890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009880 tx=0x7ff18c017000 comp rx=0 tx=0).stop 2023-10-05T19:50:04.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1900690a0 msgr2=0x7ff190135990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:04.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 --2- 172.21.15.118:0/1933907891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1900690a0 0x7ff190135990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff18000c490 tx=0x7ff18000c850 comp rx=0 tx=0).stop 2023-10-05T19:50:04.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 shutdown_connections 2023-10-05T19:50:04.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 --2- 172.21.15.118:0/1933907891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1740323e0 0x7ff174034890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:04.857 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 --2- 172.21.15.118:0/1933907891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff1900690a0 0x7ff190135990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:04.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 >> 172.21.15.118:0/1933907891 conn(0x7ff190096e30 msgr2=0x7ff19006cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:04.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 shutdown_connections 2023-10-05T19:50:04.858 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.849+0000 7ff196de7700 1 -- 172.21.15.118:0/1933907891 wait complete. 2023-10-05T19:50:04.868 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":26627},{"type":"v1","addr":"172.21.15.167:6825","nonce":26627}]},"active_addr":"172.21.15.167:6825/26627","active_change":"2023-10-05T19:49:58.542214+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":1835414126}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":2949106907}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":2146619773}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":685381655}]}]} 2023-10-05T19:50:04.870 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-05T19:50:04.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-05T19:50:04.870 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T19:50:04.976 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 Processor -- start 2023-10-05T19:50:04.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 -- start start 2023-10-05T19:50:04.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa21408fe40 0x7fa2141327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:04.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa214090210 con 0x7fa21408f360 2023-10-05T19:50:04.977 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa214098dc0 con 0x7fa21408fe40 2023-10-05T19:50:04.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21a4f4700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fa21408f360 0x7fa21408f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39320/0 (socket says 172.21.15.118:39320) 2023-10-05T19:50:04.978 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa219cf3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa21408fe40 0x7fa2141327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21a4f4700 1 -- 172.21.15.118:0/2258311268 learned_addr learned my addr 172.21.15.118:0/2258311268 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa2194f2700 1 -- 172.21.15.118:0/2258311268 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327521597 0 0) 0x7fa214090210 con 0x7fa21408f360 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa2194f2700 1 -- 172.21.15.118:0/2258311268 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa200003570 con 0x7fa21408f360 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa219cf3700 1 -- 172.21.15.118:0/2258311268 >> v1:172.21.15.118:6789/0 conn(0x7fa21408f360 legacy=0x7fa21408f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa219cf3700 1 -- 172.21.15.118:0/2258311268 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa214090480 con 0x7fa21408fe40 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa219cf3700 1 --2- 172.21.15.118:0/2258311268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408fe40 0x7fa2141327a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009de0 tx=0x7fa20c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304a4aeff9d32e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa2194f2700 1 -- 172.21.15.118:0/2258311268 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa20c00e070 con 0x7fa21408fe40 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa2194f2700 1 -- 172.21.15.118:0/2258311268 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c00bca0 con 0x7fa21408fe40 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa2194f2700 1 -- 172.21.15.118:0/2258311268 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa20c012430 con 0x7fa21408fe40 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 -- 172.21.15.118:0/2258311268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408fe40 msgr2=0x7fa2141327a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 --2- 172.21.15.118:0/2258311268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408fe40 0x7fa2141327a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009de0 tx=0x7fa20c009780 comp rx=0 tx=0).stop 2023-10-05T19:50:04.979 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 -- 172.21.15.118:0/2258311268 shutdown_connections 2023-10-05T19:50:04.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 --2- 172.21.15.118:0/2258311268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408fe40 0x7fa2141327a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:04.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 -- 172.21.15.118:0/2258311268 >> 172.21.15.118:0/2258311268 conn(0x7fa214095d10 msgr2=0x7fa214096110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:04.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 -- 172.21.15.118:0/2258311268 shutdown_connections 2023-10-05T19:50:04.980 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.969+0000 7fa21c758700 1 -- 172.21.15.118:0/2258311268 wait complete. 2023-10-05T19:50:04.981 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21c758700 1 Processor -- start 2023-10-05T19:50:04.981 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21c758700 1 -- start start 2023-10-05T19:50:04.981 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21c758700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408f360 0x7fa21408aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21c758700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21408ef00 con 0x7fa21408f360 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21a4f4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408f360 0x7fa21408aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21a4f4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408f360 0x7fa21408aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57410/0 (socket says 172.21.15.118:57410) 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21a4f4700 1 -- 172.21.15.118:0/2732736278 learned_addr learned my addr 172.21.15.118:0/2732736278 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21a4f4700 1 -- 172.21.15.118:0/2732736278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c009a20 con 0x7fa21408f360 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21a4f4700 1 --2- 172.21.15.118:0/2732736278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408f360 0x7fa21408aa40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c6c0 tx=0x7fa208007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa2067fc700 1 -- 172.21.15.118:0/2732736278 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa208005c70 con 0x7fa21408f360 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa2067fc700 1 -- 172.21.15.118:0/2732736278 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa208005dd0 con 0x7fa21408f360 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21408e1c0 con 0x7fa21408f360 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa2067fc700 1 -- 172.21.15.118:0/2732736278 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa208007250 con 0x7fa21408f360 2023-10-05T19:50:04.982 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21408af80 con 0x7fa21408f360 2023-10-05T19:50:04.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21408e350 con 0x7fa21408f360 2023-10-05T19:50:04.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa2067fc700 1 -- 172.21.15.118:0/2732736278 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fa2080073b0 con 0x7fa21408f360 2023-10-05T19:50:04.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa2067fc700 1 --2- 172.21.15.118:0/2732736278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa1f80323d0 0x7fa1f8034880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:04.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.973+0000 7fa2067fc700 1 -- 172.21.15.118:0/2732736278 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fa208043070 con 0x7fa21408f360 2023-10-05T19:50:04.983 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.977+0000 7fa219cf3700 1 --2- 172.21.15.118:0/2732736278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa1f80323d0 0x7fa1f8034880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:04.984 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.977+0000 7fa219cf3700 1 --2- 172.21.15.118:0/2732736278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa1f80323d0 0x7fa1f8034880 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009480 tx=0x7fa20c018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:04.988 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:04.981+0000 7fa2067fc700 1 -- 172.21.15.118:0/2732736278 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7fa20800eaf0 con 0x7fa21408f360 2023-10-05T19:50:05.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.137+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa21405ecb0 con 0x7fa21408f360 2023-10-05T19:50:05.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa2067fc700 1 -- 172.21.15.118:0/2732736278 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9002 (secure 0 0 0) 0x7fa208017020 con 0x7fa21408f360 2023-10-05T19:50:05.148 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:50:05.148 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":14,"fsid":"3d9357fa-146c-4f86-b124-205784953dac","created":"2023-10-05T19:49:54.360690+0000","modified":"2023-10-05T19:50:04.499700+0000","last_up_change":"2023-10-05T19:49:58.460378+0000","last_in_change":"2023-10-05T19:49:55.451738+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T19:49:58.615025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-05T19:50:03.270780+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c3f11994-670e-4caa-8693-e9021d7bd47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":26580},{"type":"v1","addr":"172.21.15.118:6801","nonce":26580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":26580},{"type":"v1","addr":"172.21.15.118:6803","nonce":26580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":26580},{"type":"v1","addr":"172.21.15.118:6807","nonce":26580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":26580},{"type":"v1","addr":"172.21.15.118:6805","nonce":26580}]},"public_addr":"172.21.15.118:6801/26580","cluster_addr":"172.21.15.118:6803/26580","heartbeat_back_addr":"172.21.15.118:6807/26580","heartbeat_front_addr":"172.21.15.118:6805/26580","state":["exists","up"]},{"osd":1,"uuid":"b60451bf-0be1-4f42-8ac8-59e525b1ed5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":26775},{"type":"v1","addr":"172.21.15.167:6809","nonce":26775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":26775},{"type":"v1","addr":"172.21.15.167:6811","nonce":26775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":26775},{"type":"v1","addr":"172.21.15.167:6815","nonce":26775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":26775},{"type":"v1","addr":"172.21.15.167:6813","nonce":26775}]},"public_addr":"172.21.15.167:6809/26775","cluster_addr":"172.21.15.167:6811/26775","heartbeat_back_addr":"172.21.15.167:6815/26775","heartbeat_front_addr":"172.21.15.167:6813/26775","state":["exists","up"]},{"osd":2,"uuid":"38ec3ae8-cc65-4596-b2f0-996cd54b59a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":26774},{"type":"v1","addr":"172.21.15.167:6817","nonce":26774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":26774},{"type":"v1","addr":"172.21.15.167:6819","nonce":26774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":26774},{"type":"v1","addr":"172.21.15.167:6823","nonce":26774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":26774},{"type":"v1","addr":"172.21.15.167:6821","nonce":26774}]},"public_addr":"172.21.15.167:6817/26774","cluster_addr":"172.21.15.167:6819/26774","heartbeat_back_addr":"172.21.15.167:6823/26774","heartbeat_front_addr":"172.21.15.167:6821/26774","state":["exists","up"]},{"osd":3,"uuid":"840e7308-39d6-4524-ac13-f91a77125e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":26773},{"type":"v1","addr":"172.21.15.167:6801","nonce":26773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":26773},{"type":"v1","addr":"172.21.15.167:6803","nonce":26773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":26773},{"type":"v1","addr":"172.21.15.167:6807","nonce":26773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":26773},{"type":"v1","addr":"172.21.15.167:6805","nonce":26773}]},"public_addr":"172.21.15.167:6801/26773","cluster_addr":"172.21.15.167:6803/26773","heartbeat_back_addr":"172.21.15.167:6807/26773","heartbeat_front_addr":"172.21.15.167:6805/26773","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.583291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.564146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.533170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.558782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T19:50:05.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa1f80323d0 msgr2=0x7fa1f8034880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 --2- 172.21.15.118:0/2732736278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa1f80323d0 0x7fa1f8034880 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009480 tx=0x7fa20c018000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408f360 msgr2=0x7fa21408aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 --2- 172.21.15.118:0/2732736278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408f360 0x7fa21408aa40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c6c0 tx=0x7fa208007e00 comp rx=0 tx=0).stop 2023-10-05T19:50:05.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 shutdown_connections 2023-10-05T19:50:05.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 --2- 172.21.15.118:0/2732736278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa1f80323d0 0x7fa1f8034880 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 --2- 172.21.15.118:0/2732736278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa21408f360 0x7fa21408aa40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 >> 172.21.15.118:0/2732736278 conn(0x7fa214095d10 msgr2=0x7fa21406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 shutdown_connections 2023-10-05T19:50:05.151 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.141+0000 7fa21c758700 1 -- 172.21.15.118:0/2732736278 wait complete. 2023-10-05T19:50:05.161 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-05T19:50:05.161 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T19:50:05.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.253+0000 7f647a2f4700 1 Processor -- start 2023-10-05T19:50:05.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.253+0000 7f647a2f4700 1 -- start start 2023-10-05T19:50:05.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6474090af0 0x7f6474090ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64740968c0 con 0x7f6474091400 2023-10-05T19:50:05.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64740966b0 con 0x7f6474090af0 2023-10-05T19:50:05.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f64792f2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6474090af0 0x7f6474090ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f64792f2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6474090af0 0x7f6474090ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57426/0 (socket says 172.21.15.118:57426) 2023-10-05T19:50:05.264 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f64792f2700 1 -- 172.21.15.118:0/2740827573 learned_addr learned my addr 172.21.15.118:0/2740827573 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f64792f2700 1 -- 172.21.15.118:0/2740827573 >> v1:172.21.15.118:6789/0 conn(0x7f6474091400 legacy=0x7f6474129df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f64792f2700 1 -- 172.21.15.118:0/2740827573 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647408f590 con 0x7f6474090af0 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f64792f2700 1 --2- 172.21.15.118:0/2740827573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 0x7f6474090ec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f646c009ef0 tx=0x7f646c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4050a69fe0460c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f6473fff700 1 -- 172.21.15.118:0/2740827573 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c00e070 con 0x7f6474090af0 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f6473fff700 1 -- 172.21.15.118:0/2740827573 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c00ba50 con 0x7f6474090af0 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f6473fff700 1 -- 172.21.15.118:0/2740827573 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c0092e0 con 0x7f6474090af0 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 -- 172.21.15.118:0/2740827573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 msgr2=0x7f6474090ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 --2- 172.21.15.118:0/2740827573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 0x7f6474090ec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f646c009ef0 tx=0x7f646c009840 comp rx=0 tx=0).stop 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 -- 172.21.15.118:0/2740827573 shutdown_connections 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 --2- 172.21.15.118:0/2740827573 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 0x7f6474090ec0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 -- 172.21.15.118:0/2740827573 >> 172.21.15.118:0/2740827573 conn(0x7f64740986c0 msgr2=0x7f6474095b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 -- 172.21.15.118:0/2740827573 shutdown_connections 2023-10-05T19:50:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 -- 172.21.15.118:0/2740827573 wait complete. 2023-10-05T19:50:05.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 Processor -- start 2023-10-05T19:50:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.257+0000 7f647a2f4700 1 -- start start 2023-10-05T19:50:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f647a2f4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 0x7f647408cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f647a2f4700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647411cd40 con 0x7f6474090af0 2023-10-05T19:50:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64792f2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 0x7f647408cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64792f2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 0x7f647408cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57432/0 (socket says 172.21.15.118:57432) 2023-10-05T19:50:05.268 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64792f2700 1 -- 172.21.15.118:0/1812613690 learned_addr learned my addr 172.21.15.118:0/1812613690 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64792f2700 1 -- 172.21.15.118:0/1812613690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c009ae0 con 0x7f6474090af0 2023-10-05T19:50:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64792f2700 1 --2- 172.21.15.118:0/1812613690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 0x7f647408cb40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64740967f0 tx=0x7f646c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64717fa700 1 -- 172.21.15.118:0/1812613690 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c0092e0 con 0x7f6474090af0 2023-10-05T19:50:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64717fa700 1 -- 172.21.15.118:0/1812613690 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c012b90 con 0x7f6474090af0 2023-10-05T19:50:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647408dc10 con 0x7f6474090af0 2023-10-05T19:50:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64717fa700 1 -- 172.21.15.118:0/1812613690 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c012e80 con 0x7f6474090af0 2023-10-05T19:50:05.269 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647408e770 con 0x7f6474090af0 2023-10-05T19:50:05.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64717fa700 1 -- 172.21.15.118:0/1812613690 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f646c028460 con 0x7f6474090af0 2023-10-05T19:50:05.270 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647405ecb0 con 0x7f6474090af0 2023-10-05T19:50:05.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64717fa700 1 --2- 172.21.15.118:0/1812613690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6460032380 0x7f6460034830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f64717fa700 1 -- 172.21.15.118:0/1812613690 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f646c045480 con 0x7f6474090af0 2023-10-05T19:50:05.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.261+0000 7f6478af1700 1 --2- 172.21.15.118:0/1812613690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6460032380 0x7f6460034830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.271 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.265+0000 7f6478af1700 1 --2- 172.21.15.118:0/1812613690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6460032380 0x7f6460034830 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6468001730 tx=0x7f6468007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.278 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.269+0000 7f64717fa700 1 -- 172.21.15.118:0/1812613690 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f646c026950 con 0x7f6474090af0 2023-10-05T19:50:05.426 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.417+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6474069ef0 con 0x7f6474090af0 2023-10-05T19:50:05.428 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f64717fa700 1 -- 172.21.15.118:0/1812613690 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9002 (secure 0 0 0) 0x7f646c011390 con 0x7f6474090af0 2023-10-05T19:50:05.428 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:50:05.428 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":14,"fsid":"3d9357fa-146c-4f86-b124-205784953dac","created":"2023-10-05T19:49:54.360690+0000","modified":"2023-10-05T19:50:04.499700+0000","last_up_change":"2023-10-05T19:49:58.460378+0000","last_in_change":"2023-10-05T19:49:55.451738+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T19:49:58.615025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-05T19:50:03.270780+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c3f11994-670e-4caa-8693-e9021d7bd47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":26580},{"type":"v1","addr":"172.21.15.118:6801","nonce":26580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":26580},{"type":"v1","addr":"172.21.15.118:6803","nonce":26580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":26580},{"type":"v1","addr":"172.21.15.118:6807","nonce":26580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":26580},{"type":"v1","addr":"172.21.15.118:6805","nonce":26580}]},"public_addr":"172.21.15.118:6801/26580","cluster_addr":"172.21.15.118:6803/26580","heartbeat_back_addr":"172.21.15.118:6807/26580","heartbeat_front_addr":"172.21.15.118:6805/26580","state":["exists","up"]},{"osd":1,"uuid":"b60451bf-0be1-4f42-8ac8-59e525b1ed5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":26775},{"type":"v1","addr":"172.21.15.167:6809","nonce":26775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":26775},{"type":"v1","addr":"172.21.15.167:6811","nonce":26775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":26775},{"type":"v1","addr":"172.21.15.167:6815","nonce":26775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":26775},{"type":"v1","addr":"172.21.15.167:6813","nonce":26775}]},"public_addr":"172.21.15.167:6809/26775","cluster_addr":"172.21.15.167:6811/26775","heartbeat_back_addr":"172.21.15.167:6815/26775","heartbeat_front_addr":"172.21.15.167:6813/26775","state":["exists","up"]},{"osd":2,"uuid":"38ec3ae8-cc65-4596-b2f0-996cd54b59a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":26774},{"type":"v1","addr":"172.21.15.167:6817","nonce":26774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":26774},{"type":"v1","addr":"172.21.15.167:6819","nonce":26774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":26774},{"type":"v1","addr":"172.21.15.167:6823","nonce":26774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":26774},{"type":"v1","addr":"172.21.15.167:6821","nonce":26774}]},"public_addr":"172.21.15.167:6817/26774","cluster_addr":"172.21.15.167:6819/26774","heartbeat_back_addr":"172.21.15.167:6823/26774","heartbeat_front_addr":"172.21.15.167:6821/26774","state":["exists","up"]},{"osd":3,"uuid":"840e7308-39d6-4524-ac13-f91a77125e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":26773},{"type":"v1","addr":"172.21.15.167:6801","nonce":26773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":26773},{"type":"v1","addr":"172.21.15.167:6803","nonce":26773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":26773},{"type":"v1","addr":"172.21.15.167:6807","nonce":26773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":26773},{"type":"v1","addr":"172.21.15.167:6805","nonce":26773}]},"public_addr":"172.21.15.167:6801/26773","cluster_addr":"172.21.15.167:6803/26773","heartbeat_back_addr":"172.21.15.167:6807/26773","heartbeat_front_addr":"172.21.15.167:6805/26773","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.583291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.564146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.533170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.558782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T19:50:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6460032380 msgr2=0x7f6460034830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 --2- 172.21.15.118:0/1812613690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6460032380 0x7f6460034830 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6468001730 tx=0x7f6468007b40 comp rx=0 tx=0).stop 2023-10-05T19:50:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 msgr2=0x7f647408cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 --2- 172.21.15.118:0/1812613690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 0x7f647408cb40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64740967f0 tx=0x7f646c017000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.430 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 shutdown_connections 2023-10-05T19:50:05.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 --2- 172.21.15.118:0/1812613690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6460032380 0x7f6460034830 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 --2- 172.21.15.118:0/1812613690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6474090af0 0x7f647408cb40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 >> 172.21.15.118:0/1812613690 conn(0x7f64740986c0 msgr2=0x7f647408f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 shutdown_connections 2023-10-05T19:50:05.431 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.421+0000 7f647a2f4700 1 -- 172.21.15.118:0/1812613690 wait complete. 2023-10-05T19:50:05.440 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-05T19:50:05.441 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-05T19:50:05.441 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-05T19:50:05.441 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-05T19:50:05.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb759e700 1 Processor -- start 2023-10-05T19:50:05.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb759e700 1 -- start start 2023-10-05T19:50:05.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7cb8090380 0x7f7cb812a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.531 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb759e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80911e0 con 0x7f7cb8093bf0 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb759e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb80920a0 con 0x7f7cb8090380 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb5d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7cb8090380 0x7f7cb812a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb659c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7cb8093bf0 0x7f7cb808fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39342/0 (socket says 172.21.15.118:39342) 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb659c700 1 -- 172.21.15.118:0/4195350686 learned_addr learned my addr 172.21.15.118:0/4195350686 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb559a700 1 -- 172.21.15.118:0/4195350686 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280741028 0 0) 0x7f7cb80911e0 con 0x7f7cb8093bf0 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb559a700 1 -- 172.21.15.118:0/4195350686 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca0003570 con 0x7f7cb8093bf0 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb5d9b700 1 -- 172.21.15.118:0/4195350686 >> v1:172.21.15.118:6789/0 conn(0x7f7cb8093bf0 legacy=0x7f7cb808fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb5d9b700 1 -- 172.21.15.118:0/4195350686 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8091950 con 0x7f7cb8090380 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.521+0000 7f7cb5d9b700 1 --2- 172.21.15.118:0/4195350686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 0x7f7cb812a500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800aa10 tx=0x7f7ca800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2014adbcdae25231 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb559a700 1 -- 172.21.15.118:0/4195350686 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ca800c970 con 0x7f7cb8090380 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb559a700 1 -- 172.21.15.118:0/4195350686 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800cad0 con 0x7f7cb8090380 2023-10-05T19:50:05.532 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb559a700 1 -- 172.21.15.118:0/4195350686 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ca800cc40 con 0x7f7cb8090380 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 -- 172.21.15.118:0/4195350686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 msgr2=0x7f7cb812a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 --2- 172.21.15.118:0/4195350686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 0x7f7cb812a500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800aa10 tx=0x7f7ca800a330 comp rx=0 tx=0).stop 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 -- 172.21.15.118:0/4195350686 shutdown_connections 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 --2- 172.21.15.118:0/4195350686 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 0x7f7cb812a500 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 -- 172.21.15.118:0/4195350686 >> 172.21.15.118:0/4195350686 conn(0x7f7cb8094b00 msgr2=0x7f7cb8094f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 -- 172.21.15.118:0/4195350686 shutdown_connections 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 -- 172.21.15.118:0/4195350686 wait complete. 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 Processor -- start 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 -- start start 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 0x7f7cb8133a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.535 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8120380 con 0x7f7cb8090380 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 0x7f7cb8133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 0x7f7cb8133a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57464/0 (socket says 172.21.15.118:57464) 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb659c700 1 -- 172.21.15.118:0/3803926048 learned_addr learned my addr 172.21.15.118:0/3803926048 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb659c700 1 -- 172.21.15.118:0/3803926048 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca800a5d0 con 0x7f7cb8090380 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb659c700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 0x7f7cb8133a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0011e0 tx=0x7f7cac007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7ca67fc700 1 -- 172.21.15.118:0/3803926048 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cac005c70 con 0x7f7cb8090380 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7ca67fc700 1 -- 172.21.15.118:0/3803926048 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac005dd0 con 0x7f7cb8090380 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb811ee30 con 0x7f7cb8090380 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7ca67fc700 1 -- 172.21.15.118:0/3803926048 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cac007210 con 0x7f7cb8090380 2023-10-05T19:50:05.536 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.525+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb811f0a0 con 0x7f7cb8090380 2023-10-05T19:50:05.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7ca67fc700 1 -- 172.21.15.118:0/3803926048 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7cac007370 con 0x7f7cb8090380 2023-10-05T19:50:05.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c5b600700 1 Processor -- start 2023-10-05T19:50:05.537 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c5b600700 1 -- start start 2023-10-05T19:50:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7cb811e700 con 0x7f7cb8090380 2023-10-05T19:50:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7ca67fc700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c98032430 0x7f7c980348e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7ca67fc700 1 -- 172.21.15.118:0/3803926048 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f7cac042f00 con 0x7f7cb8090380 2023-10-05T19:50:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7ca67fc700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f7c98037b40 0x7f7c98039f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7ca67fc700 1 -- 172.21.15.118:0/3803926048 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c9803a640 con 0x7f7c98037b40 2023-10-05T19:50:05.538 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7ca67fc700 1 -- 172.21.15.118:0/3803926048 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cac00e6a0 con 0x7f7cb8090380 2023-10-05T19:50:05.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c5b600700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7c540948b0 0x7f7c5412b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c5b600700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5406d610 con 0x7f7c5406e8b0 2023-10-05T19:50:05.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c5b600700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5406ec80 con 0x7f7c540948b0 2023-10-05T19:50:05.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7cb5d9b700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c98032430 0x7f7c980348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.539 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c5939c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7c5406e8b0 0x7f7c540941a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39354/0 (socket says 172.21.15.118:39354) 2023-10-05T19:50:05.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c5939c700 1 -- 172.21.15.118:0/2188804770 learned_addr learned my addr 172.21.15.118:0/2188804770 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:05.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c58b9b700 1 --2- 172.21.15.118:0/2188804770 >> v2:172.21.15.118:3300/0 conn(0x7f7c540948b0 0x7f7c5412b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7cb6d9d700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f7c98037b40 0x7f7c98039f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.540 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c4bfff700 1 -- 172.21.15.118:0/2188804770 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714589153 0 0) 0x7f7c5406d610 con 0x7f7c5406e8b0 2023-10-05T19:50:05.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c4bfff700 1 -- 172.21.15.118:0/2188804770 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c40003570 con 0x7f7c5406e8b0 2023-10-05T19:50:05.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c58b9b700 1 -- 172.21.15.118:0/2188804770 >> v1:172.21.15.118:6789/0 conn(0x7f7c5406e8b0 legacy=0x7f7c540941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c58b9b700 1 -- 172.21.15.118:0/2188804770 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5406bdc0 con 0x7f7c540948b0 2023-10-05T19:50:05.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c58b9b700 1 --2- 172.21.15.118:0/2188804770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c540948b0 0x7f7c5412b930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009860 tx=0x7f7c500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666050d66136911d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c4bfff700 1 -- 172.21.15.118:0/2188804770 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c500108a0 con 0x7f7c540948b0 2023-10-05T19:50:05.541 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7cb6d9d700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f7c98037b40 0x7f7c98039f70 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c4bfff700 1 -- 172.21.15.118:0/2188804770 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50010a00 con 0x7f7c540948b0 2023-10-05T19:50:05.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c4bfff700 1 -- 172.21.15.118:0/2188804770 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c50010cd0 con 0x7f7c540948b0 2023-10-05T19:50:05.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7cb5d9b700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c98032430 0x7f7c980348e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800a370 tx=0x7f7ca8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c5b600700 1 -- 172.21.15.118:0/2188804770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c540948b0 msgr2=0x7f7c5412b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.542 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7c5b600700 1 --2- 172.21.15.118:0/2188804770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c540948b0 0x7f7c5412b930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009860 tx=0x7f7c500091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.543 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.529+0000 7f7ca67fc700 1 -- 172.21.15.118:0/3803926048 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f7c9803a640 con 0x7f7c98037b40 2023-10-05T19:50:05.544 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5b600700 1 -- 172.21.15.118:0/2188804770 shutdown_connections 2023-10-05T19:50:05.544 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5b600700 1 --2- 172.21.15.118:0/2188804770 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c540948b0 0x7f7c5412b930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5b600700 1 -- 172.21.15.118:0/2188804770 >> 172.21.15.118:0/2188804770 conn(0x7f7c54095290 msgr2=0x7f7c54095690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5b600700 1 -- 172.21.15.118:0/2188804770 shutdown_connections 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5b600700 1 -- 172.21.15.118:0/2188804770 wait complete. 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5b600700 1 Processor -- start 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5b600700 1 -- start start 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5b600700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c5406e8b0 0x7f7c54091b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5b600700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54086af0 con 0x7f7c5406e8b0 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5939c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c5406e8b0 0x7f7c54091b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5939c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c5406e8b0 0x7f7c54091b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57482/0 (socket says 172.21.15.118:57482) 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5939c700 1 -- 172.21.15.118:0/2413333035 learned_addr learned my addr 172.21.15.118:0/2413333035 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.545 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5939c700 1 -- 172.21.15.118:0/2413333035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50009420 con 0x7f7c5406e8b0 2023-10-05T19:50:05.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.533+0000 7f7c5939c700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c5406e8b0 0x7f7c54091b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c6c0 tx=0x7f7c44007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c497fa700 1 -- 172.21.15.118:0/2413333035 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c44005c70 con 0x7f7c5406e8b0 2023-10-05T19:50:05.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c497fa700 1 -- 172.21.15.118:0/2413333035 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44005dd0 con 0x7f7c5406e8b0 2023-10-05T19:50:05.546 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c54127120 con 0x7f7c5406e8b0 2023-10-05T19:50:05.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c497fa700 1 -- 172.21.15.118:0/2413333035 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c44007250 con 0x7f7c5406e8b0 2023-10-05T19:50:05.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c54126770 con 0x7f7c5406e8b0 2023-10-05T19:50:05.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c497fa700 1 -- 172.21.15.118:0/2413333035 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7c44007430 con 0x7f7c5406e8b0 2023-10-05T19:50:05.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c497fa700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c40032760 0x7f7c40034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c497fa700 1 -- 172.21.15.118:0/2413333035 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f7c44048260 con 0x7f7c5406e8b0 2023-10-05T19:50:05.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c58b9b700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c40032760 0x7f7c40034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.547 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.537+0000 7f7c58b9b700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c40032760 0x7f7c40034c10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7c500091e0 tx=0x7f7c50017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f7c5b600700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x7f7c300015f0 0x7f7c30003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c30006ae0 con 0x7f7c300015f0 2023-10-05T19:50:05.548 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f7c59b9d700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x7f7c300015f0 0x7f7c30003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 Processor -- start 2023-10-05T19:50:05.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 -- start start 2023-10-05T19:50:05.549 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f7c59b9d700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x7f7c300015f0 0x7f7c30003aa0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.550 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f25a808f260 0x7f25a808f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a8090d60 con 0x7f25a808fb70 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a80904e0 con 0x7f25a808f260 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25a7fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f25a808f260 0x7f25a808f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25a77fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f25a808fb70 0x7f25a8126e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39368/0 (socket says 172.21.15.118:39368) 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25a77fe700 1 -- 172.21.15.118:0/2102341784 learned_addr learned my addr 172.21.15.118:0/2102341784 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25a7fff700 1 -- 172.21.15.118:0/2102341784 >> v1:172.21.15.118:6789/0 conn(0x7f25a808fb70 legacy=0x7f25a8126e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25a7fff700 1 -- 172.21.15.118:0/2102341784 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8091180 con 0x7f25a808f260 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25a7fff700 1 --2- 172.21.15.118:0/2102341784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 0x7f25a808f630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009e10 tx=0x7f25a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456f869c24200aea server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25a6ffd700 1 -- 172.21.15.118:0/2102341784 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a000e070 con 0x7f25a808f260 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25a6ffd700 1 -- 172.21.15.118:0/2102341784 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a000bbf0 con 0x7f25a808f260 2023-10-05T19:50:05.551 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25a6ffd700 1 -- 172.21.15.118:0/2102341784 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a0012430 con 0x7f25a808f260 2023-10-05T19:50:05.552 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f7c497fa700 1 -- 172.21.15.118:0/2413333035 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f7c30006ae0 con 0x7f7c300015f0 2023-10-05T19:50:05.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 -- 172.21.15.118:0/2102341784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 msgr2=0x7f25a808f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 --2- 172.21.15.118:0/2102341784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 0x7f25a808f630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009e10 tx=0x7f25a0009780 comp rx=0 tx=0).stop 2023-10-05T19:50:05.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 -- 172.21.15.118:0/2102341784 shutdown_connections 2023-10-05T19:50:05.553 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 --2- 172.21.15.118:0/2102341784 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 0x7f25a808f630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.541+0000 7f25ad0d1700 1 -- 172.21.15.118:0/2102341784 >> 172.21.15.118:0/2102341784 conn(0x7f25a8094b00 msgr2=0x7f25a8094f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25ad0d1700 1 -- 172.21.15.118:0/2102341784 shutdown_connections 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25ad0d1700 1 -- 172.21.15.118:0/2102341784 wait complete. 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25ad0d1700 1 Processor -- start 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25ad0d1700 1 -- start start 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25ad0d1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 0x7f25a808c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25ad0d1700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a811df00 con 0x7f25a808f260 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25a7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 0x7f25a808c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25a7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 0x7f25a808c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57494/0 (socket says 172.21.15.118:57494) 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25a7fff700 1 -- 172.21.15.118:0/3237004605 learned_addr learned my addr 172.21.15.118:0/3237004605 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.554 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25a7fff700 1 -- 172.21.15.118:0/3237004605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a0009a20 con 0x7f25a808f260 2023-10-05T19:50:05.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f9362935700 1 Processor -- start 2023-10-05T19:50:05.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f9362935700 1 -- start start 2023-10-05T19:50:05.555 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25a7fff700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 0x7f25a808c880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f25a00099f0 tx=0x7f25a0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f258ffff700 1 -- 172.21.15.118:0/3237004605 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a0027470 con 0x7f25a808f260 2023-10-05T19:50:05.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f258ffff700 1 -- 172.21.15.118:0/3237004605 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a00275f0 con 0x7f25a808f260 2023-10-05T19:50:05.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a808e510 con 0x7f25a808f260 2023-10-05T19:50:05.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f258ffff700 1 -- 172.21.15.118:0/3237004605 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a00278e0 con 0x7f25a808f260 2023-10-05T19:50:05.556 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a811d590 con 0x7f25a808f260 2023-10-05T19:50:05.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f9362935700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f935c090f50 0x7f935c12b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f9362935700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935c091690 con 0x7f935c090470 2023-10-05T19:50:05.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f9362935700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935c094260 con 0x7f935c090f50 2023-10-05T19:50:05.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f935b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f935c090f50 0x7f935c12b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f935b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f935c090f50 0x7f935c12b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57508/0 (socket says 172.21.15.118:57508) 2023-10-05T19:50:05.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.545+0000 7f935b7fe700 1 -- 172.21.15.118:0/2298211166 learned_addr learned my addr 172.21.15.118:0/2298211166 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935b7fe700 1 -- 172.21.15.118:0/2298211166 >> v1:172.21.15.118:6789/0 conn(0x7f935c090470 legacy=0x7f935c090840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.557 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935b7fe700 1 -- 172.21.15.118:0/2298211166 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c091c90 con 0x7f935c090f50 2023-10-05T19:50:05.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25a805ecb0 con 0x7f25a808f260 2023-10-05T19:50:05.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935affd700 1 -- 172.21.15.118:0/2298211166 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214029321 0 0) 0x7f935c091690 con 0x7f935c090470 2023-10-05T19:50:05.558 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f258ffff700 1 -- 172.21.15.118:0/3237004605 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f25a0024070 con 0x7f25a808f260 2023-10-05T19:50:05.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935b7fe700 1 --2- 172.21.15.118:0/2298211166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090f50 0x7f935c12b1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9350009930 tx=0x7f9350009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ea683da91cf5c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935affd700 1 -- 172.21.15.118:0/2298211166 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935000b860 con 0x7f935c090f50 2023-10-05T19:50:05.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f258ffff700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594032380 0x7f2594034830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.559 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f258ffff700 1 -- 172.21.15.118:0/3237004605 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f25a0046450 con 0x7f25a808f260 2023-10-05T19:50:05.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f258ffff700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2594037a90 0x7f2594039ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f258ffff700 1 -- 172.21.15.118:0/3237004605 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f259403a590 con 0x7f2594037a90 2023-10-05T19:50:05.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f258ffff700 1 -- 172.21.15.118:0/3237004605 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25a002f990 con 0x7f25a808f260 2023-10-05T19:50:05.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935affd700 1 -- 172.21.15.118:0/2298211166 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935000b9c0 con 0x7f935c090f50 2023-10-05T19:50:05.560 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935affd700 1 -- 172.21.15.118:0/2298211166 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935000bb50 con 0x7f935c090f50 2023-10-05T19:50:05.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f25a77fe700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594032380 0x7f2594034830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f25ac8d0700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2594037a90 0x7f2594039ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.561 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 -- 172.21.15.118:0/2298211166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090f50 msgr2=0x7f935c12b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 --2- 172.21.15.118:0/2298211166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090f50 0x7f935c12b1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9350009930 tx=0x7f9350009250 comp rx=0 tx=0).stop 2023-10-05T19:50:05.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 -- 172.21.15.118:0/2298211166 shutdown_connections 2023-10-05T19:50:05.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 --2- 172.21.15.118:0/2298211166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090f50 0x7f935c12b1b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 -- 172.21.15.118:0/2298211166 >> 172.21.15.118:0/2298211166 conn(0x7f935c094aa0 msgr2=0x7f935c094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 -- 172.21.15.118:0/2298211166 shutdown_connections 2023-10-05T19:50:05.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 -- 172.21.15.118:0/2298211166 wait complete. 2023-10-05T19:50:05.562 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f25ac8d0700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2594037a90 0x7f2594039ec0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.563 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f25a77fe700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594032380 0x7f2594034830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f259c0016a0 tx=0x7f259c007b30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.563 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 Processor -- start 2023-10-05T19:50:05.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 -- start start 2023-10-05T19:50:05.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090470 0x7f935c1357c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c133220 con 0x7f935c090470 2023-10-05T19:50:05.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090470 0x7f935c1357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090470 0x7f935c1357c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57522/0 (socket says 172.21.15.118:57522) 2023-10-05T19:50:05.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935bfff700 1 -- 172.21.15.118:0/2199068490 learned_addr learned my addr 172.21.15.118:0/2199068490 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935bfff700 1 -- 172.21.15.118:0/2199068490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500094f0 con 0x7f935c090470 2023-10-05T19:50:05.564 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f258ffff700 1 -- 172.21.15.118:0/3237004605 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f259403a590 con 0x7f2594037a90 2023-10-05T19:50:05.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f935bfff700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090470 0x7f935c1357c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c6e0 tx=0x7f934c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9343fff700 1 -- 172.21.15.118:0/2199068490 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f934c010610 con 0x7f935c090470 2023-10-05T19:50:05.565 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.549+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935c097380 con 0x7f935c090470 2023-10-05T19:50:05.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935c11d180 con 0x7f935c090470 2023-10-05T19:50:05.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9343fff700 1 -- 172.21.15.118:0/2199068490 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c010770 con 0x7f935c090470 2023-10-05T19:50:05.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9343fff700 1 -- 172.21.15.118:0/2199068490 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f934c010a40 con 0x7f935c090470 2023-10-05T19:50:05.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f935c05ecb0 con 0x7f935c090470 2023-10-05T19:50:05.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9343fff700 1 -- 172.21.15.118:0/2199068490 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f934c010ba0 con 0x7f935c090470 2023-10-05T19:50:05.566 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7cb8093e30 con 0x7f7c98037b40 2023-10-05T19:50:05.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9343fff700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93440323b0 0x7f9344034860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9343fff700 1 -- 172.21.15.118:0/2199068490 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f934c0430a0 con 0x7f935c090470 2023-10-05T19:50:05.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9343fff700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f9344037ac0 0x7f9344039ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9343fff700 1 -- 172.21.15.118:0/2199068490 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f934403a5c0 con 0x7f9344037ac0 2023-10-05T19:50:05.567 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9343fff700 1 -- 172.21.15.118:0/2199068490 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f934c01b3b0 con 0x7f935c090470 2023-10-05T19:50:05.568 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f935b7fe700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93440323b0 0x7f9344034860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.568 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7ca67fc700 1 -- 172.21.15.118:0/3803926048 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7cb8093e30 con 0x7f7c98037b40 2023-10-05T19:50:05.568 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9360ed2700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f9344037ac0 0x7f9344039ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f7c98037b40 msgr2=0x7f7c98039f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f7c98037b40 0x7f7c98039f70 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9360ed2700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f9344037ac0 0x7f9344039ef0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c98032430 msgr2=0x7f7c980348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.569 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c98032430 0x7f7c980348e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800a370 tx=0x7f7ca8019000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 msgr2=0x7f7cb8133a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 0x7f7cb8133a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0011e0 tx=0x7f7cac007df0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.570 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f935b7fe700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93440323b0 0x7f9344034860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9350000c00 tx=0x7f9350016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 shutdown_connections 2023-10-05T19:50:05.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f7c98037b40 0x7f7c98039f70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c98032430 0x7f7c980348e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 --2- 172.21.15.118:0/3803926048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7cb8090380 0x7f7cb8133a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 >> 172.21.15.118:0/3803926048 conn(0x7f7cb8094b00 msgr2=0x7f7cb8127410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 shutdown_connections 2023-10-05T19:50:05.571 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f9343fff700 1 -- 172.21.15.118:0/2199068490 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f934403a5c0 con 0x7f9344037ac0 2023-10-05T19:50:05.572 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.553+0000 7f7cb759e700 1 -- 172.21.15.118:0/3803926048 wait complete. 2023-10-05T19:50:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c30005bd0 con 0x7f7c300015f0 2023-10-05T19:50:05.573 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25a804b5c0 con 0x7f2594037a90 2023-10-05T19:50:05.574 INFO:teuthology.orchestra.run.smithi118.stdout:38654705667 2023-10-05T19:50:05.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-05T19:50:05.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c497fa700 1 -- 172.21.15.118:0/2413333035 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7c30005bd0 con 0x7f7c300015f0 2023-10-05T19:50:05.575 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f258ffff700 1 -- 172.21.15.118:0/3237004605 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f25a804b5c0 con 0x7f2594037a90 2023-10-05T19:50:05.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x7f7c300015f0 msgr2=0x7f7c30003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x7f7c300015f0 0x7f7c30003aa0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2594037a90 msgr2=0x7f2594039ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.576 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2594037a90 0x7f2594039ec0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c40032760 msgr2=0x7f7c40034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c40032760 0x7f7c40034c10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7c500091e0 tx=0x7f7c50017000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c5406e8b0 msgr2=0x7f7c54091b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.577 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c5406e8b0 0x7f7c54091b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c6c0 tx=0x7f7c44007e00 comp rx=0 tx=0).stop 2023-10-05T19:50:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594032380 msgr2=0x7f2594034830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594032380 0x7f2594034830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f259c0016a0 tx=0x7f259c007b30 comp rx=0 tx=0).stop 2023-10-05T19:50:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 msgr2=0x7f25a808c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 0x7f25a808c880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f25a00099f0 tx=0x7f25a0018000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 shutdown_connections 2023-10-05T19:50:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x7f7c300015f0 0x7f7c30003aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7c40032760 0x7f7c40034c10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.578 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 --2- 172.21.15.118:0/2413333035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7c5406e8b0 0x7f7c54091b60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 >> 172.21.15.118:0/2413333035 conn(0x7f7c54095290 msgr2=0x7f7c5411f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 shutdown_connections 2023-10-05T19:50:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2594037a90 0x7f2594039ec0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594032380 0x7f2594034830 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 --2- 172.21.15.118:0/3237004605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f25a808f260 0x7f25a808c880 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f25a00099f0 tx=0x7f25a0018000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.579 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 >> 172.21.15.118:0/3237004605 conn(0x7f25a8094b00 msgr2=0x7f25a806d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 shutdown_connections 2023-10-05T19:50:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 shutdown_connections 2023-10-05T19:50:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f25ad0d1700 1 -- 172.21.15.118:0/3237004605 wait complete. 2023-10-05T19:50:05.580 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.565+0000 7f7c5b600700 1 -- 172.21.15.118:0/2413333035 wait complete. 2023-10-05T19:50:05.586 INFO:teuthology.orchestra.run.smithi118.stdout:38654705667 2023-10-05T19:50:05.587 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-05T19:50:05.587 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.577+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f935c04b5c0 con 0x7f9344037ac0 2023-10-05T19:50:05.588 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.577+0000 7f9343fff700 1 -- 172.21.15.118:0/2199068490 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f935c04b5c0 con 0x7f9344037ac0 2023-10-05T19:50:05.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f9344037ac0 msgr2=0x7f9344039ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f9344037ac0 0x7f9344039ef0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93440323b0 msgr2=0x7f9344034860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93440323b0 0x7f9344034860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9350000c00 tx=0x7f9350016000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090470 msgr2=0x7f935c1357c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090470 0x7f935c1357c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c6e0 tx=0x7f934c007df0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.589 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 shutdown_connections 2023-10-05T19:50:05.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f9344037ac0 0x7f9344039ef0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93440323b0 0x7f9344034860 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 --2- 172.21.15.118:0/2199068490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f935c090470 0x7f935c1357c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.590 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 >> 172.21.15.118:0/2199068490 conn(0x7f935c094aa0 msgr2=0x7f935c06c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.591 INFO:teuthology.orchestra.run.smithi118.stdout:38654705667 2023-10-05T19:50:05.591 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-05T19:50:05.591 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 shutdown_connections 2023-10-05T19:50:05.592 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.581+0000 7f9362935700 1 -- 172.21.15.118:0/2199068490 wait complete. 2023-10-05T19:50:05.598 INFO:teuthology.orchestra.run.smithi118.stdout:38654705667 2023-10-05T19:50:05.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-05T19:50:05.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.669+0000 7fe7d7fff700 1 Processor -- start 2023-10-05T19:50:05.679 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.669+0000 7fe7d7fff700 1 -- start start 2023-10-05T19:50:05.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe7d808f260 0x7fe7d808f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.681 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d8090d60 con 0x7fe7d808fb70 2023-10-05T19:50:05.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d80904e0 con 0x7fe7d808f260 2023-10-05T19:50:05.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe7d808f260 0x7fe7d808f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d6ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe7d808f260 0x7fe7d808f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57532/0 (socket says 172.21.15.118:57532) 2023-10-05T19:50:05.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d67fc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fe7d808fb70 0x7fe7d8126e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39384/0 (socket says 172.21.15.118:39384) 2023-10-05T19:50:05.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d6ffd700 1 -- 172.21.15.118:0/4037634536 learned_addr learned my addr 172.21.15.118:0/4037634536 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.682 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d5ffb700 1 -- 172.21.15.118:0/4037634536 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548341102 0 0) 0x7fe7d8090d60 con 0x7fe7d808fb70 2023-10-05T19:50:05.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d6ffd700 1 -- 172.21.15.118:0/4037634536 >> v1:172.21.15.118:6789/0 conn(0x7fe7d808fb70 legacy=0x7fe7d8126e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d6ffd700 1 -- 172.21.15.118:0/4037634536 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8091180 con 0x7fe7d808f260 2023-10-05T19:50:05.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d6ffd700 1 --2- 172.21.15.118:0/4037634536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 0x7fe7d808f630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009930 tx=0x7fe7c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2010c33ddb612a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d5ffb700 1 -- 172.21.15.118:0/4037634536 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c800b860 con 0x7fe7d808f260 2023-10-05T19:50:05.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d5ffb700 1 -- 172.21.15.118:0/4037634536 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c800b9c0 con 0x7fe7d808f260 2023-10-05T19:50:05.683 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d5ffb700 1 -- 172.21.15.118:0/4037634536 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c800bb50 con 0x7fe7d808f260 2023-10-05T19:50:05.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 -- 172.21.15.118:0/4037634536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 msgr2=0x7fe7d808f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.687 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 --2- 172.21.15.118:0/4037634536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 0x7fe7d808f630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009930 tx=0x7fe7c8009250 comp rx=0 tx=0).stop 2023-10-05T19:50:05.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 -- 172.21.15.118:0/4037634536 shutdown_connections 2023-10-05T19:50:05.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 --2- 172.21.15.118:0/4037634536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 0x7fe7d808f630 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 -- 172.21.15.118:0/4037634536 >> 172.21.15.118:0/4037634536 conn(0x7fe7d8094b00 msgr2=0x7fe7d8094f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 -- 172.21.15.118:0/4037634536 shutdown_connections 2023-10-05T19:50:05.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.673+0000 7fe7d7fff700 1 -- 172.21.15.118:0/4037634536 wait complete. 2023-10-05T19:50:05.688 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d7fff700 1 Processor -- start 2023-10-05T19:50:05.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d7fff700 1 -- start start 2023-10-05T19:50:05.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d7fff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 0x7fe7d8069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d7fff700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d808ca80 con 0x7fe7d808f260 2023-10-05T19:50:05.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 0x7fe7d8069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d6ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 0x7fe7d8069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57542/0 (socket says 172.21.15.118:57542) 2023-10-05T19:50:05.689 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d6ffd700 1 -- 172.21.15.118:0/409817690 learned_addr learned my addr 172.21.15.118:0/409817690 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d6ffd700 1 -- 172.21.15.118:0/409817690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c80094f0 con 0x7fe7d808f260 2023-10-05T19:50:05.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d6ffd700 1 --2- 172.21.15.118:0/409817690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 0x7fe7d8069f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80094c0 tx=0x7fe7c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7beffd700 1 -- 172.21.15.118:0/409817690 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c800bd00 con 0x7fe7d808f260 2023-10-05T19:50:05.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d808dda0 con 0x7fe7d808f260 2023-10-05T19:50:05.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d808c710 con 0x7fe7d808f260 2023-10-05T19:50:05.690 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7beffd700 1 -- 172.21.15.118:0/409817690 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c8020070 con 0x7fe7d808f260 2023-10-05T19:50:05.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7beffd700 1 -- 172.21.15.118:0/409817690 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7c801b450 con 0x7fe7d808f260 2023-10-05T19:50:05.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7beffd700 1 -- 172.21.15.118:0/409817690 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fe7c8022030 con 0x7fe7d808f260 2023-10-05T19:50:05.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7beffd700 1 --2- 172.21.15.118:0/409817690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe7c4032390 0x7fe7c4034840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7beffd700 1 -- 172.21.15.118:0/409817690 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fe7c80459f0 con 0x7fe7d808f260 2023-10-05T19:50:05.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.677+0000 7fe7d67fc700 1 --2- 172.21.15.118:0/409817690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe7c4032390 0x7fe7c4034840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.691 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.681+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d805ecb0 con 0x7fe7d808f260 2023-10-05T19:50:05.692 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.681+0000 7fe7d67fc700 1 --2- 172.21.15.118:0/409817690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe7c4032390 0x7fe7c4034840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0011e0 tx=0x7fe7cc007990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.695 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.685+0000 7fe7beffd700 1 -- 172.21.15.118:0/409817690 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7fe7c80249c0 con 0x7fe7d808f260 2023-10-05T19:50:05.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f8906519700 1 Processor -- start 2023-10-05T19:50:05.705 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f8906519700 1 -- start start 2023-10-05T19:50:05.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f8906519700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f890008f360 0x7f890008f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f8906519700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89000914c0 con 0x7f8900094090 2023-10-05T19:50:05.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f8906519700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8900090b80 con 0x7f890008f360 2023-10-05T19:50:05.706 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f88fffff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f890008f360 0x7f890008f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f88ff7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8900094090 0x7f8900126f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39398/0 (socket says 172.21.15.118:39398) 2023-10-05T19:50:05.707 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f88ff7fe700 1 -- 172.21.15.118:0/3944019681 learned_addr learned my addr 172.21.15.118:0/3944019681 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:05.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f88feffd700 1 -- 172.21.15.118:0/3944019681 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024665428 0 0) 0x7f89000914c0 con 0x7f8900094090 2023-10-05T19:50:05.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f88feffd700 1 -- 172.21.15.118:0/3944019681 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e8003570 con 0x7f8900094090 2023-10-05T19:50:05.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f88fffff700 1 -- 172.21.15.118:0/3944019681 >> v1:172.21.15.118:6789/0 conn(0x7f8900094090 legacy=0x7f8900126f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f88fffff700 1 -- 172.21.15.118:0/3944019681 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8900090410 con 0x7f890008f360 2023-10-05T19:50:05.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.697+0000 7f88fffff700 1 --2- 172.21.15.118:0/3944019681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 0x7f890008f730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009890 tx=0x7f88f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76611c6be99f3ce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f88feffd700 1 -- 172.21.15.118:0/3944019681 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88f4011630 con 0x7f890008f360 2023-10-05T19:50:05.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f88feffd700 1 -- 172.21.15.118:0/3944019681 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f4011790 con 0x7f890008f360 2023-10-05T19:50:05.708 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f88feffd700 1 -- 172.21.15.118:0/3944019681 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88f4011900 con 0x7f890008f360 2023-10-05T19:50:05.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 -- 172.21.15.118:0/3944019681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 msgr2=0x7f890008f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 --2- 172.21.15.118:0/3944019681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 0x7f890008f730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009890 tx=0x7f88f40091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 -- 172.21.15.118:0/3944019681 shutdown_connections 2023-10-05T19:50:05.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 --2- 172.21.15.118:0/3944019681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 0x7f890008f730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 -- 172.21.15.118:0/3944019681 >> 172.21.15.118:0/3944019681 conn(0x7f8900094aa0 msgr2=0x7f8900094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 -- 172.21.15.118:0/3944019681 shutdown_connections 2023-10-05T19:50:05.709 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 -- 172.21.15.118:0/3944019681 wait complete. 2023-10-05T19:50:05.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 Processor -- start 2023-10-05T19:50:05.710 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 -- start start 2023-10-05T19:50:05.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 0x7f890006a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f8906519700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890008c600 con 0x7f890008f360 2023-10-05T19:50:05.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f88fffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 0x7f890006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f88fffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 0x7f890006a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57566/0 (socket says 172.21.15.118:57566) 2023-10-05T19:50:05.711 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.701+0000 7f88fffff700 1 -- 172.21.15.118:0/535805646 learned_addr learned my addr 172.21.15.118:0/535805646 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88fffff700 1 -- 172.21.15.118:0/535805646 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f4009420 con 0x7f890008f360 2023-10-05T19:50:05.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88fffff700 1 --2- 172.21.15.118:0/535805646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 0x7f890006a190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88f40091e0 tx=0x7f88f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88e7fff700 1 -- 172.21.15.118:0/535805646 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88f4011630 con 0x7f890008f360 2023-10-05T19:50:05.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88e7fff700 1 -- 172.21.15.118:0/535805646 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f4020070 con 0x7f890008f360 2023-10-05T19:50:05.712 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890006bd20 con 0x7f890008f360 2023-10-05T19:50:05.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88e7fff700 1 -- 172.21.15.118:0/535805646 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88f40275c0 con 0x7f890008f360 2023-10-05T19:50:05.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890008d940 con 0x7f890008f360 2023-10-05T19:50:05.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88e7fff700 1 -- 172.21.15.118:0/535805646 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f88f4027720 con 0x7f890008f360 2023-10-05T19:50:05.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88e7fff700 1 --2- 172.21.15.118:0/535805646 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f88ec0323e0 0x7f88ec034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.713 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88e7fff700 1 -- 172.21.15.118:0/535805646 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f88f4022070 con 0x7f890008f360 2023-10-05T19:50:05.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88ff7fe700 1 --2- 172.21.15.118:0/535805646 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f88ec0323e0 0x7f88ec034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.714 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.705+0000 7f88ff7fe700 1 --2- 172.21.15.118:0/535805646 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f88ec0323e0 0x7f88ec034890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f88f8005c50 tx=0x7f88f80016e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.715 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.709+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890005ecb0 con 0x7f890008f360 2023-10-05T19:50:05.724 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.717+0000 7f88e7fff700 1 -- 172.21.15.118:0/535805646 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f88f40263e0 con 0x7f890008f360 2023-10-05T19:50:05.745 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8c56f0700 1 Processor -- start 2023-10-05T19:50:05.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8c56f0700 1 -- start start 2023-10-05T19:50:05.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8c56f0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd8c0069b80 0x7fd8c012c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8c56f0700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c0092e70 con 0x7fd8c00690a0 2023-10-05T19:50:05.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8c56f0700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c006e960 con 0x7fd8c0069b80 2023-10-05T19:50:05.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8bffff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fd8c00690a0 0x7fd8c0069470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39406/0 (socket says 172.21.15.118:39406) 2023-10-05T19:50:05.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8bf7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd8c0069b80 0x7fd8c012c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8bffff700 1 -- 172.21.15.118:0/1214581487 learned_addr learned my addr 172.21.15.118:0/1214581487 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:05.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8beffd700 1 -- 172.21.15.118:0/1214581487 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657003753 0 0) 0x7fd8c0092e70 con 0x7fd8c00690a0 2023-10-05T19:50:05.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8beffd700 1 -- 172.21.15.118:0/1214581487 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a8003570 con 0x7fd8c00690a0 2023-10-05T19:50:05.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8bf7fe700 1 -- 172.21.15.118:0/1214581487 >> v1:172.21.15.118:6789/0 conn(0x7fd8c00690a0 legacy=0x7fd8c0069470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8bf7fe700 1 -- 172.21.15.118:0/1214581487 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c006b6e0 con 0x7fd8c0069b80 2023-10-05T19:50:05.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8bf7fe700 1 --2- 172.21.15.118:0/1214581487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c0069b80 0x7fd8c012c130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009860 tx=0x7fd8b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af14e731ce5c2b3c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.737+0000 7fd8beffd700 1 -- 172.21.15.118:0/1214581487 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b8011630 con 0x7fd8c0069b80 2023-10-05T19:50:05.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8beffd700 1 -- 172.21.15.118:0/1214581487 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b8011790 con 0x7fd8c0069b80 2023-10-05T19:50:05.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8beffd700 1 -- 172.21.15.118:0/1214581487 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b8011920 con 0x7fd8c0069b80 2023-10-05T19:50:05.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 Processor -- start 2023-10-05T19:50:05.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 -- start start 2023-10-05T19:50:05.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 -- 172.21.15.118:0/1214581487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c0069b80 msgr2=0x7fd8c012c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 --2- 172.21.15.118:0/1214581487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c0069b80 0x7fd8c012c130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009860 tx=0x7fd8b80091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17b4090470 0x7f17b4090840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b4091690 con 0x7f17b4090d80 2023-10-05T19:50:05.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b4094260 con 0x7f17b4090470 2023-10-05T19:50:05.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b37fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17b4090470 0x7f17b4090840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17abfff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f17b4090d80 0x7f17b4125f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39416/0 (socket says 172.21.15.118:39416) 2023-10-05T19:50:05.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17abfff700 1 -- 172.21.15.118:0/2971021319 learned_addr learned my addr 172.21.15.118:0/2971021319 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:05.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 -- 172.21.15.118:0/1214581487 shutdown_connections 2023-10-05T19:50:05.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 --2- 172.21.15.118:0/1214581487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c0069b80 0x7fd8c012c130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 -- 172.21.15.118:0/1214581487 >> 172.21.15.118:0/1214581487 conn(0x7fd8c0095bf0 msgr2=0x7fd8c0095ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b37fe700 1 -- 172.21.15.118:0/2971021319 >> v1:172.21.15.118:6789/0 conn(0x7f17b4090d80 legacy=0x7f17b4125f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b37fe700 1 -- 172.21.15.118:0/2971021319 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4091c90 con 0x7f17b4090470 2023-10-05T19:50:05.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 -- 172.21.15.118:0/1214581487 shutdown_connections 2023-10-05T19:50:05.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 -- 172.21.15.118:0/1214581487 wait complete. 2023-10-05T19:50:05.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b37fe700 1 --2- 172.21.15.118:0/2971021319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 0x7f17b4090840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f179c009860 tx=0x7f179c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b2e8eb32e9e99d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b2ffd700 1 -- 172.21.15.118:0/2971021319 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f179c00b680 con 0x7f17b4090470 2023-10-05T19:50:05.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b2ffd700 1 -- 172.21.15.118:0/2971021319 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c00b7e0 con 0x7f17b4090470 2023-10-05T19:50:05.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b2ffd700 1 -- 172.21.15.118:0/2971021319 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f179c00b990 con 0x7f17b4090470 2023-10-05T19:50:05.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 Processor -- start 2023-10-05T19:50:05.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 -- start start 2023-10-05T19:50:05.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00690a0 0x7fd8c0135780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 -- 172.21.15.118:0/2971021319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 msgr2=0x7f17b4090840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 --2- 172.21.15.118:0/2971021319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 0x7f17b4090840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f179c009860 tx=0x7f179c0091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8c56f0700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0069f70 con 0x7fd8c00690a0 2023-10-05T19:50:05.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 -- 172.21.15.118:0/2971021319 shutdown_connections 2023-10-05T19:50:05.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 --2- 172.21.15.118:0/2971021319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 0x7f17b4090840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 -- 172.21.15.118:0/2971021319 >> 172.21.15.118:0/2971021319 conn(0x7f17b4094aa0 msgr2=0x7f17b4094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 -- 172.21.15.118:0/2971021319 shutdown_connections 2023-10-05T19:50:05.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8bffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00690a0 0x7fd8c0135780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8bffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00690a0 0x7fd8c0135780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57600/0 (socket says 172.21.15.118:57600) 2023-10-05T19:50:05.755 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7f17b9ad8700 1 -- 172.21.15.118:0/2971021319 wait complete. 2023-10-05T19:50:05.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8bffff700 1 -- 172.21.15.118:0/2707341967 learned_addr learned my addr 172.21.15.118:0/2707341967 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8bffff700 1 -- 172.21.15.118:0/2707341967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8009420 con 0x7fd8c00690a0 2023-10-05T19:50:05.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.741+0000 7fd8bffff700 1 --2- 172.21.15.118:0/2707341967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00690a0 0x7fd8c0135780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c6c0 tx=0x7fd8b4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.756 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8a7fff700 1 -- 172.21.15.118:0/2707341967 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4005b30 con 0x7fd8c00690a0 2023-10-05T19:50:05.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7f17b9ad8700 1 Processor -- start 2023-10-05T19:50:05.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8a7fff700 1 -- 172.21.15.118:0/2707341967 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b4005c90 con 0x7fd8c00690a0 2023-10-05T19:50:05.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8a7fff700 1 -- 172.21.15.118:0/2707341967 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8b40070d0 con 0x7fd8c00690a0 2023-10-05T19:50:05.757 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c008faa0 con 0x7fd8c00690a0 2023-10-05T19:50:05.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7f17b9ad8700 1 -- start start 2023-10-05T19:50:05.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c008f610 con 0x7fd8c00690a0 2023-10-05T19:50:05.758 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8a7fff700 1 -- 172.21.15.118:0/2707341967 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fd8b4007230 con 0x7fd8c00690a0 2023-10-05T19:50:05.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7f17b9ad8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 0x7f17b408b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7f17b9ad8700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b408fd60 con 0x7f17b4090470 2023-10-05T19:50:05.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7f17b37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 0x7f17b408b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7f17b37fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 0x7f17b408b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57602/0 (socket says 172.21.15.118:57602) 2023-10-05T19:50:05.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7f17b37fe700 1 -- 172.21.15.118:0/934701651 learned_addr learned my addr 172.21.15.118:0/934701651 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:05.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7f17b37fe700 1 -- 172.21.15.118:0/934701651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c009420 con 0x7f17b4090470 2023-10-05T19:50:05.759 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c005ecb0 con 0x7fd8c00690a0 2023-10-05T19:50:05.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8a7fff700 1 --2- 172.21.15.118:0/2707341967 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd8ac0323d0 0x7fd8ac034880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7f17b37fe700 1 --2- 172.21.15.118:0/934701651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 0x7f17b408b820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f179c009fb0 tx=0x7f179c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8a7fff700 1 -- 172.21.15.118:0/2707341967 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fd8b4042f30 con 0x7fd8c00690a0 2023-10-05T19:50:05.760 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8bf7fe700 1 --2- 172.21.15.118:0/2707341967 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd8ac0323d0 0x7fd8ac034880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.745+0000 7fd8bf7fe700 1 --2- 172.21.15.118:0/2707341967 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd8ac0323d0 0x7fd8ac034880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80030c0 tx=0x7fd8b8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.749+0000 7f17ab7fe700 1 -- 172.21.15.118:0/934701651 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f179c02d3f0 con 0x7f17b4090470 2023-10-05T19:50:05.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.749+0000 7f17ab7fe700 1 -- 172.21.15.118:0/934701651 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c02d550 con 0x7f17b4090470 2023-10-05T19:50:05.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.749+0000 7f17ab7fe700 1 -- 172.21.15.118:0/934701651 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f179c02d820 con 0x7f17b4090470 2023-10-05T19:50:05.761 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.749+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b408e260 con 0x7f17b4090470 2023-10-05T19:50:05.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.749+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b408d3a0 con 0x7f17b4090470 2023-10-05T19:50:05.762 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.749+0000 7fd8a7fff700 1 -- 172.21.15.118:0/2707341967 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7fd8b4072bb0 con 0x7fd8c00690a0 2023-10-05T19:50:05.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.753+0000 7f17ab7fe700 1 -- 172.21.15.118:0/934701651 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f179c02d9d0 con 0x7f17b4090470 2023-10-05T19:50:05.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.753+0000 7f17ab7fe700 1 --2- 172.21.15.118:0/934701651 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f17980323e0 0x7f1798034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:05.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.753+0000 7f17ab7fe700 1 -- 172.21.15.118:0/934701651 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f179c04e150 con 0x7f17b4090470 2023-10-05T19:50:05.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.753+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b4095580 con 0x7f17b4090470 2023-10-05T19:50:05.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.753+0000 7f17abfff700 1 --2- 172.21.15.118:0/934701651 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f17980323e0 0x7f1798034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:05.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.753+0000 7f17abfff700 1 --2- 172.21.15.118:0/934701651 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f17980323e0 0x7f1798034890 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f17a40016c0 tx=0x7f17a4007b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:05.765 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.757+0000 7f17ab7fe700 1 -- 172.21.15.118:0/934701651 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f17b4095580 con 0x7f17b4090470 2023-10-05T19:50:05.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.853+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe7d804b5c0 con 0x7fe7d808f260 2023-10-05T19:50:05.861 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.853+0000 7fe7beffd700 1 -- 172.21.15.118:0/409817690 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7c80243d0 con 0x7fe7d808f260 2023-10-05T19:50:05.862 INFO:teuthology.orchestra.run.smithi118.stdout:38654705665 2023-10-05T19:50:05.863 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe7c4032390 msgr2=0x7fe7c4034840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 --2- 172.21.15.118:0/409817690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe7c4032390 0x7fe7c4034840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0011e0 tx=0x7fe7cc007990 comp rx=0 tx=0).stop 2023-10-05T19:50:05.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 msgr2=0x7fe7d8069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 --2- 172.21.15.118:0/409817690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 0x7fe7d8069f80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80094c0 tx=0x7fe7c8016000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 shutdown_connections 2023-10-05T19:50:05.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 --2- 172.21.15.118:0/409817690 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe7c4032390 0x7fe7c4034840 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 --2- 172.21.15.118:0/409817690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe7d808f260 0x7fe7d8069f80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 >> 172.21.15.118:0/409817690 conn(0x7fe7d8094b00 msgr2=0x7fe7d806d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 shutdown_connections 2023-10-05T19:50:05.864 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.857+0000 7fe7d7fff700 1 -- 172.21.15.118:0/409817690 wait complete. 2023-10-05T19:50:05.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.3 2023-10-05T19:50:05.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.905+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f890004b5c0 con 0x7f890008f360 2023-10-05T19:50:05.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.905+0000 7f88e7fff700 1 -- 172.21.15.118:0/535805646 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88f4019e60 con 0x7f890008f360 2023-10-05T19:50:05.914 INFO:teuthology.orchestra.run.smithi118.stdout:38654705665 2023-10-05T19:50:05.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f88ec0323e0 msgr2=0x7f88ec034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 --2- 172.21.15.118:0/535805646 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f88ec0323e0 0x7f88ec034890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f88f8005c50 tx=0x7f88f80016e0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 msgr2=0x7f890006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 --2- 172.21.15.118:0/535805646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 0x7f890006a190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f88f40091e0 tx=0x7f88f4016000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 shutdown_connections 2023-10-05T19:50:05.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 --2- 172.21.15.118:0/535805646 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f88ec0323e0 0x7f88ec034890 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 --2- 172.21.15.118:0/535805646 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f890008f360 0x7f890006a190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 >> 172.21.15.118:0/535805646 conn(0x7f8900094aa0 msgr2=0x7f890006e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 shutdown_connections 2023-10-05T19:50:05.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7f8906519700 1 -- 172.21.15.118:0/535805646 wait complete. 2023-10-05T19:50:05.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd8c004b5c0 con 0x7fd8c00690a0 2023-10-05T19:50:05.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.909+0000 7fd8a7fff700 1 -- 172.21.15.118:0/2707341967 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8b4017070 con 0x7fd8c00690a0 2023-10-05T19:50:05.920 INFO:teuthology.orchestra.run.smithi118.stdout:38654705665 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd8ac0323d0 msgr2=0x7fd8ac034880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 --2- 172.21.15.118:0/2707341967 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd8ac0323d0 0x7fd8ac034880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd8b80030c0 tx=0x7fd8b8016000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00690a0 msgr2=0x7fd8c0135780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 --2- 172.21.15.118:0/2707341967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00690a0 0x7fd8c0135780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c6c0 tx=0x7fd8b4007e00 comp rx=0 tx=0).stop 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 shutdown_connections 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 --2- 172.21.15.118:0/2707341967 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd8ac0323d0 0x7fd8ac034880 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 --2- 172.21.15.118:0/2707341967 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd8c00690a0 0x7fd8c0135780 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 >> 172.21.15.118:0/2707341967 conn(0x7fd8c0095bf0 msgr2=0x7fd8c006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 shutdown_connections 2023-10-05T19:50:05.921 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.913+0000 7fd8c56f0700 1 -- 172.21.15.118:0/2707341967 wait complete. 2023-10-05T19:50:05.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.1 2023-10-05T19:50:05.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.0 2023-10-05T19:50:05.940 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.933+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f17b4095580 con 0x7f17b4090470 2023-10-05T19:50:05.941 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.933+0000 7f17ab7fe700 1 -- 172.21.15.118:0/934701651 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17b4095580 con 0x7f17b4090470 2023-10-05T19:50:05.941 INFO:teuthology.orchestra.run.smithi118.stdout:38654705665 2023-10-05T19:50:05.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f17980323e0 msgr2=0x7f1798034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 --2- 172.21.15.118:0/934701651 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f17980323e0 0x7f1798034890 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f17a40016c0 tx=0x7f17a4007b50 comp rx=0 tx=0).stop 2023-10-05T19:50:05.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 msgr2=0x7f17b408b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:05.944 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 --2- 172.21.15.118:0/934701651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 0x7f17b408b820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f179c009fb0 tx=0x7f179c016000 comp rx=0 tx=0).stop 2023-10-05T19:50:05.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 shutdown_connections 2023-10-05T19:50:05.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 --2- 172.21.15.118:0/934701651 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f17980323e0 0x7f1798034890 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 --2- 172.21.15.118:0/934701651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17b4090470 0x7f17b408b820 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:05.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 >> 172.21.15.118:0/934701651 conn(0x7f17b4094aa0 msgr2=0x7f17b4097430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:05.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 shutdown_connections 2023-10-05T19:50:05.945 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:05.937+0000 7f17b9ad8700 1 -- 172.21.15.118:0/934701651 wait complete. 2023-10-05T19:50:05.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.2 2023-10-05T19:50:06.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-05T19:50:06.932 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-05T19:50:06.933 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-05T19:50:06.957 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-05T19:50:07.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d6b93700 1 Processor -- start 2023-10-05T19:50:07.001 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d6b93700 1 -- start start 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d6b93700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02d006a770 0x7f02d006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d6b93700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d006ec40 con 0x7f02d006b080 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d6b93700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d006b990 con 0x7f02d006a770 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d5b91700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02d006a770 0x7f02d006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d5390700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f02d006b080 0x7f02d012d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39426/0 (socket says 172.21.15.118:39426) 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d5390700 1 -- 172.21.15.118:0/3370290596 learned_addr learned my addr 172.21.15.118:0/3370290596 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d5b91700 1 -- 172.21.15.118:0/3370290596 >> v1:172.21.15.118:6789/0 conn(0x7f02d006b080 legacy=0x7f02d012d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d4b8f700 1 -- 172.21.15.118:0/3370290596 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628896203 0 0) 0x7f02d006ec40 con 0x7f02d006b080 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d5b91700 1 -- 172.21.15.118:0/3370290596 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d0067df0 con 0x7f02d006a770 2023-10-05T19:50:07.003 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d5b91700 1 --2- 172.21.15.118:0/3370290596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 0x7f02d006ab40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009860 tx=0x7f02c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77da5f95644769f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d4b8f700 1 -- 172.21.15.118:0/3370290596 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02c000b680 con 0x7f02d006a770 2023-10-05T19:50:07.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d4b8f700 1 -- 172.21.15.118:0/3370290596 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c000b7e0 con 0x7f02d006a770 2023-10-05T19:50:07.004 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.993+0000 7f02d4b8f700 1 -- 172.21.15.118:0/3370290596 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02c000b990 con 0x7f02d006a770 2023-10-05T19:50:07.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 -- 172.21.15.118:0/3370290596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 msgr2=0x7f02d006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 --2- 172.21.15.118:0/3370290596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 0x7f02d006ab40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009860 tx=0x7f02c00091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 -- 172.21.15.118:0/3370290596 shutdown_connections 2023-10-05T19:50:07.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 --2- 172.21.15.118:0/3370290596 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 0x7f02d006ab40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 -- 172.21.15.118:0/3370290596 >> 172.21.15.118:0/3370290596 conn(0x7f02d0098630 msgr2=0x7f02d0098a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:07.005 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 -- 172.21.15.118:0/3370290596 shutdown_connections 2023-10-05T19:50:07.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 -- 172.21.15.118:0/3370290596 wait complete. 2023-10-05T19:50:07.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 Processor -- start 2023-10-05T19:50:07.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 -- start start 2023-10-05T19:50:07.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 0x7f02d012a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d01389d0 con 0x7f02d006a770 2023-10-05T19:50:07.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d5b91700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 0x7f02d012a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d5b91700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 0x7f02d012a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57612/0 (socket says 172.21.15.118:57612) 2023-10-05T19:50:07.006 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d5b91700 1 -- 172.21.15.118:0/2893499563 learned_addr learned my addr 172.21.15.118:0/2893499563 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:07.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d5b91700 1 -- 172.21.15.118:0/2893499563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c0009420 con 0x7f02d006a770 2023-10-05T19:50:07.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d5b91700 1 --2- 172.21.15.118:0/2893499563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 0x7f02d012a5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f02c00093f0 tx=0x7f02c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02c5ffb700 1 -- 172.21.15.118:0/2893499563 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02c001c450 con 0x7f02d006a770 2023-10-05T19:50:07.007 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02c5ffb700 1 -- 172.21.15.118:0/2893499563 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c001c5d0 con 0x7f02d006a770 2023-10-05T19:50:07.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d011fae0 con 0x7f02d006a770 2023-10-05T19:50:07.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02c5ffb700 1 -- 172.21.15.118:0/2893499563 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02c001c780 con 0x7f02d006a770 2023-10-05T19:50:07.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:06.997+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d011fe90 con 0x7f02d006a770 2023-10-05T19:50:07.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.001+0000 7f02c5ffb700 1 -- 172.21.15.118:0/2893499563 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f02c001c8e0 con 0x7f02d006a770 2023-10-05T19:50:07.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.001+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d005ecb0 con 0x7f02d006a770 2023-10-05T19:50:07.008 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.001+0000 7f02c5ffb700 1 --2- 172.21.15.118:0/2893499563 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f02b4032430 0x7f02b40348e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.001+0000 7f02c5ffb700 1 -- 172.21.15.118:0/2893499563 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f02c0045520 con 0x7f02d006a770 2023-10-05T19:50:07.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.001+0000 7f02d5390700 1 --2- 172.21.15.118:0/2893499563 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f02b4032430 0x7f02b40348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.009 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.001+0000 7f02d5390700 1 --2- 172.21.15.118:0/2893499563 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f02b4032430 0x7f02b40348e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0011e0 tx=0x7f02cc0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.014 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.005+0000 7f02c5ffb700 1 -- 172.21.15.118:0/2893499563 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f02c0018350 con 0x7f02d006a770 2023-10-05T19:50:07.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.041+0000 7f7102504700 1 Processor -- start 2023-10-05T19:50:07.051 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.041+0000 7f7102504700 1 -- start start 2023-10-05T19:50:07.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f7102504700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70fc090b80 0x7f70fc12b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f7102504700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0916f0 con 0x7f70fc093ef0 2023-10-05T19:50:07.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f7102504700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc066b70 con 0x7f70fc090b80 2023-10-05T19:50:07.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f70fbfff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f70fc093ef0 0x7f70fc090470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39430/0 (socket says 172.21.15.118:39430) 2023-10-05T19:50:07.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f70fbfff700 1 -- 172.21.15.118:0/188576551 learned_addr learned my addr 172.21.15.118:0/188576551 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:07.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f70f3fff700 1 --2- 172.21.15.118:0/188576551 >> v2:172.21.15.118:3300/0 conn(0x7f70fc090b80 0x7f70fc12b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.053 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10d6dbd700 1 Processor -- start 2023-10-05T19:50:07.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10d6dbd700 1 -- start start 2023-10-05T19:50:07.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f70f3fff700 1 -- 172.21.15.118:0/188576551 >> v1:172.21.15.118:6789/0 conn(0x7f70fc093ef0 legacy=0x7f70fc090470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f70f3fff700 1 -- 172.21.15.118:0/188576551 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc093930 con 0x7f70fc090b80 2023-10-05T19:50:07.054 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f70f3fff700 1 --2- 172.21.15.118:0/188576551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 0x7f70fc12b1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f70e400bb10 tx=0x7f70e400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e2302034029e45 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10d6dbd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f10d0090b80 0x7f10d012b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10d6dbd700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d00916f0 con 0x7f10d0093ef0 2023-10-05T19:50:07.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10d4b59700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f10d0093ef0 0x7f10d0090470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39446/0 (socket says 172.21.15.118:39446) 2023-10-05T19:50:07.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10d6dbd700 1 -- 172.21.15.118:0/4155754163 --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d0066b70 con 0x7f10d0090b80 2023-10-05T19:50:07.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10d4b59700 1 -- 172.21.15.118:0/4155754163 learned_addr learned my addr 172.21.15.118:0/4155754163 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:07.055 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10cffff700 1 --2- 172.21.15.118:0/4155754163 >> v2:172.21.15.118:3300/0 conn(0x7f10d0090b80 0x7f10d012b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f70fb7fe700 1 -- 172.21.15.118:0/188576551 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70e400db20 con 0x7f70fc090b80 2023-10-05T19:50:07.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f70fb7fe700 1 -- 172.21.15.118:0/188576551 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e400dc80 con 0x7f70fc090b80 2023-10-05T19:50:07.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f70fb7fe700 1 -- 172.21.15.118:0/188576551 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70e4010470 con 0x7f70fc090b80 2023-10-05T19:50:07.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 -- 172.21.15.118:0/188576551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 msgr2=0x7f70fc12b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 --2- 172.21.15.118:0/188576551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 0x7f70fc12b1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f70e400bb10 tx=0x7f70e400b430 comp rx=0 tx=0).stop 2023-10-05T19:50:07.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10cffff700 1 -- 172.21.15.118:0/4155754163 >> v1:172.21.15.118:6789/0 conn(0x7f10d0093ef0 legacy=0x7f10d0090470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.056 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10cffff700 1 -- 172.21.15.118:0/4155754163 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d0093930 con 0x7f10d0090b80 2023-10-05T19:50:07.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.045+0000 7f10cffff700 1 --2- 172.21.15.118:0/4155754163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 0x7f10d012b1b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009de0 tx=0x7f10c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef39e2f945e51025 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10cf7fe700 1 -- 172.21.15.118:0/4155754163 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10c800e070 con 0x7f10d0090b80 2023-10-05T19:50:07.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10cf7fe700 1 -- 172.21.15.118:0/4155754163 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c800bcd0 con 0x7f10d0090b80 2023-10-05T19:50:07.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10cf7fe700 1 -- 172.21.15.118:0/4155754163 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10c8012430 con 0x7f10d0090b80 2023-10-05T19:50:07.057 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 -- 172.21.15.118:0/188576551 shutdown_connections 2023-10-05T19:50:07.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 --2- 172.21.15.118:0/188576551 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 0x7f70fc12b1b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 -- 172.21.15.118:0/188576551 >> 172.21.15.118:0/188576551 conn(0x7f70fc094aa0 msgr2=0x7f70fc094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:07.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 -- 172.21.15.118:0/188576551 shutdown_connections 2023-10-05T19:50:07.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 -- 172.21.15.118:0/188576551 wait complete. 2023-10-05T19:50:07.058 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 -- 172.21.15.118:0/4155754163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 msgr2=0x7f10d012b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 --2- 172.21.15.118:0/4155754163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 0x7f10d012b1b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009de0 tx=0x7f10c8009780 comp rx=0 tx=0).stop 2023-10-05T19:50:07.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 -- 172.21.15.118:0/4155754163 shutdown_connections 2023-10-05T19:50:07.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 --2- 172.21.15.118:0/4155754163 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 0x7f10d012b1b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 -- 172.21.15.118:0/4155754163 >> 172.21.15.118:0/4155754163 conn(0x7f10d0094aa0 msgr2=0x7f10d0094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:07.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 -- 172.21.15.118:0/4155754163 shutdown_connections 2023-10-05T19:50:07.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 -- 172.21.15.118:0/4155754163 wait complete. 2023-10-05T19:50:07.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 Processor -- start 2023-10-05T19:50:07.059 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 -- start start 2023-10-05T19:50:07.060 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 Processor -- start 2023-10-05T19:50:07.060 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 0x7f70fc137fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.060 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc137c60 con 0x7f70fc090b80 2023-10-05T19:50:07.060 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 -- start start 2023-10-05T19:50:07.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f70fbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 0x7f70fc137fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f70fbfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 0x7f70fc137fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57642/0 (socket says 172.21.15.118:57642) 2023-10-05T19:50:07.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f70fbfff700 1 -- 172.21.15.118:0/2192000756 learned_addr learned my addr 172.21.15.118:0/2192000756 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:07.061 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f70fbfff700 1 -- 172.21.15.118:0/2192000756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e400b6d0 con 0x7f70fc090b80 2023-10-05T19:50:07.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 0x7f10d008e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d6dbd700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d006dc90 con 0x7f10d0090b80 2023-10-05T19:50:07.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d4b59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 0x7f10d008e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d4b59700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 0x7f10d008e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57652/0 (socket says 172.21.15.118:57652) 2023-10-05T19:50:07.062 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d4b59700 1 -- 172.21.15.118:0/2688913797 learned_addr learned my addr 172.21.15.118:0/2688913797 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:07.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f70fbfff700 1 --2- 172.21.15.118:0/2192000756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 0x7f70fc137fe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c6c0 tx=0x7f70ec007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f70f8ff9700 1 -- 172.21.15.118:0/2192000756 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ec005c70 con 0x7f70fc090b80 2023-10-05T19:50:07.063 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f10d4b59700 1 -- 172.21.15.118:0/2688913797 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8009a20 con 0x7f10d0090b80 2023-10-05T19:50:07.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f70f8ff9700 1 -- 172.21.15.118:0/2192000756 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec005dd0 con 0x7f70fc090b80 2023-10-05T19:50:07.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc1201d0 con 0x7f70fc090b80 2023-10-05T19:50:07.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f70f8ff9700 1 -- 172.21.15.118:0/2192000756 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70ec007210 con 0x7f70fc090b80 2023-10-05T19:50:07.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.049+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc08eca0 con 0x7f70fc090b80 2023-10-05T19:50:07.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f70f8ff9700 1 -- 172.21.15.118:0/2192000756 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f70ec007370 con 0x7f70fc090b80 2023-10-05T19:50:07.064 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f70f8ff9700 1 --2- 172.21.15.118:0/2192000756 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70dc0323e0 0x7f70dc034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f70f8ff9700 1 -- 172.21.15.118:0/2192000756 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f70ec042ee0 con 0x7f70fc090b80 2023-10-05T19:50:07.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10d4b59700 1 --2- 172.21.15.118:0/2688913797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 0x7f10d008e8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c690 tx=0x7f10c400ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10ccff9700 1 -- 172.21.15.118:0/2688913797 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10c4007360 con 0x7f10d0090b80 2023-10-05T19:50:07.065 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10ccff9700 1 -- 172.21.15.118:0/2688913797 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40074c0 con 0x7f10d0090b80 2023-10-05T19:50:07.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d008c230 con 0x7f10d0090b80 2023-10-05T19:50:07.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10ccff9700 1 -- 172.21.15.118:0/2688913797 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10c4004830 con 0x7f10d0090b80 2023-10-05T19:50:07.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d008df50 con 0x7f10d0090b80 2023-10-05T19:50:07.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f70f3fff700 1 --2- 172.21.15.118:0/2192000756 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70dc0323e0 0x7f70dc034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.066 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f70f3fff700 1 --2- 172.21.15.118:0/2192000756 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70dc0323e0 0x7f70dc034890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f70e400b470 tx=0x7f70e401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.067 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10ccff9700 1 -- 172.21.15.118:0/2688913797 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f10c4004af0 con 0x7f10d0090b80 2023-10-05T19:50:07.067 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d005ecb0 con 0x7f10d0090b80 2023-10-05T19:50:07.067 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10ccff9700 1 --2- 172.21.15.118:0/2688913797 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f10bc032390 0x7f10bc034840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.067 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10ccff9700 1 -- 172.21.15.118:0/2688913797 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f10c4043790 con 0x7f10d0090b80 2023-10-05T19:50:07.067 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10cffff700 1 --2- 172.21.15.118:0/2688913797 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f10bc032390 0x7f10bc034840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f7dbc959700 1 Processor -- start 2023-10-05T19:50:07.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f7dbc959700 1 -- start start 2023-10-05T19:50:07.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.053+0000 7f10cffff700 1 --2- 172.21.15.118:0/2688913797 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f10bc032390 0x7f10bc034840 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009de0 tx=0x7f10c8018000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.068 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc11edd0 con 0x7f70fc090b80 2023-10-05T19:50:07.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7dbc959700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7db8094090 0x7f7db812dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7dbc959700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db8091140 con 0x7f7db808e410 2023-10-05T19:50:07.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7dbc959700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db80908a0 con 0x7f7db8094090 2023-10-05T19:50:07.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7db5d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7db8094090 0x7f7db812dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.069 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7db659c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f7db808e410 0x7f7db808e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39458/0 (socket says 172.21.15.118:39458) 2023-10-05T19:50:07.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7db659c700 1 -- 172.21.15.118:0/2445593675 learned_addr learned my addr 172.21.15.118:0/2445593675 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:07.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7db5d9b700 1 -- 172.21.15.118:0/2445593675 >> v1:172.21.15.118:6789/0 conn(0x7f7db808e410 legacy=0x7f7db808e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7db5d9b700 1 -- 172.21.15.118:0/2445593675 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db80916f0 con 0x7f7db8094090 2023-10-05T19:50:07.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f7db5d9b700 1 --2- 172.21.15.118:0/2445593675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db8094090 0x7f7db812dfd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009860 tx=0x7f7dac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847ba53c114dcac8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.070 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.057+0000 7f10ccff9700 1 -- 172.21.15.118:0/2688913797 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f10c40106d0 con 0x7f10d0090b80 2023-10-05T19:50:07.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.061+0000 7f7db559a700 1 -- 172.21.15.118:0/2445593675 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dac00b680 con 0x7f7db8094090 2023-10-05T19:50:07.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.061+0000 7f7db559a700 1 -- 172.21.15.118:0/2445593675 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac00b7e0 con 0x7f7db8094090 2023-10-05T19:50:07.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.061+0000 7f7db559a700 1 -- 172.21.15.118:0/2445593675 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7dac00bad0 con 0x7f7db8094090 2023-10-05T19:50:07.071 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.061+0000 7f70f8ff9700 1 -- 172.21.15.118:0/2192000756 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f70ec017070 con 0x7f70fc090b80 2023-10-05T19:50:07.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 -- 172.21.15.118:0/2445593675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db8094090 msgr2=0x7f7db812dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 --2- 172.21.15.118:0/2445593675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db8094090 0x7f7db812dfd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009860 tx=0x7f7dac0091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 -- 172.21.15.118:0/2445593675 shutdown_connections 2023-10-05T19:50:07.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 --2- 172.21.15.118:0/2445593675 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db8094090 0x7f7db812dfd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 -- 172.21.15.118:0/2445593675 >> 172.21.15.118:0/2445593675 conn(0x7f7db8094aa0 msgr2=0x7f7db8094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:07.072 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 -- 172.21.15.118:0/2445593675 shutdown_connections 2023-10-05T19:50:07.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 -- 172.21.15.118:0/2445593675 wait complete. 2023-10-05T19:50:07.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 Processor -- start 2023-10-05T19:50:07.073 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 -- start start 2023-10-05T19:50:07.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db808e410 0x7f7db811cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db8120260 con 0x7f7db808e410 2023-10-05T19:50:07.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7db659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db808e410 0x7f7db811cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7db659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db808e410 0x7f7db811cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57666/0 (socket says 172.21.15.118:57666) 2023-10-05T19:50:07.074 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7db659c700 1 -- 172.21.15.118:0/526777174 learned_addr learned my addr 172.21.15.118:0/526777174 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:07.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7db659c700 1 -- 172.21.15.118:0/526777174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac009420 con 0x7f7db808e410 2023-10-05T19:50:07.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7db659c700 1 --2- 172.21.15.118:0/526777174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db808e410 0x7f7db811cee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7da800c6c0 tx=0x7f7da8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7da67fc700 1 -- 172.21.15.118:0/526777174 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7da8005c70 con 0x7f7db808e410 2023-10-05T19:50:07.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7da67fc700 1 -- 172.21.15.118:0/526777174 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da8005dd0 con 0x7f7db808e410 2023-10-05T19:50:07.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7da67fc700 1 -- 172.21.15.118:0/526777174 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7da8004970 con 0x7f7db808e410 2023-10-05T19:50:07.075 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db811ffa0 con 0x7f7db808e410 2023-10-05T19:50:07.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.065+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db811f620 con 0x7f7db808e410 2023-10-05T19:50:07.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.069+0000 7f7da67fc700 1 -- 172.21.15.118:0/526777174 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7da8004ad0 con 0x7f7db808e410 2023-10-05T19:50:07.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.069+0000 7f7da67fc700 1 --2- 172.21.15.118:0/526777174 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7d980323e0 0x7f7d98034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:07.076 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.069+0000 7f7da67fc700 1 -- 172.21.15.118:0/526777174 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f7da8042ec0 con 0x7f7db808e410 2023-10-05T19:50:07.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.069+0000 7f7db5d9b700 1 --2- 172.21.15.118:0/526777174 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7d980323e0 0x7f7d98034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:07.077 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.069+0000 7f7db5d9b700 1 --2- 172.21.15.118:0/526777174 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7d980323e0 0x7f7d98034890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0091e0 tx=0x7f7dac016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:07.083 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.077+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db811eda0 con 0x7f7db808e410 2023-10-05T19:50:07.090 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.081+0000 7f7da67fc700 1 -- 172.21.15.118:0/526777174 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f7da80108f0 con 0x7f7db808e410 2023-10-05T19:50:07.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f02d006dcd0 con 0x7f02d006a770 2023-10-05T19:50:07.200 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02c5ffb700 1 -- 172.21.15.118:0/2893499563 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f02c002db40 con 0x7f02d006a770 2023-10-05T19:50:07.200 INFO:teuthology.orchestra.run.smithi118.stdout:38654705665 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f02b4032430 msgr2=0x7f02b40348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 --2- 172.21.15.118:0/2893499563 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f02b4032430 0x7f02b40348e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0011e0 tx=0x7f02cc0079d0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 msgr2=0x7f02d012a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 --2- 172.21.15.118:0/2893499563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 0x7f02d012a5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f02c00093f0 tx=0x7f02c0016000 comp rx=0 tx=0).stop 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 shutdown_connections 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 --2- 172.21.15.118:0/2893499563 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f02b4032430 0x7f02b40348e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 --2- 172.21.15.118:0/2893499563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02d006a770 0x7f02d012a5b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 >> 172.21.15.118:0/2893499563 conn(0x7f02d0098630 msgr2=0x7f02d0115480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 shutdown_connections 2023-10-05T19:50:07.203 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.193+0000 7f02d6b93700 1 -- 172.21.15.118:0/2893499563 wait complete. 2023-10-05T19:50:07.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.3 2023-10-05T19:50:07.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.245+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7db811fd90 con 0x7f7db808e410 2023-10-05T19:50:07.254 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.245+0000 7f7da67fc700 1 -- 172.21.15.118:0/526777174 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7da8010300 con 0x7f7db808e410 2023-10-05T19:50:07.254 INFO:teuthology.orchestra.run.smithi118.stdout:38654705665 2023-10-05T19:50:07.256 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7d980323e0 msgr2=0x7f7d98034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 --2- 172.21.15.118:0/526777174 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7d980323e0 0x7f7d98034890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0091e0 tx=0x7f7dac016000 comp rx=0 tx=0).stop 2023-10-05T19:50:07.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db808e410 msgr2=0x7f7db811cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 --2- 172.21.15.118:0/526777174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db808e410 0x7f7db811cee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7da800c6c0 tx=0x7f7da8007f70 comp rx=0 tx=0).stop 2023-10-05T19:50:07.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 shutdown_connections 2023-10-05T19:50:07.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 --2- 172.21.15.118:0/526777174 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7d980323e0 0x7f7d98034890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 --2- 172.21.15.118:0/526777174 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7db808e410 0x7f7db811cee0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 >> 172.21.15.118:0/526777174 conn(0x7f7db8094aa0 msgr2=0x7f7db806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:07.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 shutdown_connections 2023-10-05T19:50:07.257 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7dbc959700 1 -- 172.21.15.118:0/526777174 wait complete. 2023-10-05T19:50:07.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f70fc05ecb0 con 0x7f70fc090b80 2023-10-05T19:50:07.258 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.249+0000 7f70f8ff9700 1 -- 172.21.15.118:0/2192000756 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70ec0108b0 con 0x7f70fc090b80 2023-10-05T19:50:07.258 INFO:teuthology.orchestra.run.smithi118.stdout:38654705665 2023-10-05T19:50:07.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70dc0323e0 msgr2=0x7f70dc034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 --2- 172.21.15.118:0/2192000756 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70dc0323e0 0x7f70dc034890 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f70e400b470 tx=0x7f70e401a000 comp rx=0 tx=0).stop 2023-10-05T19:50:07.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 msgr2=0x7f70fc137fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 --2- 172.21.15.118:0/2192000756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 0x7f70fc137fe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c6c0 tx=0x7f70ec007f30 comp rx=0 tx=0).stop 2023-10-05T19:50:07.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 shutdown_connections 2023-10-05T19:50:07.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 --2- 172.21.15.118:0/2192000756 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70dc0323e0 0x7f70dc034890 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 --2- 172.21.15.118:0/2192000756 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70fc090b80 0x7f70fc137fe0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.261 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 >> 172.21.15.118:0/2192000756 conn(0x7f70fc094aa0 msgr2=0x7f70fc06d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:07.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 shutdown_connections 2023-10-05T19:50:07.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f7102504700 1 -- 172.21.15.118:0/2192000756 wait complete. 2023-10-05T19:50:07.262 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10d004b5c0 con 0x7f10d0090b80 2023-10-05T19:50:07.263 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.253+0000 7f10ccff9700 1 -- 172.21.15.118:0/2688913797 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10c401c390 con 0x7f10d0090b80 2023-10-05T19:50:07.263 INFO:teuthology.orchestra.run.smithi118.stdout:38654705665 2023-10-05T19:50:07.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f10bc032390 msgr2=0x7f10bc034840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 --2- 172.21.15.118:0/2688913797 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f10bc032390 0x7f10bc034840 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009de0 tx=0x7f10c8018000 comp rx=0 tx=0).stop 2023-10-05T19:50:07.266 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 msgr2=0x7f10d008e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:07.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 --2- 172.21.15.118:0/2688913797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 0x7f10d008e8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c690 tx=0x7f10c400ca50 comp rx=0 tx=0).stop 2023-10-05T19:50:07.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 shutdown_connections 2023-10-05T19:50:07.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 --2- 172.21.15.118:0/2688913797 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f10bc032390 0x7f10bc034840 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 --2- 172.21.15.118:0/2688913797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10d0090b80 0x7f10d008e8c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:07.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 >> 172.21.15.118:0/2688913797 conn(0x7f10d0094aa0 msgr2=0x7f10d00967b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:07.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 shutdown_connections 2023-10-05T19:50:07.267 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:07.257+0000 7f10d6dbd700 1 -- 172.21.15.118:0/2688913797 wait complete. 2023-10-05T19:50:07.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.1 2023-10-05T19:50:07.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.0 2023-10-05T19:50:07.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705665 for osd.2 2023-10-05T19:50:08.214 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-05T19:50:08.270 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-05T19:50:08.273 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-05T19:50:08.278 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-05T19:50:08.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 Processor -- start 2023-10-05T19:50:08.328 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 -- start start 2023-10-05T19:50:08.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22d8128f00 0x7f22d812b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d806bb70 con 0x7f22d806bfc0 2023-10-05T19:50:08.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d80950f0 con 0x7f22d8128f00 2023-10-05T19:50:08.329 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22ddae6700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f22d8128f00 0x7f22d812b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22de2e7700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f22d806bfc0 0x7f22d806c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39460/0 (socket says 172.21.15.118:39460) 2023-10-05T19:50:08.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22de2e7700 1 -- 172.21.15.118:0/3520411602 learned_addr learned my addr 172.21.15.118:0/3520411602 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:08.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22dd2e5700 1 -- 172.21.15.118:0/3520411602 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823181234 0 0) 0x7f22d806bb70 con 0x7f22d806bfc0 2023-10-05T19:50:08.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22dd2e5700 1 -- 172.21.15.118:0/3520411602 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c4003570 con 0x7f22d806bfc0 2023-10-05T19:50:08.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22ddae6700 1 -- 172.21.15.118:0/3520411602 >> v1:172.21.15.118:6789/0 conn(0x7f22d806bfc0 legacy=0x7f22d806c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.330 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22ddae6700 1 -- 172.21.15.118:0/3520411602 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d806f3f0 con 0x7f22d8128f00 2023-10-05T19:50:08.331 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22ddae6700 1 --2- 172.21.15.118:0/3520411602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d8128f00 0x7f22d812b2e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009890 tx=0x7f22d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e3f26b00f22652 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22dd2e5700 1 -- 172.21.15.118:0/3520411602 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d4011630 con 0x7f22d8128f00 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22dd2e5700 1 -- 172.21.15.118:0/3520411602 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4011790 con 0x7f22d8128f00 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22dd2e5700 1 -- 172.21.15.118:0/3520411602 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d4011a60 con 0x7f22d8128f00 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 -- 172.21.15.118:0/3520411602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d8128f00 msgr2=0x7f22d812b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 --2- 172.21.15.118:0/3520411602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d8128f00 0x7f22d812b2e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009890 tx=0x7f22d40091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 -- 172.21.15.118:0/3520411602 shutdown_connections 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 --2- 172.21.15.118:0/3520411602 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d8128f00 0x7f22d812b2e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 -- 172.21.15.118:0/3520411602 >> 172.21.15.118:0/3520411602 conn(0x7f22d8095430 msgr2=0x7f22d8095830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 -- 172.21.15.118:0/3520411602 shutdown_connections 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.321+0000 7f22e054b700 1 -- 172.21.15.118:0/3520411602 wait complete. 2023-10-05T19:50:08.332 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22e054b700 1 Processor -- start 2023-10-05T19:50:08.333 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22e054b700 1 -- start start 2023-10-05T19:50:08.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22e054b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d806bfc0 0x7f22d808e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22e054b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d8127580 con 0x7f22d806bfc0 2023-10-05T19:50:08.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22de2e7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d806bfc0 0x7f22d808e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22de2e7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d806bfc0 0x7f22d808e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57678/0 (socket says 172.21.15.118:57678) 2023-10-05T19:50:08.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22de2e7700 1 -- 172.21.15.118:0/3171155902 learned_addr learned my addr 172.21.15.118:0/3171155902 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:08.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22de2e7700 1 -- 172.21.15.118:0/3171155902 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4009420 con 0x7f22d806bfc0 2023-10-05T19:50:08.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22de2e7700 1 --2- 172.21.15.118:0/3171155902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d806bfc0 0x7f22d808e1e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c490 tx=0x7f22c8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22ce7fc700 1 -- 172.21.15.118:0/3171155902 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22c8005b30 con 0x7f22d806bfc0 2023-10-05T19:50:08.334 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22ce7fc700 1 -- 172.21.15.118:0/3171155902 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8005c90 con 0x7f22d806bfc0 2023-10-05T19:50:08.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d8127e00 con 0x7f22d806bfc0 2023-10-05T19:50:08.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22ce7fc700 1 -- 172.21.15.118:0/3171155902 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22c80070d0 con 0x7f22d806bfc0 2023-10-05T19:50:08.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d8128130 con 0x7f22d806bfc0 2023-10-05T19:50:08.335 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22ce7fc700 1 -- 172.21.15.118:0/3171155902 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f22c8007300 con 0x7f22d806bfc0 2023-10-05T19:50:08.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d805ecb0 con 0x7f22d806bfc0 2023-10-05T19:50:08.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22ce7fc700 1 --2- 172.21.15.118:0/3171155902 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f22c40326e0 0x7f22c4034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.325+0000 7f22ce7fc700 1 -- 172.21.15.118:0/3171155902 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f22c8043070 con 0x7f22d806bfc0 2023-10-05T19:50:08.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.329+0000 7f22ddae6700 1 --2- 172.21.15.118:0/3171155902 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f22c40326e0 0x7f22c4034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.329+0000 7f22ddae6700 1 --2- 172.21.15.118:0/3171155902 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f22c40326e0 0x7f22c4034b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22d4006eb0 tx=0x7f22d4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.333+0000 7f22ce7fc700 1 -- 172.21.15.118:0/3171155902 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f22c8072bb0 con 0x7f22d806bfc0 2023-10-05T19:50:08.393 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb72534700 1 Processor -- start 2023-10-05T19:50:08.394 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb72534700 1 -- start start 2023-10-05T19:50:08.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb72534700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffb6c0697b0 0x7ffb6c069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb72534700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6c092ce0 con 0x7ffb6c08fae0 2023-10-05T19:50:08.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb72534700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6c090f50 con 0x7ffb6c0697b0 2023-10-05T19:50:08.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb6b7fe700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffb6c0697b0 0x7ffb6c069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb6bfff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ffb6c08fae0 0x7ffb6c0690a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39474/0 (socket says 172.21.15.118:39474) 2023-10-05T19:50:08.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb6bfff700 1 -- 172.21.15.118:0/263291078 learned_addr learned my addr 172.21.15.118:0/263291078 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:08.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb6b7fe700 1 -- 172.21.15.118:0/263291078 >> v1:172.21.15.118:6789/0 conn(0x7ffb6c08fae0 legacy=0x7ffb6c0690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb6b7fe700 1 -- 172.21.15.118:0/263291078 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c090870 con 0x7ffb6c0697b0 2023-10-05T19:50:08.395 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.385+0000 7ffb6b7fe700 1 --2- 172.21.15.118:0/263291078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 0x7ffb6c069bc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009860 tx=0x7ffb600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17a897701c664a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.396 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb6affd700 1 -- 172.21.15.118:0/263291078 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb6000b680 con 0x7ffb6c0697b0 2023-10-05T19:50:08.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb6affd700 1 -- 172.21.15.118:0/263291078 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6000b7e0 con 0x7ffb6c0697b0 2023-10-05T19:50:08.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb6affd700 1 -- 172.21.15.118:0/263291078 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb6000b990 con 0x7ffb6c0697b0 2023-10-05T19:50:08.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 -- 172.21.15.118:0/263291078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 msgr2=0x7ffb6c069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 --2- 172.21.15.118:0/263291078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 0x7ffb6c069bc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009860 tx=0x7ffb600091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 -- 172.21.15.118:0/263291078 shutdown_connections 2023-10-05T19:50:08.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 --2- 172.21.15.118:0/263291078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 0x7ffb6c069bc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 -- 172.21.15.118:0/263291078 >> 172.21.15.118:0/263291078 conn(0x7ffb6c095ae0 msgr2=0x7ffb6c095ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 -- 172.21.15.118:0/263291078 shutdown_connections 2023-10-05T19:50:08.397 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 -- 172.21.15.118:0/263291078 wait complete. 2023-10-05T19:50:08.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 Processor -- start 2023-10-05T19:50:08.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 -- start start 2023-10-05T19:50:08.398 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 0x7ffb6c12ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb72534700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c08ec00 con 0x7ffb6c0697b0 2023-10-05T19:50:08.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb6bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 0x7ffb6c12ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb6bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 0x7ffb6c12ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57690/0 (socket says 172.21.15.118:57690) 2023-10-05T19:50:08.399 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb6bfff700 1 -- 172.21.15.118:0/2769471565 learned_addr learned my addr 172.21.15.118:0/2769471565 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:08.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.389+0000 7ffb6bfff700 1 -- 172.21.15.118:0/2769471565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60009420 con 0x7ffb6c0697b0 2023-10-05T19:50:08.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb6bfff700 1 --2- 172.21.15.118:0/2769471565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 0x7ffb6c12ab70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00c6c0 tx=0x7ffb5c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb53fff700 1 -- 172.21.15.118:0/2769471565 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c005b30 con 0x7ffb6c0697b0 2023-10-05T19:50:08.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6c1208d0 con 0x7ffb6c0697b0 2023-10-05T19:50:08.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb53fff700 1 -- 172.21.15.118:0/2769471565 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c005c90 con 0x7ffb6c0697b0 2023-10-05T19:50:08.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb53fff700 1 -- 172.21.15.118:0/2769471565 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffb5c0070d0 con 0x7ffb6c0697b0 2023-10-05T19:50:08.400 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c08e2a0 con 0x7ffb6c0697b0 2023-10-05T19:50:08.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6c05ecb0 con 0x7ffb6c0697b0 2023-10-05T19:50:08.401 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb53fff700 1 -- 172.21.15.118:0/2769471565 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ffb5c007230 con 0x7ffb6c0697b0 2023-10-05T19:50:08.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb53fff700 1 --2- 172.21.15.118:0/2769471565 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffb58032390 0x7ffb58034840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.402 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb6b7fe700 1 --2- 172.21.15.118:0/2769471565 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffb58032390 0x7ffb58034840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.393+0000 7ffb6b7fe700 1 --2- 172.21.15.118:0/2769471565 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffb58032390 0x7ffb58034840 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffb600030c0 tx=0x7ffb60016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.403 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.397+0000 7ffb53fff700 1 -- 172.21.15.118:0/2769471565 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7ffb5c011360 con 0x7ffb6c0697b0 2023-10-05T19:50:08.410 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.401+0000 7ffb53fff700 1 -- 172.21.15.118:0/2769471565 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7ffb5c00e6a0 con 0x7ffb6c0697b0 2023-10-05T19:50:08.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5ac7182700 1 Processor -- start 2023-10-05T19:50:08.414 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5ac7182700 1 -- start start 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5ac7182700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ac012bfc0 0x7f5ac012e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5ac7182700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac0091130 con 0x7f5ac008e410 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5ac7182700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac008eef0 con 0x7f5ac012bfc0 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5ac4f1e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f5ac008e410 0x7f5ac008e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39482/0 (socket says 172.21.15.118:39482) 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5ac4f1e700 1 -- 172.21.15.118:0/1524908913 learned_addr learned my addr 172.21.15.118:0/1524908913 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5abffff700 1 --2- 172.21.15.118:0/1524908913 >> v2:172.21.15.118:3300/0 conn(0x7f5ac012bfc0 0x7f5ac012e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5abf7fe700 1 -- 172.21.15.118:0/1524908913 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100258522 0 0) 0x7f5ac0091130 con 0x7f5ac008e410 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.405+0000 7f5abf7fe700 1 -- 172.21.15.118:0/1524908913 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab0003570 con 0x7f5ac008e410 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5abffff700 1 -- 172.21.15.118:0/1524908913 >> v1:172.21.15.118:6789/0 conn(0x7f5ac008e410 legacy=0x7f5ac008e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5abffff700 1 -- 172.21.15.118:0/1524908913 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac00922b0 con 0x7f5ac012bfc0 2023-10-05T19:50:08.416 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5abffff700 1 --2- 172.21.15.118:0/1524908913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac012bfc0 0x7f5ac012e3a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5aac009860 tx=0x7f5aac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6b11edcb2058a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5abf7fe700 1 -- 172.21.15.118:0/1524908913 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5aac011630 con 0x7f5ac012bfc0 2023-10-05T19:50:08.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5abf7fe700 1 -- 172.21.15.118:0/1524908913 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac011790 con 0x7f5ac012bfc0 2023-10-05T19:50:08.417 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5abf7fe700 1 -- 172.21.15.118:0/1524908913 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5aac011920 con 0x7f5ac012bfc0 2023-10-05T19:50:08.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 -- 172.21.15.118:0/1524908913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac012bfc0 msgr2=0x7f5ac012e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 --2- 172.21.15.118:0/1524908913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac012bfc0 0x7f5ac012e3a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5aac009860 tx=0x7f5aac0091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 -- 172.21.15.118:0/1524908913 shutdown_connections 2023-10-05T19:50:08.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 --2- 172.21.15.118:0/1524908913 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac012bfc0 0x7f5ac012e3a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 -- 172.21.15.118:0/1524908913 >> 172.21.15.118:0/1524908913 conn(0x7f5ac0094aa0 msgr2=0x7f5ac0094e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 -- 172.21.15.118:0/1524908913 shutdown_connections 2023-10-05T19:50:08.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 -- 172.21.15.118:0/1524908913 wait complete. 2023-10-05T19:50:08.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 Processor -- start 2023-10-05T19:50:08.419 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 -- start start 2023-10-05T19:50:08.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac008e410 0x7f5ac011cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac7182700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac012b210 con 0x7f5ac008e410 2023-10-05T19:50:08.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac4f1e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac008e410 0x7f5ac011cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac4f1e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac008e410 0x7f5ac011cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57696/0 (socket says 172.21.15.118:57696) 2023-10-05T19:50:08.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac4f1e700 1 -- 172.21.15.118:0/3077344851 learned_addr learned my addr 172.21.15.118:0/3077344851 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:08.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac4f1e700 1 -- 172.21.15.118:0/3077344851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac009420 con 0x7f5ac008e410 2023-10-05T19:50:08.420 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.409+0000 7f5ac4f1e700 1 --2- 172.21.15.118:0/3077344851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac008e410 0x7f5ac011cee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c6c0 tx=0x7f5ab4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5abcff9700 1 -- 172.21.15.118:0/3077344851 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab4005b30 con 0x7f5ac008e410 2023-10-05T19:50:08.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5abcff9700 1 -- 172.21.15.118:0/3077344851 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4005c90 con 0x7f5ac008e410 2023-10-05T19:50:08.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac011e1b0 con 0x7f5ac008e410 2023-10-05T19:50:08.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5abcff9700 1 -- 172.21.15.118:0/3077344851 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab40070d0 con 0x7f5ac008e410 2023-10-05T19:50:08.421 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac011e9b0 con 0x7f5ac008e410 2023-10-05T19:50:08.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5abcff9700 1 -- 172.21.15.118:0/3077344851 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5ab4007230 con 0x7f5ac008e410 2023-10-05T19:50:08.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5abcff9700 1 --2- 172.21.15.118:0/3077344851 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5aa4032420 0x7f5aa40348d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5abcff9700 1 -- 172.21.15.118:0/3077344851 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f5ab4042ec0 con 0x7f5ac008e410 2023-10-05T19:50:08.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5abffff700 1 --2- 172.21.15.118:0/3077344851 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5aa4032420 0x7f5aa40348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.422 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.413+0000 7f5abffff700 1 --2- 172.21.15.118:0/3077344851 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5aa4032420 0x7f5aa40348d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5aac009860 tx=0x7f5aac016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.423 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.417+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa00050b0 con 0x7f5ac008e410 2023-10-05T19:50:08.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f9674b0d700 1 Processor -- start 2023-10-05T19:50:08.427 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f9674b0d700 1 -- start start 2023-10-05T19:50:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f9674b0d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f967008fd40 0x7f967012c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f9674b0d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9670090d60 con 0x7f967008f260 2023-10-05T19:50:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f9674b0d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96700904e0 con 0x7f967008fd40 2023-10-05T19:50:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f966effd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f967008fd40 0x7f967012c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f966f7fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f967008f260 0x7f967008f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39494/0 (socket says 172.21.15.118:39494) 2023-10-05T19:50:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f966f7fe700 1 -- 172.21.15.118:0/1954529939 learned_addr learned my addr 172.21.15.118:0/1954529939 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f966effd700 1 -- 172.21.15.118:0/1954529939 >> v1:172.21.15.118:6789/0 conn(0x7f967008f260 legacy=0x7f967008f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f966effd700 1 -- 172.21.15.118:0/1954529939 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670091180 con 0x7f967008fd40 2023-10-05T19:50:08.429 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.421+0000 7f966effd700 1 --2- 172.21.15.118:0/1954529939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008fd40 0x7f967012c050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9658009860 tx=0x7f96580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9b6139f3ac8ec6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.432 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f966e7fc700 1 -- 172.21.15.118:0/1954529939 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f965800b680 con 0x7f967008fd40 2023-10-05T19:50:08.432 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f966e7fc700 1 -- 172.21.15.118:0/1954529939 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965800b7e0 con 0x7f967008fd40 2023-10-05T19:50:08.432 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f966e7fc700 1 -- 172.21.15.118:0/1954529939 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f965800b990 con 0x7f967008fd40 2023-10-05T19:50:08.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f5abcff9700 1 -- 172.21.15.118:0/3077344851 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f5ab4017020 con 0x7f5ac008e410 2023-10-05T19:50:08.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 -- 172.21.15.118:0/1954529939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008fd40 msgr2=0x7f967012c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 --2- 172.21.15.118:0/1954529939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008fd40 0x7f967012c050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9658009860 tx=0x7f96580091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.433 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 -- 172.21.15.118:0/1954529939 shutdown_connections 2023-10-05T19:50:08.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 --2- 172.21.15.118:0/1954529939 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008fd40 0x7f967012c050 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 -- 172.21.15.118:0/1954529939 >> 172.21.15.118:0/1954529939 conn(0x7f9670094b00 msgr2=0x7f9670094f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 -- 172.21.15.118:0/1954529939 shutdown_connections 2023-10-05T19:50:08.434 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 -- 172.21.15.118:0/1954529939 wait complete. 2023-10-05T19:50:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 Processor -- start 2023-10-05T19:50:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 -- start start 2023-10-05T19:50:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008f260 0x7f96701358e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f9674b0d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9670133360 con 0x7f967008f260 2023-10-05T19:50:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f966f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008f260 0x7f96701358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.435 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f966f7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008f260 0x7f96701358e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57712/0 (socket says 172.21.15.118:57712) 2023-10-05T19:50:08.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.425+0000 7f966f7fe700 1 -- 172.21.15.118:0/2069860298 learned_addr learned my addr 172.21.15.118:0/2069860298 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:08.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f966f7fe700 1 -- 172.21.15.118:0/2069860298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9658009420 con 0x7f967008f260 2023-10-05T19:50:08.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f966f7fe700 1 --2- 172.21.15.118:0/2069860298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008f260 0x7f96701358e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f966000c6c0 tx=0x7f9660007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.436 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f96677fe700 1 -- 172.21.15.118:0/2069860298 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9660005b30 con 0x7f967008f260 2023-10-05T19:50:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f96677fe700 1 -- 172.21.15.118:0/2069860298 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9660005c90 con 0x7f967008f260 2023-10-05T19:50:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967011d310 con 0x7f967008f260 2023-10-05T19:50:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f96677fe700 1 -- 172.21.15.118:0/2069860298 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9660004830 con 0x7f967008f260 2023-10-05T19:50:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967011de50 con 0x7f967008f260 2023-10-05T19:50:08.437 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f96677fe700 1 -- 172.21.15.118:0/2069860298 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9660004990 con 0x7f967008f260 2023-10-05T19:50:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f96677fe700 1 --2- 172.21.15.118:0/2069860298 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96500323e0 0x7f9650034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f96677fe700 1 -- 172.21.15.118:0/2069860298 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f9660042d70 con 0x7f967008f260 2023-10-05T19:50:08.438 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f966effd700 1 --2- 172.21.15.118:0/2069860298 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96500323e0 0x7f9650034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.429+0000 7f966effd700 1 --2- 172.21.15.118:0/2069860298 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96500323e0 0x7f9650034890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f96580091e0 tx=0x7f9658016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.439 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.433+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967005ecb0 con 0x7f967008f260 2023-10-05T19:50:08.447 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.437+0000 7f96677fe700 1 -- 172.21.15.118:0/2069860298 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f96600108f0 con 0x7f967008f260 2023-10-05T19:50:08.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.501+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22d804b5c0 con 0x7f22d806bfc0 2023-10-05T19:50:08.511 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.501+0000 7f22ce7fc700 1 -- 172.21.15.118:0/3171155902 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22c8017030 con 0x7f22d806bfc0 2023-10-05T19:50:08.511 INFO:teuthology.orchestra.run.smithi118.stdout:38654705667 2023-10-05T19:50:08.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f22c40326e0 msgr2=0x7f22c4034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 --2- 172.21.15.118:0/3171155902 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f22c40326e0 0x7f22c4034b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22d4006eb0 tx=0x7f22d4016000 comp rx=0 tx=0).stop 2023-10-05T19:50:08.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d806bfc0 msgr2=0x7f22d808e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 --2- 172.21.15.118:0/3171155902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d806bfc0 0x7f22d808e1e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c490 tx=0x7f22c8007e00 comp rx=0 tx=0).stop 2023-10-05T19:50:08.513 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 shutdown_connections 2023-10-05T19:50:08.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 --2- 172.21.15.118:0/3171155902 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f22c40326e0 0x7f22c4034b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 --2- 172.21.15.118:0/3171155902 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f22d806bfc0 0x7f22d808e1e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 >> 172.21.15.118:0/3171155902 conn(0x7f22d8095430 msgr2=0x7f22d806aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 shutdown_connections 2023-10-05T19:50:08.514 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.505+0000 7f22e054b700 1 -- 172.21.15.118:0/3171155902 wait complete. 2023-10-05T19:50:08.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.3 2023-10-05T19:50:08.533 DEBUG:teuthology.parallel:result is None 2023-10-05T19:50:08.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.597+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f967004b5c0 con 0x7f967008f260 2023-10-05T19:50:08.606 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.597+0000 7f96677fe700 1 -- 172.21.15.118:0/2069860298 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f966001b360 con 0x7f967008f260 2023-10-05T19:50:08.607 INFO:teuthology.orchestra.run.smithi118.stdout:38654705667 2023-10-05T19:50:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96500323e0 msgr2=0x7f9650034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 --2- 172.21.15.118:0/2069860298 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96500323e0 0x7f9650034890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f96580091e0 tx=0x7f9658016000 comp rx=0 tx=0).stop 2023-10-05T19:50:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008f260 msgr2=0x7f96701358e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 --2- 172.21.15.118:0/2069860298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008f260 0x7f96701358e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f966000c6c0 tx=0x7f9660007f70 comp rx=0 tx=0).stop 2023-10-05T19:50:08.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 shutdown_connections 2023-10-05T19:50:08.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 --2- 172.21.15.118:0/2069860298 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96500323e0 0x7f9650034890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 --2- 172.21.15.118:0/2069860298 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f967008f260 0x7f96701358e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 >> 172.21.15.118:0/2069860298 conn(0x7f9670094b00 msgr2=0x7f967006d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 shutdown_connections 2023-10-05T19:50:08.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.601+0000 7f9674b0d700 1 -- 172.21.15.118:0/2069860298 wait complete. 2023-10-05T19:50:08.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.2 2023-10-05T19:50:08.620 DEBUG:teuthology.parallel:result is None 2023-10-05T19:50:08.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5aa0005360 con 0x7f5ac008e410 2023-10-05T19:50:08.628 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5abcff9700 1 -- 172.21.15.118:0/3077344851 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ab4011e40 con 0x7f5ac008e410 2023-10-05T19:50:08.629 INFO:teuthology.orchestra.run.smithi118.stdout:38654705667 2023-10-05T19:50:08.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5aa4032420 msgr2=0x7f5aa40348d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 --2- 172.21.15.118:0/3077344851 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5aa4032420 0x7f5aa40348d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5aac009860 tx=0x7f5aac016000 comp rx=0 tx=0).stop 2023-10-05T19:50:08.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac008e410 msgr2=0x7f5ac011cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 --2- 172.21.15.118:0/3077344851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac008e410 0x7f5ac011cee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c6c0 tx=0x7f5ab4007e00 comp rx=0 tx=0).stop 2023-10-05T19:50:08.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 shutdown_connections 2023-10-05T19:50:08.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 --2- 172.21.15.118:0/3077344851 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5aa4032420 0x7f5aa40348d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.631 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 --2- 172.21.15.118:0/3077344851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ac008e410 0x7f5ac011cee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 >> 172.21.15.118:0/3077344851 conn(0x7f5ac0094aa0 msgr2=0x7f5ac008dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 shutdown_connections 2023-10-05T19:50:08.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.621+0000 7f5ac7182700 1 -- 172.21.15.118:0/3077344851 wait complete. 2023-10-05T19:50:08.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb6c04b5c0 con 0x7ffb6c0697b0 2023-10-05T19:50:08.632 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb53fff700 1 -- 172.21.15.118:0/2769471565 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb5c010300 con 0x7ffb6c0697b0 2023-10-05T19:50:08.633 INFO:teuthology.orchestra.run.smithi118.stdout:38654705667 2023-10-05T19:50:08.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffb58032390 msgr2=0x7ffb58034840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 --2- 172.21.15.118:0/2769471565 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffb58032390 0x7ffb58034840 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffb600030c0 tx=0x7ffb60016000 comp rx=0 tx=0).stop 2023-10-05T19:50:08.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 msgr2=0x7ffb6c12ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.635 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 --2- 172.21.15.118:0/2769471565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 0x7ffb6c12ab70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00c6c0 tx=0x7ffb5c007f30 comp rx=0 tx=0).stop 2023-10-05T19:50:08.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 shutdown_connections 2023-10-05T19:50:08.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 --2- 172.21.15.118:0/2769471565 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffb58032390 0x7ffb58034840 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 --2- 172.21.15.118:0/2769471565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffb6c0697b0 0x7ffb6c12ab70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 >> 172.21.15.118:0/2769471565 conn(0x7ffb6c095ae0 msgr2=0x7ffb6c06d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 shutdown_connections 2023-10-05T19:50:08.636 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.625+0000 7ffb72534700 1 -- 172.21.15.118:0/2769471565 wait complete. 2023-10-05T19:50:08.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.0 2023-10-05T19:50:08.642 DEBUG:teuthology.parallel:result is None 2023-10-05T19:50:08.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.1 2023-10-05T19:50:08.646 DEBUG:teuthology.parallel:result is None 2023-10-05T19:50:08.646 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-05T19:50:08.646 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T19:50:08.746 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3ca070700 1 Processor -- start 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3ca070700 1 -- start start 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3ca070700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3c408f150 0x7ff3c408f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3ca070700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c40916f0 con 0x7ff3c408fa60 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3ca070700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c4090a90 con 0x7ff3c408f150 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3c886d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff3c408fa60 0x7ff3c41315f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39508/0 (socket says 172.21.15.118:39508) 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3c886d700 1 -- 172.21.15.118:0/646130798 learned_addr learned my addr 172.21.15.118:0/646130798 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3c906e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3c408f150 0x7ff3c408f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3c3fff700 1 -- 172.21.15.118:0/646130798 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747737988 0 0) 0x7ff3c40916f0 con 0x7ff3c408fa60 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3c3fff700 1 -- 172.21.15.118:0/646130798 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b0003570 con 0x7ff3c408fa60 2023-10-05T19:50:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3c906e700 1 -- 172.21.15.118:0/646130798 >> v1:172.21.15.118:6789/0 conn(0x7ff3c408fa60 legacy=0x7ff3c41315f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.748 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3c906e700 1 -- 172.21.15.118:0/646130798 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40967a0 con 0x7ff3c408f150 2023-10-05T19:50:08.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.737+0000 7ff3c906e700 1 --2- 172.21.15.118:0/646130798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 0x7ff3c408f520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009850 tx=0x7ff3ac009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14eae22bbda23bd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3c3fff700 1 -- 172.21.15.118:0/646130798 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac005c10 con 0x7ff3c408f150 2023-10-05T19:50:08.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3c3fff700 1 -- 172.21.15.118:0/646130798 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac005d70 con 0x7ff3c408f150 2023-10-05T19:50:08.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3c3fff700 1 -- 172.21.15.118:0/646130798 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac006170 con 0x7ff3c408f150 2023-10-05T19:50:08.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 -- 172.21.15.118:0/646130798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 msgr2=0x7ff3c408f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 --2- 172.21.15.118:0/646130798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 0x7ff3c408f520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac009850 tx=0x7ff3ac009120 comp rx=0 tx=0).stop 2023-10-05T19:50:08.749 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 -- 172.21.15.118:0/646130798 shutdown_connections 2023-10-05T19:50:08.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 --2- 172.21.15.118:0/646130798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 0x7ff3c408f520 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 -- 172.21.15.118:0/646130798 >> 172.21.15.118:0/646130798 conn(0x7ff3c40986c0 msgr2=0x7ff3c4095b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 -- 172.21.15.118:0/646130798 shutdown_connections 2023-10-05T19:50:08.750 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 -- 172.21.15.118:0/646130798 wait complete. 2023-10-05T19:50:08.751 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 Processor -- start 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 -- start start 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 0x7ff3c413bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3ca070700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c412a1f0 con 0x7ff3c408f150 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3c906e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 0x7ff3c413bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3c906e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 0x7ff3c413bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57720/0 (socket says 172.21.15.118:57720) 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3c906e700 1 -- 172.21.15.118:0/2031140497 learned_addr learned my addr 172.21.15.118:0/2031140497 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.741+0000 7ff3c906e700 1 -- 172.21.15.118:0/2031140497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac0093c0 con 0x7ff3c408f150 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3c906e700 1 --2- 172.21.15.118:0/2031140497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 0x7ff3c413bed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac003080 tx=0x7ff3ac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3c17fa700 1 -- 172.21.15.118:0/2031140497 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac011b40 con 0x7ff3c408f150 2023-10-05T19:50:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3c17fa700 1 -- 172.21.15.118:0/2031140497 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac011cc0 con 0x7ff3c408f150 2023-10-05T19:50:08.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c4128ed0 con 0x7ff3c408f150 2023-10-05T19:50:08.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3c17fa700 1 -- 172.21.15.118:0/2031140497 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac01c430 con 0x7ff3c408f150 2023-10-05T19:50:08.753 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c412af20 con 0x7ff3c408f150 2023-10-05T19:50:08.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3c17fa700 1 -- 172.21.15.118:0/2031140497 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff3ac023070 con 0x7ff3c408f150 2023-10-05T19:50:08.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3c17fa700 1 --2- 172.21.15.118:0/2031140497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3a4032390 0x7ff3a4034840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:08.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3c17fa700 1 -- 172.21.15.118:0/2031140497 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7ff3ac045a20 con 0x7ff3c408f150 2023-10-05T19:50:08.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c412ab70 con 0x7ff3c408f150 2023-10-05T19:50:08.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3c886d700 1 --2- 172.21.15.118:0/2031140497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3a4032390 0x7ff3a4034840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:08.754 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.745+0000 7ff3c886d700 1 --2- 172.21.15.118:0/2031140497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3a4032390 0x7ff3a4034840 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4005c50 tx=0x7ff3b40016e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:08.763 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.753+0000 7ff3c17fa700 1 -- 172.21.15.118:0/2031140497 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7ff3ac010970 con 0x7ff3c408f150 2023-10-05T19:50:08.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.905+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 --> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3c405ecb0 con 0x7ff3a4032390 2023-10-05T19:50:08.917 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3c17fa700 1 -- 172.21.15.118:0/2031140497 <== mgr.4100 v2:172.21.15.167:6824/26627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+33324 (secure 0 0 0) 0x7ff3c405ecb0 con 0x7ff3a4032390 2023-10-05T19:50:08.917 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:50:08.918 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3a4032390 msgr2=0x7ff3a4034840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3ca070700 1 --2- 172.21.15.118:0/2031140497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3a4032390 0x7ff3a4034840 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4005c50 tx=0x7ff3b40016e0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 msgr2=0x7ff3c413bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:08.919 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3ca070700 1 --2- 172.21.15.118:0/2031140497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 0x7ff3c413bed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac003080 tx=0x7ff3ac015000 comp rx=0 tx=0).stop 2023-10-05T19:50:08.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 shutdown_connections 2023-10-05T19:50:08.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3ca070700 1 --2- 172.21.15.118:0/2031140497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3a4032390 0x7ff3a4034840 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3ca070700 1 --2- 172.21.15.118:0/2031140497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff3c408f150 0x7ff3c413bed0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:08.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 >> 172.21.15.118:0/2031140497 conn(0x7ff3c40986c0 msgr2=0x7ff3c412f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:08.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.909+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 shutdown_connections 2023-10-05T19:50:08.920 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:08.913+0000 7ff3ca070700 1 -- 172.21.15.118:0/2031140497 wait complete. 2023-10-05T19:50:08.920 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-10-05T19:50:08.931 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-10-05T19:50:08.554421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3192472,"kb_used_data":371611448,"kb_used_omap":360,"kb_used_meta":0,"kb_avail":371605048,"statfs":{"total":383792660480,"available":380523569152,"internally_reserved":6553600,"allocated":380530122752,"data_stored":380530122752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":369445,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.044674"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.516581+0000","last_change":"2023-10-05T19:50:04.516581+0000","last_active":"2023-10-05T19:50:04.516581+0000","last_peered":"2023-10-05T19:50:04.516581+0000","last_clean":"2023-10-05T19:50:04.516581+0000","last_became_active":"2023-10-05T19:50:04.516269+0000","last_became_peered":"2023-10-05T19:50:04.516269+0000","last_unstale":"2023-10-05T19:50:04.516581+0000","last_undegraded":"2023-10-05T19:50:04.516581+0000","last_fullsized":"2023-10-05T19:50:04.516581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:25.971567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.514650+0000","last_change":"2023-10-05T19:50:04.514650+0000","last_active":"2023-10-05T19:50:04.514650+0000","last_peered":"2023-10-05T19:50:04.514650+0000","last_clean":"2023-10-05T19:50:04.514650+0000","last_became_active":"2023-10-05T19:50:04.513934+0000","last_became_peered":"2023-10-05T19:50:04.513934+0000","last_unstale":"2023-10-05T19:50:04.514650+0000","last_undegraded":"2023-10-05T19:50:04.514650+0000","last_fullsized":"2023-10-05T19:50:04.514650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:09.324805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.515094+0000","last_change":"2023-10-05T19:50:04.515094+0000","last_active":"2023-10-05T19:50:04.515094+0000","last_peered":"2023-10-05T19:50:04.515094+0000","last_clean":"2023-10-05T19:50:04.515094+0000","last_became_active":"2023-10-05T19:50:04.514476+0000","last_became_peered":"2023-10-05T19:50:04.514476+0000","last_unstale":"2023-10-05T19:50:04.515094+0000","last_undegraded":"2023-10-05T19:50:04.515094+0000","last_fullsized":"2023-10-05T19:50:04.515094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:31.435864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.517703+0000","last_change":"2023-10-05T19:50:04.517703+0000","last_active":"2023-10-05T19:50:04.517703+0000","last_peered":"2023-10-05T19:50:04.517703+0000","last_clean":"2023-10-05T19:50:04.517703+0000","last_became_active":"2023-10-05T19:50:04.517092+0000","last_became_peered":"2023-10-05T19:50:04.517092+0000","last_unstale":"2023-10-05T19:50:04.517703+0000","last_undegraded":"2023-10-05T19:50:04.517703+0000","last_fullsized":"2023-10-05T19:50:04.517703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:25.971567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.515652+0000","last_change":"2023-10-05T19:50:04.515652+0000","last_active":"2023-10-05T19:50:04.515652+0000","last_peered":"2023-10-05T19:50:04.515652+0000","last_clean":"2023-10-05T19:50:04.515652+0000","last_became_active":"2023-10-05T19:50:04.515341+0000","last_became_peered":"2023-10-05T19:50:04.515341+0000","last_unstale":"2023-10-05T19:50:04.515652+0000","last_undegraded":"2023-10-05T19:50:04.515652+0000","last_fullsized":"2023-10-05T19:50:04.515652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:27.071272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.518042+0000","last_change":"2023-10-05T19:50:04.517548+0000","last_active":"2023-10-05T19:50:04.518042+0000","last_peered":"2023-10-05T19:50:04.518042+0000","last_clean":"2023-10-05T19:50:04.518042+0000","last_became_active":"2023-10-05T19:50:04.516132+0000","last_became_peered":"2023-10-05T19:50:04.516132+0000","last_unstale":"2023-10-05T19:50:04.518042+0000","last_undegraded":"2023-10-05T19:50:04.518042+0000","last_fullsized":"2023-10-05T19:50:04.518042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:27.071272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.519474+0000","last_change":"2023-10-05T19:50:04.519474+0000","last_active":"2023-10-05T19:50:04.519474+0000","last_peered":"2023-10-05T19:50:04.519474+0000","last_clean":"2023-10-05T19:50:04.519474+0000","last_became_active":"2023-10-05T19:50:04.519175+0000","last_became_peered":"2023-10-05T19:50:04.519175+0000","last_unstale":"2023-10-05T19:50:04.519474+0000","last_undegraded":"2023-10-05T19:50:04.519474+0000","last_fullsized":"2023-10-05T19:50:04.519474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:19:55.021427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.515472+0000","last_change":"2023-10-05T19:50:04.515472+0000","last_active":"2023-10-05T19:50:04.515472+0000","last_peered":"2023-10-05T19:50:04.515472+0000","last_clean":"2023-10-05T19:50:04.515472+0000","last_became_active":"2023-10-05T19:50:04.514572+0000","last_became_peered":"2023-10-05T19:50:04.514572+0000","last_unstale":"2023-10-05T19:50:04.515472+0000","last_undegraded":"2023-10-05T19:50:04.515472+0000","last_fullsized":"2023-10-05T19:50:04.515472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:09.324805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":161,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-05T19:50:03.500815+0000","last_change":"2023-10-05T19:50:00.607846+0000","last_active":"2023-10-05T19:50:03.500815+0000","last_peered":"2023-10-05T19:50:03.500815+0000","last_clean":"2023-10-05T19:50:03.500815+0000","last_became_active":"2023-10-05T19:50:00.605696+0000","last_became_peered":"2023-10-05T19:50:00.605696+0000","last_unstale":"2023-10-05T19:50:03.500815+0000","last_undegraded":"2023-10-05T19:50:03.500815+0000","last_fullsized":"2023-10-05T19:50:03.500815+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:49:59.466915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:49:59.466915+0000","last_clean_scrub_stamp":"2023-10-05T19:49:59.466915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:46:04.914288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795964,"kb_used_data":92903480,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903416,"statfs":{"total":95948165120,"available":95133097984,"internally_reserved":65536,"allocated":95133163520,"data_stored":95133163520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43716,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":800240,"kb_used_data":92902224,"kb_used_omap":120,"kb_used_meta":0,"kb_avail":92899140,"statfs":{"total":95948165120,"available":95128719360,"internally_reserved":3158016,"allocated":95131877376,"data_stored":95131877376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":123597,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":800220,"kb_used_data":92902264,"kb_used_omap":129,"kb_used_meta":0,"kb_avail":92899160,"statfs":{"total":95948165120,"available":95128739840,"internally_reserved":3178496,"allocated":95131918336,"data_stored":95131918336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132613,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796048,"kb_used_data":92903480,"kb_used_omap":67,"kb_used_meta":0,"kb_avail":92903332,"statfs":{"total":95948165120,"available":95133011968,"internally_reserved":151552,"allocated":95133163520,"data_stored":95133163520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69519,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[]}} 2023-10-05T19:50:09.027 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T19:50:09.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.129+0000 7f0bd8a09700 1 Processor -- start 2023-10-05T19:50:09.139 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.129+0000 7f0bd8a09700 1 -- start start 2023-10-05T19:50:09.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0bd4090580 0x7f0bd4090950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:09.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd4092250 con 0x7f0bd4090e90 2023-10-05T19:50:09.140 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd406e420 con 0x7f0bd4090580 2023-10-05T19:50:09.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd259c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0bd4090e90 0x7f0bd4129f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:39522/0 (socket says 172.21.15.118:39522) 2023-10-05T19:50:09.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd2d9d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0bd4090580 0x7f0bd4090950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:09.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd259c700 1 -- 172.21.15.118:0/3228183351 learned_addr learned my addr 172.21.15.118:0/3228183351 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:09.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd2d9d700 1 -- 172.21.15.118:0/3228183351 >> v1:172.21.15.118:6789/0 conn(0x7f0bd4090e90 legacy=0x7f0bd4129f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd2d9d700 1 -- 172.21.15.118:0/3228183351 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4091710 con 0x7f0bd4090580 2023-10-05T19:50:09.141 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd2d9d700 1 --2- 172.21.15.118:0/3228183351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 0x7f0bd4090950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009860 tx=0x7f0bc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30970c2f56e6895f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:09.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd1d9b700 1 -- 172.21.15.118:0/3228183351 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc400b680 con 0x7f0bd4090580 2023-10-05T19:50:09.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd1d9b700 1 -- 172.21.15.118:0/3228183351 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc400b7e0 con 0x7f0bd4090580 2023-10-05T19:50:09.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd1d9b700 1 -- 172.21.15.118:0/3228183351 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc400bad0 con 0x7f0bd4090580 2023-10-05T19:50:09.142 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 -- 172.21.15.118:0/3228183351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 msgr2=0x7f0bd4090950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 --2- 172.21.15.118:0/3228183351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 0x7f0bd4090950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009860 tx=0x7f0bc40091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:09.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 -- 172.21.15.118:0/3228183351 shutdown_connections 2023-10-05T19:50:09.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 --2- 172.21.15.118:0/3228183351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 0x7f0bd4090950 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:09.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 -- 172.21.15.118:0/3228183351 >> 172.21.15.118:0/3228183351 conn(0x7f0bd4096e30 msgr2=0x7f0bd4097200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:09.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 -- 172.21.15.118:0/3228183351 shutdown_connections 2023-10-05T19:50:09.143 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.133+0000 7f0bd8a09700 1 -- 172.21.15.118:0/3228183351 wait complete. 2023-10-05T19:50:09.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd8a09700 1 Processor -- start 2023-10-05T19:50:09.144 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd8a09700 1 -- start start 2023-10-05T19:50:09.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd8a09700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 0x7f0bd408b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:09.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd8a09700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd408ff00 con 0x7f0bd4090580 2023-10-05T19:50:09.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 0x7f0bd408b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:09.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd2d9d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 0x7f0bd408b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57750/0 (socket says 172.21.15.118:57750) 2023-10-05T19:50:09.146 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd2d9d700 1 -- 172.21.15.118:0/1557652558 learned_addr learned my addr 172.21.15.118:0/1557652558 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:09.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd2d9d700 1 -- 172.21.15.118:0/1557652558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4009420 con 0x7f0bd4090580 2023-10-05T19:50:09.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd2d9d700 1 --2- 172.21.15.118:0/1557652558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 0x7f0bd408b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4006eb0 tx=0x7f0bc4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:09.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bcaffd700 1 -- 172.21.15.118:0/1557652558 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc4025470 con 0x7f0bd4090580 2023-10-05T19:50:09.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd408d270 con 0x7f0bd4090580 2023-10-05T19:50:09.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bcaffd700 1 -- 172.21.15.118:0/1557652558 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40255d0 con 0x7f0bd4090580 2023-10-05T19:50:09.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bcaffd700 1 -- 172.21.15.118:0/1557652558 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0bc4025880 con 0x7f0bd4090580 2023-10-05T19:50:09.147 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.137+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd408e480 con 0x7f0bd4090580 2023-10-05T19:50:09.148 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.141+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd408ef90 con 0x7f0bd4090580 2023-10-05T19:50:09.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.141+0000 7f0bcaffd700 1 -- 172.21.15.118:0/1557652558 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f0bc4022070 con 0x7f0bd4090580 2023-10-05T19:50:09.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.141+0000 7f0bcaffd700 1 --2- 172.21.15.118:0/1557652558 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0bb4032390 0x7f0bb4034840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:09.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.141+0000 7f0bcaffd700 1 -- 172.21.15.118:0/1557652558 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f0bc4045bb0 con 0x7f0bd4090580 2023-10-05T19:50:09.149 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.141+0000 7f0bd259c700 1 --2- 172.21.15.118:0/1557652558 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0bb4032390 0x7f0bb4034840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:09.150 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.141+0000 7f0bd259c700 1 --2- 172.21.15.118:0/1557652558 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0bb4032390 0x7f0bb4034840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0016a0 tx=0x7f0bbc007b30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:09.156 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.149+0000 7f0bcaffd700 1 -- 172.21.15.118:0/1557652558 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f0bc404c080 con 0x7f0bd4090580 2023-10-05T19:50:09.323 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.317+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 --> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bd405ecb0 con 0x7f0bb4032390 2023-10-05T19:50:09.336 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.317+0000 7f0bcaffd700 1 -- 172.21.15.118:0/1557652558 <== mgr.4100 v2:172.21.15.167:6824/26627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+33324 (secure 0 0 0) 0x7f0bd405ecb0 con 0x7f0bb4032390 2023-10-05T19:50:09.337 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:50:09.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0bb4032390 msgr2=0x7f0bb4034840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 --2- 172.21.15.118:0/1557652558 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0bb4032390 0x7f0bb4034840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0016a0 tx=0x7f0bbc007b30 comp rx=0 tx=0).stop 2023-10-05T19:50:09.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 msgr2=0x7f0bd408b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 --2- 172.21.15.118:0/1557652558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 0x7f0bd408b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4006eb0 tx=0x7f0bc4016000 comp rx=0 tx=0).stop 2023-10-05T19:50:09.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 shutdown_connections 2023-10-05T19:50:09.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 --2- 172.21.15.118:0/1557652558 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0bb4032390 0x7f0bb4034840 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:09.338 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 --2- 172.21.15.118:0/1557652558 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0bd4090580 0x7f0bd408b760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:09.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 >> 172.21.15.118:0/1557652558 conn(0x7f0bd4096e30 msgr2=0x7f0bd4084fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:09.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 shutdown_connections 2023-10-05T19:50:09.339 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.321+0000 7f0bd8a09700 1 -- 172.21.15.118:0/1557652558 wait complete. 2023-10-05T19:50:09.339 INFO:teuthology.orchestra.run.smithi118.stderr:dumped all 2023-10-05T19:50:09.341 INFO:teuthology.orchestra.run.smithi118.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-10-05T19:50:08.554421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":374797520,"kb_used":3192472,"kb_used_data":371611448,"kb_used_omap":360,"kb_used_meta":0,"kb_avail":371605048,"statfs":{"total":383792660480,"available":380523569152,"internally_reserved":6553600,"allocated":380530122752,"data_stored":380530122752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":369445,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.044674"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.516581+0000","last_change":"2023-10-05T19:50:04.516581+0000","last_active":"2023-10-05T19:50:04.516581+0000","last_peered":"2023-10-05T19:50:04.516581+0000","last_clean":"2023-10-05T19:50:04.516581+0000","last_became_active":"2023-10-05T19:50:04.516269+0000","last_became_peered":"2023-10-05T19:50:04.516269+0000","last_unstale":"2023-10-05T19:50:04.516581+0000","last_undegraded":"2023-10-05T19:50:04.516581+0000","last_fullsized":"2023-10-05T19:50:04.516581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:25.971567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.514650+0000","last_change":"2023-10-05T19:50:04.514650+0000","last_active":"2023-10-05T19:50:04.514650+0000","last_peered":"2023-10-05T19:50:04.514650+0000","last_clean":"2023-10-05T19:50:04.514650+0000","last_became_active":"2023-10-05T19:50:04.513934+0000","last_became_peered":"2023-10-05T19:50:04.513934+0000","last_unstale":"2023-10-05T19:50:04.514650+0000","last_undegraded":"2023-10-05T19:50:04.514650+0000","last_fullsized":"2023-10-05T19:50:04.514650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:09.324805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.515094+0000","last_change":"2023-10-05T19:50:04.515094+0000","last_active":"2023-10-05T19:50:04.515094+0000","last_peered":"2023-10-05T19:50:04.515094+0000","last_clean":"2023-10-05T19:50:04.515094+0000","last_became_active":"2023-10-05T19:50:04.514476+0000","last_became_peered":"2023-10-05T19:50:04.514476+0000","last_unstale":"2023-10-05T19:50:04.515094+0000","last_undegraded":"2023-10-05T19:50:04.515094+0000","last_fullsized":"2023-10-05T19:50:04.515094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:31.435864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.517703+0000","last_change":"2023-10-05T19:50:04.517703+0000","last_active":"2023-10-05T19:50:04.517703+0000","last_peered":"2023-10-05T19:50:04.517703+0000","last_clean":"2023-10-05T19:50:04.517703+0000","last_became_active":"2023-10-05T19:50:04.517092+0000","last_became_peered":"2023-10-05T19:50:04.517092+0000","last_unstale":"2023-10-05T19:50:04.517703+0000","last_undegraded":"2023-10-05T19:50:04.517703+0000","last_fullsized":"2023-10-05T19:50:04.517703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:14:25.971567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.515652+0000","last_change":"2023-10-05T19:50:04.515652+0000","last_active":"2023-10-05T19:50:04.515652+0000","last_peered":"2023-10-05T19:50:04.515652+0000","last_clean":"2023-10-05T19:50:04.515652+0000","last_became_active":"2023-10-05T19:50:04.515341+0000","last_became_peered":"2023-10-05T19:50:04.515341+0000","last_unstale":"2023-10-05T19:50:04.515652+0000","last_undegraded":"2023-10-05T19:50:04.515652+0000","last_fullsized":"2023-10-05T19:50:04.515652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:27.071272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.518042+0000","last_change":"2023-10-05T19:50:04.517548+0000","last_active":"2023-10-05T19:50:04.518042+0000","last_peered":"2023-10-05T19:50:04.518042+0000","last_clean":"2023-10-05T19:50:04.518042+0000","last_became_active":"2023-10-05T19:50:04.516132+0000","last_became_peered":"2023-10-05T19:50:04.516132+0000","last_unstale":"2023-10-05T19:50:04.518042+0000","last_undegraded":"2023-10-05T19:50:04.518042+0000","last_fullsized":"2023-10-05T19:50:04.518042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:27:27.071272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.519474+0000","last_change":"2023-10-05T19:50:04.519474+0000","last_active":"2023-10-05T19:50:04.519474+0000","last_peered":"2023-10-05T19:50:04.519474+0000","last_clean":"2023-10-05T19:50:04.519474+0000","last_became_active":"2023-10-05T19:50:04.519175+0000","last_became_peered":"2023-10-05T19:50:04.519175+0000","last_unstale":"2023-10-05T19:50:04.519474+0000","last_undegraded":"2023-10-05T19:50:04.519474+0000","last_fullsized":"2023-10-05T19:50:04.519474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:19:55.021427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-05T19:50:04.515472+0000","last_change":"2023-10-05T19:50:04.515472+0000","last_active":"2023-10-05T19:50:04.515472+0000","last_peered":"2023-10-05T19:50:04.515472+0000","last_clean":"2023-10-05T19:50:04.515472+0000","last_became_active":"2023-10-05T19:50:04.514572+0000","last_became_peered":"2023-10-05T19:50:04.514572+0000","last_unstale":"2023-10-05T19:50:04.515472+0000","last_undegraded":"2023-10-05T19:50:04.515472+0000","last_fullsized":"2023-10-05T19:50:04.515472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:50:03.491529+0000","last_clean_scrub_stamp":"2023-10-05T19:50:03.491529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:37:09.324805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":161,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-05T19:50:03.500815+0000","last_change":"2023-10-05T19:50:00.607846+0000","last_active":"2023-10-05T19:50:03.500815+0000","last_peered":"2023-10-05T19:50:03.500815+0000","last_clean":"2023-10-05T19:50:03.500815+0000","last_became_active":"2023-10-05T19:50:00.605696+0000","last_became_peered":"2023-10-05T19:50:00.605696+0000","last_unstale":"2023-10-05T19:50:03.500815+0000","last_undegraded":"2023-10-05T19:50:03.500815+0000","last_fullsized":"2023-10-05T19:50:03.500815+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T19:49:59.466915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T19:49:59.466915+0000","last_clean_scrub_stamp":"2023-10-05T19:49:59.466915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T23:46:04.914288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795964,"kb_used_data":92903480,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":92903416,"statfs":{"total":95948165120,"available":95133097984,"internally_reserved":65536,"allocated":95133163520,"data_stored":95133163520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43716,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":800240,"kb_used_data":92902224,"kb_used_omap":120,"kb_used_meta":0,"kb_avail":92899140,"statfs":{"total":95948165120,"available":95128719360,"internally_reserved":3158016,"allocated":95131877376,"data_stored":95131877376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":123597,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":800220,"kb_used_data":92902264,"kb_used_omap":129,"kb_used_meta":0,"kb_avail":92899160,"statfs":{"total":95948165120,"available":95128739840,"internally_reserved":3178496,"allocated":95131918336,"data_stored":95131918336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":132613,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796048,"kb_used_data":92903480,"kb_used_omap":67,"kb_used_meta":0,"kb_avail":92903332,"statfs":{"total":95948165120,"available":95133011968,"internally_reserved":151552,"allocated":95133163520,"data_stored":95133163520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69519,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[]}} 2023-10-05T19:50:09.353 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-05T19:50:09.353 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-05T19:50:09.354 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-05T19:50:09.354 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-05T19:50:09.454 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bec25700 1 Processor -- start 2023-10-05T19:50:09.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bec25700 1 -- start start 2023-10-05T19:50:09.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bec25700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f28b8093670 0x7f28b8093a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:09.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bec25700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b8094cb0 con 0x7f28b8093f80 2023-10-05T19:50:09.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bec25700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b8094a40 con 0x7f28b8093670 2023-10-05T19:50:09.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bdc23700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f28b8093670 0x7f28b8093a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:09.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bd422700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f28b8093f80 0x7f28b812d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:41210/0 (socket says 172.21.15.118:41210) 2023-10-05T19:50:09.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bdc23700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f28b8093670 0x7f28b8093a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52470/0 (socket says 172.21.15.118:52470) 2023-10-05T19:50:09.455 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bd422700 1 -- 172.21.15.118:0/3233472707 learned_addr learned my addr 172.21.15.118:0/3233472707 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:50:09.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bdc23700 1 -- 172.21.15.118:0/3233472707 >> v1:172.21.15.118:6789/0 conn(0x7f28b8093f80 legacy=0x7f28b812d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.445+0000 7f28bdc23700 1 -- 172.21.15.118:0/3233472707 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80989a0 con 0x7f28b8093670 2023-10-05T19:50:09.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bdc23700 1 --2- 172.21.15.118:0/3233472707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 0x7f28b8093a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009860 tx=0x7f28b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a206f7a8696435 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:09.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bcc21700 1 -- 172.21.15.118:0/3233472707 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28b400b680 con 0x7f28b8093670 2023-10-05T19:50:09.456 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bcc21700 1 -- 172.21.15.118:0/3233472707 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b400b7e0 con 0x7f28b8093670 2023-10-05T19:50:09.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bcc21700 1 -- 172.21.15.118:0/3233472707 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28b400b990 con 0x7f28b8093670 2023-10-05T19:50:09.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bec25700 1 -- 172.21.15.118:0/3233472707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 msgr2=0x7f28b8093a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.457 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bec25700 1 --2- 172.21.15.118:0/3233472707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 0x7f28b8093a40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009860 tx=0x7f28b40091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:09.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bec25700 1 -- 172.21.15.118:0/3233472707 shutdown_connections 2023-10-05T19:50:09.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bec25700 1 --2- 172.21.15.118:0/3233472707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 0x7f28b8093a40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:09.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bec25700 1 -- 172.21.15.118:0/3233472707 >> 172.21.15.118:0/3233472707 conn(0x7f28b8098e20 msgr2=0x7f28b80991f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:09.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bec25700 1 -- 172.21.15.118:0/3233472707 shutdown_connections 2023-10-05T19:50:09.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bec25700 1 -- 172.21.15.118:0/3233472707 wait complete. 2023-10-05T19:50:09.458 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bec25700 1 Processor -- start 2023-10-05T19:50:09.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.449+0000 7f28bec25700 1 -- start start 2023-10-05T19:50:09.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bec25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 0x7f28b808e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:09.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bec25700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80904e0 con 0x7f28b8093670 2023-10-05T19:50:09.459 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bdc23700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 0x7f28b808e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:09.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bdc23700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 0x7f28b808e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:52476/0 (socket says 172.21.15.118:52476) 2023-10-05T19:50:09.460 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bdc23700 1 -- 172.21.15.118:0/1056338876 learned_addr learned my addr 172.21.15.118:0/1056338876 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:50:09.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bdc23700 1 -- 172.21.15.118:0/1056338876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4009420 con 0x7f28b8093670 2023-10-05T19:50:09.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bdc23700 1 --2- 172.21.15.118:0/1056338876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 0x7f28b808e8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f28b40091e0 tx=0x7f28b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:09.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28adffb700 1 -- 172.21.15.118:0/1056338876 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28b4011cf0 con 0x7f28b8093670 2023-10-05T19:50:09.461 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28adffb700 1 -- 172.21.15.118:0/1056338876 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b401f070 con 0x7f28b8093670 2023-10-05T19:50:09.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b806e3a0 con 0x7f28b8093670 2023-10-05T19:50:09.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28adffb700 1 -- 172.21.15.118:0/1056338876 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28b4011e90 con 0x7f28b8093670 2023-10-05T19:50:09.462 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b80924a0 con 0x7f28b8093670 2023-10-05T19:50:09.463 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28adffb700 1 -- 172.21.15.118:0/1056338876 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f28b4021030 con 0x7f28b8093670 2023-10-05T19:50:09.463 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b805ecb0 con 0x7f28b8093670 2023-10-05T19:50:09.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28adffb700 1 --2- 172.21.15.118:0/1056338876 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f289c032430 0x7f289c0348e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:09.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.453+0000 7f28adffb700 1 -- 172.21.15.118:0/1056338876 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f28b4045770 con 0x7f28b8093670 2023-10-05T19:50:09.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.457+0000 7f28bd422700 1 --2- 172.21.15.118:0/1056338876 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f289c032430 0x7f289c0348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:09.464 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.457+0000 7f28bd422700 1 --2- 172.21.15.118:0/1056338876 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f289c032430 0x7f289c0348e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f28a80016a0 tx=0x7f28a8007b30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:09.472 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.465+0000 7f28adffb700 1 -- 172.21.15.118:0/1056338876 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f28b402c750 con 0x7f28b8093670 2023-10-05T19:50:09.668 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.661+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f28b80965d0 con 0x7f28b8093670 2023-10-05T19:50:09.668 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.661+0000 7f28adffb700 1 -- 172.21.15.118:0/1056338876 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f28b40193c0 con 0x7f28b8093670 2023-10-05T19:50:09.669 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:50:09.669 INFO:teuthology.orchestra.run.smithi118.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-05T19:50:09.672 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f289c032430 msgr2=0x7f289c0348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 --2- 172.21.15.118:0/1056338876 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f289c032430 0x7f289c0348e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f28a80016a0 tx=0x7f28a8007b30 comp rx=0 tx=0).stop 2023-10-05T19:50:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 msgr2=0x7f28b808e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 --2- 172.21.15.118:0/1056338876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 0x7f28b808e8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f28b40091e0 tx=0x7f28b4016000 comp rx=0 tx=0).stop 2023-10-05T19:50:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 shutdown_connections 2023-10-05T19:50:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 --2- 172.21.15.118:0/1056338876 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f289c032430 0x7f289c0348e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 --2- 172.21.15.118:0/1056338876 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28b8093670 0x7f28b808e8c0 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f28b40091e0 tx=0x7f28b4016000 comp rx=0 tx=0).stop 2023-10-05T19:50:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 >> 172.21.15.118:0/1056338876 conn(0x7f28b8098e20 msgr2=0x7f28b806da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 shutdown_connections 2023-10-05T19:50:09.673 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:50:09.665+0000 7f28bec25700 1 -- 172.21.15.118:0/1056338876 wait complete. 2023-10-05T19:50:09.689 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-05T19:50:09.689 INFO:teuthology.run_tasks:Running task rgw... 2023-10-05T19:50:09.703 DEBUG:tasks.rgw:config is {'client.0': None} 2023-10-05T19:50:09.703 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2023-10-05T19:50:09.703 INFO:tasks.rgw:Creating data pools 2023-10-05T19:50:09.703 DEBUG:tasks.rgw:Obtaining remote for client client.0 2023-10-05T19:50:09.703 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2023-10-05T19:50:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 Processor -- start 2023-10-05T19:50:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 -- start start 2023-10-05T19:50:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7facbc1114d0 0x7facbc1118a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc111e70 con 0x7facbc110070 2023-10-05T19:50:09.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc04c3e0 con 0x7facbc1114d0 2023-10-05T19:50:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc148b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7facbc1114d0 0x7facbc1118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc0c8a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7facbc110070 0x7facbc1104e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51154/0 (socket says 172.21.15.167:51154) 2023-10-05T19:50:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc0c8a700 1 -- 172.21.15.167:0/1128377471 learned_addr learned my addr 172.21.15.167:0/1128377471 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facb3fff700 1 -- 172.21.15.167:0/1128377471 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601182584 0 0) 0x7facbc111e70 con 0x7facbc110070 2023-10-05T19:50:09.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facb3fff700 1 -- 172.21.15.167:0/1128377471 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faca8003570 con 0x7facbc110070 2023-10-05T19:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc148b700 1 -- 172.21.15.167:0/1128377471 >> v1:172.21.15.118:6789/0 conn(0x7facbc110070 legacy=0x7facbc1104e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc148b700 1 -- 172.21.15.167:0/1128377471 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc110bf0 con 0x7facbc1114d0 2023-10-05T19:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc148b700 1 --2- 172.21.15.167:0/1128377471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc1114d0 0x7facbc1118a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7facb8009860 tx=0x7facb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d81f6a4a8c82b07 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facb3fff700 1 -- 172.21.15.167:0/1128377471 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb8011630 con 0x7facbc1114d0 2023-10-05T19:50:09.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facb3fff700 1 -- 172.21.15.167:0/1128377471 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8011790 con 0x7facbc1114d0 2023-10-05T19:50:09.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facb3fff700 1 -- 172.21.15.167:0/1128377471 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb8011920 con 0x7facbc1114d0 2023-10-05T19:50:09.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 -- 172.21.15.167:0/1128377471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc1114d0 msgr2=0x7facbc1118a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:09.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 --2- 172.21.15.167:0/1128377471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc1114d0 0x7facbc1118a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7facb8009860 tx=0x7facb80091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 -- 172.21.15.167:0/1128377471 shutdown_connections 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 --2- 172.21.15.167:0/1128377471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc1114d0 0x7facbc1118a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 -- 172.21.15.167:0/1128377471 >> 172.21.15.167:0/1128377471 conn(0x7facbc06a130 msgr2=0x7facbc06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.817+0000 7facc248d700 1 -- 172.21.15.167:0/1128377471 shutdown_connections 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc248d700 1 -- 172.21.15.167:0/1128377471 wait complete. 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc248d700 1 Processor -- start 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc248d700 1 -- start start 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc248d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc110070 0x7facbc120fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc248d700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc10e330 con 0x7facbc110070 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc148b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc110070 0x7facbc120fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:09.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc148b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc110070 0x7facbc120fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:49566/0 (socket says 172.21.15.167:49566) 2023-10-05T19:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc148b700 1 -- 172.21.15.167:0/1406876066 learned_addr learned my addr 172.21.15.167:0/1406876066 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:09.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc148b700 1 -- 172.21.15.167:0/1406876066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8009420 con 0x7facbc110070 2023-10-05T19:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc148b700 1 --2- 172.21.15.167:0/1406876066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc110070 0x7facbc120fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7facb8000c00 tx=0x7facb8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facb17fa700 1 -- 172.21.15.167:0/1406876066 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb8011900 con 0x7facbc110070 2023-10-05T19:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facb17fa700 1 -- 172.21.15.167:0/1406876066 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb8020070 con 0x7facbc110070 2023-10-05T19:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc121610 con 0x7facbc110070 2023-10-05T19:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facb17fa700 1 -- 172.21.15.167:0/1406876066 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facb8027480 con 0x7facbc110070 2023-10-05T19:50:09.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.821+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc121a80 con 0x7facbc110070 2023-10-05T19:50:09.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.825+0000 7facb17fa700 1 -- 172.21.15.167:0/1406876066 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7facb80275e0 con 0x7facbc110070 2023-10-05T19:50:09.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.825+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc05ecb0 con 0x7facbc110070 2023-10-05T19:50:09.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.825+0000 7facb17fa700 1 --2- 172.21.15.167:0/1406876066 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7faca00323e0 0x7faca0034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:09.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.825+0000 7facb17fa700 1 -- 172.21.15.167:0/1406876066 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7facb8022070 con 0x7facbc110070 2023-10-05T19:50:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.825+0000 7facc0c8a700 1 --2- 172.21.15.167:0/1406876066 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7faca00323e0 0x7faca0034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:09.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.825+0000 7facc0c8a700 1 --2- 172.21.15.167:0/1406876066 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7faca00323e0 0x7faca0034890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7facac0058d0 tx=0x7facac0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:09.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:09.833+0000 7facb17fa700 1 -- 172.21.15.167:0/1406876066 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7facb801c450 con 0x7facbc110070 2023-10-05T19:50:10.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.009+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) v1 -- 0x7facbc111570 con 0x7facbc110070 2023-10-05T19:50:10.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.529+0000 7facb17fa700 1 -- 172.21.15.167:0/1406876066 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v16) v1 ==== 171+0+0 (secure 0 0 0) 0x7facb8010380 con 0x7facbc110070 2023-10-05T19:50:10.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7faca00323e0 msgr2=0x7faca0034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:10.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 --2- 172.21.15.167:0/1406876066 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7faca00323e0 0x7faca0034890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7facac0058d0 tx=0x7facac0079d0 comp rx=0 tx=0).stop 2023-10-05T19:50:10.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc110070 msgr2=0x7facbc120fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:10.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 --2- 172.21.15.167:0/1406876066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc110070 0x7facbc120fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7facb8000c00 tx=0x7facb8016000 comp rx=0 tx=0).stop 2023-10-05T19:50:10.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 shutdown_connections 2023-10-05T19:50:10.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 --2- 172.21.15.167:0/1406876066 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7faca00323e0 0x7faca0034890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:10.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 --2- 172.21.15.167:0/1406876066 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7facbc110070 0x7facbc120fe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:10.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 >> 172.21.15.167:0/1406876066 conn(0x7facbc06a130 msgr2=0x7facbc10ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:10.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 shutdown_connections 2023-10-05T19:50:10.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.537+0000 7facc248d700 1 -- 172.21.15.167:0/1406876066 wait complete. 2023-10-05T19:50:10.558 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2023-10-05T19:50:10.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda759e700 1 Processor -- start 2023-10-05T19:50:10.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda759e700 1 -- start start 2023-10-05T19:50:10.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda759e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efda81116a0 0x7efda8113a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:10.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda759e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda8113fc0 con 0x7efda810d960 2023-10-05T19:50:10.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda759e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda804c3e0 con 0x7efda81116a0 2023-10-05T19:50:10.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda5d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efda81116a0 0x7efda8113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:10.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda659c700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7efda810d960 0x7efda810dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51166/0 (socket says 172.21.15.167:51166) 2023-10-05T19:50:10.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda659c700 1 -- 172.21.15.167:0/1264799684 learned_addr learned my addr 172.21.15.167:0/1264799684 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:10.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda559a700 1 -- 172.21.15.167:0/1264799684 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761839002 0 0) 0x7efda8113fc0 con 0x7efda810d960 2023-10-05T19:50:10.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda559a700 1 -- 172.21.15.167:0/1264799684 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd94004680 con 0x7efda810d960 2023-10-05T19:50:10.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda5d9b700 1 -- 172.21.15.167:0/1264799684 >> v1:172.21.15.118:6789/0 conn(0x7efda810d960 legacy=0x7efda810dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:10.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda5d9b700 1 -- 172.21.15.167:0/1264799684 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8115160 con 0x7efda81116a0 2023-10-05T19:50:10.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.665+0000 7efda5d9b700 1 --2- 172.21.15.167:0/1264799684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda81116a0 0x7efda8113a80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd90009860 tx=0x7efd900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b341ca54fb90c0a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:10.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda559a700 1 -- 172.21.15.167:0/1264799684 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd90011630 con 0x7efda81116a0 2023-10-05T19:50:10.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda559a700 1 -- 172.21.15.167:0/1264799684 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd90011790 con 0x7efda81116a0 2023-10-05T19:50:10.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda559a700 1 -- 172.21.15.167:0/1264799684 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd90011920 con 0x7efda81116a0 2023-10-05T19:50:10.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 -- 172.21.15.167:0/1264799684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda81116a0 msgr2=0x7efda8113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:10.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 --2- 172.21.15.167:0/1264799684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda81116a0 0x7efda8113a80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd90009860 tx=0x7efd900091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:10.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 -- 172.21.15.167:0/1264799684 shutdown_connections 2023-10-05T19:50:10.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 --2- 172.21.15.167:0/1264799684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda81116a0 0x7efda8113a80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:10.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 -- 172.21.15.167:0/1264799684 >> 172.21.15.167:0/1264799684 conn(0x7efda806b120 msgr2=0x7efda806d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:10.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 -- 172.21.15.167:0/1264799684 shutdown_connections 2023-10-05T19:50:10.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 -- 172.21.15.167:0/1264799684 wait complete. 2023-10-05T19:50:10.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 Processor -- start 2023-10-05T19:50:10.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 -- start start 2023-10-05T19:50:10.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda810d960 0x7efda811cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:10.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.669+0000 7efda759e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8110710 con 0x7efda810d960 2023-10-05T19:50:10.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efda659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda810d960 0x7efda811cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:10.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efda659c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda810d960 0x7efda811cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:49588/0 (socket says 172.21.15.167:49588) 2023-10-05T19:50:10.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efda659c700 1 -- 172.21.15.167:0/4119146427 learned_addr learned my addr 172.21.15.167:0/4119146427 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:10.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efda659c700 1 -- 172.21.15.167:0/4119146427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90009420 con 0x7efda810d960 2023-10-05T19:50:10.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efda659c700 1 --2- 172.21.15.167:0/4119146427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda810d960 0x7efda811cc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd9800cbb0 tx=0x7efd98001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:10.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efd9e7fc700 1 -- 172.21.15.167:0/4119146427 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd9800a960 con 0x7efda810d960 2023-10-05T19:50:10.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efd9e7fc700 1 -- 172.21.15.167:0/4119146427 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9800aae0 con 0x7efda810d960 2023-10-05T19:50:10.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda811d290 con 0x7efda810d960 2023-10-05T19:50:10.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efd9e7fc700 1 -- 172.21.15.167:0/4119146427 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd9800add0 con 0x7efda810d960 2023-10-05T19:50:10.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda811d760 con 0x7efda810d960 2023-10-05T19:50:10.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda805ecb0 con 0x7efda810d960 2023-10-05T19:50:10.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.673+0000 7efd9e7fc700 1 -- 172.21.15.167:0/4119146427 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7efd980070f0 con 0x7efda810d960 2023-10-05T19:50:10.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.677+0000 7efd9e7fc700 1 --2- 172.21.15.167:0/4119146427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd88032390 0x7efd88034840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:10.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.677+0000 7efd9e7fc700 1 -- 172.21.15.167:0/4119146427 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3721+0+0 (secure 0 0 0) 0x7efd98043f60 con 0x7efda810d960 2023-10-05T19:50:10.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.677+0000 7efda5d9b700 1 --2- 172.21.15.167:0/4119146427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd88032390 0x7efd88034840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:10.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.677+0000 7efda5d9b700 1 --2- 172.21.15.167:0/4119146427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd88032390 0x7efd88034840 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd90009fd0 tx=0x7efd90016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:10.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.685+0000 7efd9e7fc700 1 -- 172.21.15.167:0/4119146427 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7efd9801a950 con 0x7efda810d960 2023-10-05T19:50:10.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:10.849+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7efda8111780 con 0x7efda810d960 2023-10-05T19:50:12.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.541+0000 7efd9e7fc700 1 -- 172.21.15.167:0/4119146427 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v18) v1 ==== 227+0+0 (secure 0 0 0) 0x7efd9801a360 con 0x7efda810d960 2023-10-05T19:50:12.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.545+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd88032390 msgr2=0x7efd88034840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:12.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.549+0000 7efda759e700 1 --2- 172.21.15.167:0/4119146427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd88032390 0x7efd88034840 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd90009fd0 tx=0x7efd90016000 comp rx=0 tx=0).stop 2023-10-05T19:50:12.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.549+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda810d960 msgr2=0x7efda811cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:12.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.549+0000 7efda759e700 1 --2- 172.21.15.167:0/4119146427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda810d960 0x7efda811cc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd9800cbb0 tx=0x7efd98001ae0 comp rx=0 tx=0).stop 2023-10-05T19:50:12.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.549+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 shutdown_connections 2023-10-05T19:50:12.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.549+0000 7efda759e700 1 --2- 172.21.15.167:0/4119146427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd88032390 0x7efd88034840 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:12.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.549+0000 7efda759e700 1 --2- 172.21.15.167:0/4119146427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efda810d960 0x7efda811cc00 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd9800cbb0 tx=0x7efd98001ae0 comp rx=0 tx=0).stop 2023-10-05T19:50:12.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.549+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 >> 172.21.15.167:0/4119146427 conn(0x7efda806b120 msgr2=0x7efda810ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:12.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.549+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 shutdown_connections 2023-10-05T19:50:12.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.553+0000 7efda759e700 1 -- 172.21.15.167:0/4119146427 wait complete. 2023-10-05T19:50:12.563 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'default.rgw.buckets.data' created 2023-10-05T19:50:12.581 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2023-10-05T19:50:12.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.669+0000 7f2b2359e700 1 Processor -- start 2023-10-05T19:50:12.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.669+0000 7f2b2359e700 1 -- start start 2023-10-05T19:50:12.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.669+0000 7f2b2359e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2b2410ea30 0x7f2b2410ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:12.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.669+0000 7f2b2359e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2410f3f0 con 0x7f2b24108d70 2023-10-05T19:50:12.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.669+0000 7f2b2359e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2404c3e0 con 0x7f2b2410ea30 2023-10-05T19:50:12.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.669+0000 7f2b2259c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2b2410ea30 0x7f2b2410ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:12.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.669+0000 7f2b21d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2b24108d70 0x7f2b24109210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51176/0 (socket says 172.21.15.167:51176) 2023-10-05T19:50:12.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.669+0000 7f2b21d9b700 1 -- 172.21.15.167:0/3712825411 learned_addr learned my addr 172.21.15.167:0/3712825411 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:12.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2259c700 1 -- 172.21.15.167:0/3712825411 >> v1:172.21.15.118:6789/0 conn(0x7f2b24108d70 legacy=0x7f2b24109210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:12.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2159a700 1 -- 172.21.15.167:0/3712825411 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789274804 0 0) 0x7f2b2410f3f0 con 0x7f2b24108d70 2023-10-05T19:50:12.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2259c700 1 -- 172.21.15.167:0/3712825411 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24109920 con 0x7f2b2410ea30 2023-10-05T19:50:12.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2259c700 1 --2- 172.21.15.167:0/3712825411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b2410ea30 0x7f2b2410ee20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009860 tx=0x7f2b0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d86ef4fd577df89 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:12.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2159a700 1 -- 172.21.15.167:0/3712825411 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c00b680 con 0x7f2b2410ea30 2023-10-05T19:50:12.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2159a700 1 -- 172.21.15.167:0/3712825411 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c00b7e0 con 0x7f2b2410ea30 2023-10-05T19:50:12.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2159a700 1 -- 172.21.15.167:0/3712825411 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c00b990 con 0x7f2b2410ea30 2023-10-05T19:50:12.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2359e700 1 -- 172.21.15.167:0/3712825411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b2410ea30 msgr2=0x7f2b2410ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:12.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2359e700 1 --2- 172.21.15.167:0/3712825411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b2410ea30 0x7f2b2410ee20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009860 tx=0x7f2b0c0091a0 comp rx=0 tx=0).stop 2023-10-05T19:50:12.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2359e700 1 -- 172.21.15.167:0/3712825411 shutdown_connections 2023-10-05T19:50:12.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2359e700 1 --2- 172.21.15.167:0/3712825411 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b2410ea30 0x7f2b2410ee20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:12.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2359e700 1 -- 172.21.15.167:0/3712825411 >> 172.21.15.167:0/3712825411 conn(0x7f2b2406b160 msgr2=0x7f2b2406d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:12.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2359e700 1 -- 172.21.15.167:0/3712825411 shutdown_connections 2023-10-05T19:50:12.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.673+0000 7f2b2359e700 1 -- 172.21.15.167:0/3712825411 wait complete. 2023-10-05T19:50:12.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2359e700 1 Processor -- start 2023-10-05T19:50:12.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2359e700 1 -- start start 2023-10-05T19:50:12.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2359e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b24108d70 0x7f2b2411ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:12.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2359e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2406dcf0 con 0x7f2b24108d70 2023-10-05T19:50:12.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2259c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b24108d70 0x7f2b2411ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:12.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2259c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b24108d70 0x7f2b2411ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:49610/0 (socket says 172.21.15.167:49610) 2023-10-05T19:50:12.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2259c700 1 -- 172.21.15.167:0/856695088 learned_addr learned my addr 172.21.15.167:0/856695088 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:12.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2259c700 1 -- 172.21.15.167:0/856695088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c009420 con 0x7f2b24108d70 2023-10-05T19:50:12.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2259c700 1 --2- 172.21.15.167:0/856695088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b24108d70 0x7f2b2411ef30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0091e0 tx=0x7f2b0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:12.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b1a7fc700 1 -- 172.21.15.167:0/856695088 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c01c450 con 0x7f2b24108d70 2023-10-05T19:50:12.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b1a7fc700 1 -- 172.21.15.167:0/856695088 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c01c5b0 con 0x7f2b24108d70 2023-10-05T19:50:12.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b1a7fc700 1 -- 172.21.15.167:0/856695088 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b0c01c720 con 0x7f2b24108d70 2023-10-05T19:50:12.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2411f560 con 0x7f2b24108d70 2023-10-05T19:50:12.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.677+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2411f950 con 0x7f2b24108d70 2023-10-05T19:50:12.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.681+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2405ecb0 con 0x7f2b24108d70 2023-10-05T19:50:12.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.681+0000 7f2b1a7fc700 1 -- 172.21.15.167:0/856695088 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2b0c01c990 con 0x7f2b24108d70 2023-10-05T19:50:12.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.681+0000 7f2b1a7fc700 1 --2- 172.21.15.167:0/856695088 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b04032420 0x7f2b040348d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:12.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.681+0000 7f2b1a7fc700 1 -- 172.21.15.167:0/856695088 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4196+0+0 (secure 0 0 0) 0x7f2b0c045970 con 0x7f2b24108d70 2023-10-05T19:50:12.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.681+0000 7f2b21d9b700 1 --2- 172.21.15.167:0/856695088 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b04032420 0x7f2b040348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:12.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.681+0000 7f2b21d9b700 1 --2- 172.21.15.167:0/856695088 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b04032420 0x7f2b040348d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001560 tx=0x7f2b140016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:12.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.689+0000 7f2b1a7fc700 1 -- 172.21.15.167:0/856695088 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f2b0c018350 con 0x7f2b24108d70 2023-10-05T19:50:12.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:12.849+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7f2b2410ea30 con 0x7f2b24108d70 2023-10-05T19:50:13.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.553+0000 7f2b1a7fc700 1 -- 172.21.15.167:0/856695088 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) v1 ==== 185+0+0 (secure 0 0 0) 0x7f2b0c02db40 con 0x7f2b24108d70 2023-10-05T19:50:13.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b04032420 msgr2=0x7f2b040348d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:13.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 --2- 172.21.15.167:0/856695088 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b04032420 0x7f2b040348d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001560 tx=0x7f2b140016c0 comp rx=0 tx=0).stop 2023-10-05T19:50:13.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b24108d70 msgr2=0x7f2b2411ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:13.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 --2- 172.21.15.167:0/856695088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b24108d70 0x7f2b2411ef30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0091e0 tx=0x7f2b0c016000 comp rx=0 tx=0).stop 2023-10-05T19:50:13.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 shutdown_connections 2023-10-05T19:50:13.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 --2- 172.21.15.167:0/856695088 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b04032420 0x7f2b040348d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:13.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 --2- 172.21.15.167:0/856695088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2b24108d70 0x7f2b2411ef30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:13.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 >> 172.21.15.167:0/856695088 conn(0x7f2b2406b160 msgr2=0x7f2b2410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:13.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 shutdown_connections 2023-10-05T19:50:13.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.577+0000 7f2b2359e700 1 -- 172.21.15.167:0/856695088 wait complete. 2023-10-05T19:50:13.585 INFO:teuthology.orchestra.run.smithi167.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-10-05T19:50:13.595 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2023-10-05T19:50:13.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.729+0000 7f9552aa5700 1 Processor -- start 2023-10-05T19:50:13.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.729+0000 7f9552aa5700 1 -- start start 2023-10-05T19:50:13.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.729+0000 7f9552aa5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f954c112040 0x7f954c114420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:13.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.729+0000 7f9552aa5700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c114960 con 0x7f954c10a0b0 2023-10-05T19:50:13.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.729+0000 7f9552aa5700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c04c3e0 con 0x7f954c112040 2023-10-05T19:50:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.729+0000 7f95512a2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f954c112040 0x7f954c114420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.729+0000 7f95512a2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f954c112040 0x7f954c114420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:49614/0 (socket says 172.21.15.167:49614) 2023-10-05T19:50:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.729+0000 7f95512a2700 1 -- 172.21.15.167:0/597920352 learned_addr learned my addr 172.21.15.167:0/597920352 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.729+0000 7f9551aa3700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f954c10a0b0 0x7f954c10a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51186/0 (socket says 172.21.15.167:51186) 2023-10-05T19:50:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f95512a2700 1 -- 172.21.15.167:0/597920352 >> v1:172.21.15.118:6789/0 conn(0x7f954c10a0b0 legacy=0x7f954c10a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f95512a2700 1 -- 172.21.15.167:0/597920352 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c115b00 con 0x7f954c112040 2023-10-05T19:50:13.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f95512a2700 1 --2- 172.21.15.167:0/597920352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c112040 0x7f954c114420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9548009930 tx=0x7f9548009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5575f44010f96a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:13.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9550aa1700 1 -- 172.21.15.167:0/597920352 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954800b860 con 0x7f954c112040 2023-10-05T19:50:13.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9550aa1700 1 -- 172.21.15.167:0/597920352 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954800b9c0 con 0x7f954c112040 2023-10-05T19:50:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9550aa1700 1 -- 172.21.15.167:0/597920352 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954800bb50 con 0x7f954c112040 2023-10-05T19:50:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 -- 172.21.15.167:0/597920352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c112040 msgr2=0x7f954c114420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 --2- 172.21.15.167:0/597920352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c112040 0x7f954c114420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9548009930 tx=0x7f9548009250 comp rx=0 tx=0).stop 2023-10-05T19:50:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 -- 172.21.15.167:0/597920352 shutdown_connections 2023-10-05T19:50:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 --2- 172.21.15.167:0/597920352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c112040 0x7f954c114420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 -- 172.21.15.167:0/597920352 >> 172.21.15.167:0/597920352 conn(0x7f954c06b170 msgr2=0x7f954c06d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 -- 172.21.15.167:0/597920352 shutdown_connections 2023-10-05T19:50:13.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 -- 172.21.15.167:0/597920352 wait complete. 2023-10-05T19:50:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 Processor -- start 2023-10-05T19:50:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 -- start start 2023-10-05T19:50:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c10a0b0 0x7f954c121230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9552aa5700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c113bb0 con 0x7f954c10a0b0 2023-10-05T19:50:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.733+0000 7f9551aa3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c10a0b0 0x7f954c121230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f9551aa3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c10a0b0 0x7f954c121230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:49628/0 (socket says 172.21.15.167:49628) 2023-10-05T19:50:13.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f9551aa3700 1 -- 172.21.15.167:0/112254961 learned_addr learned my addr 172.21.15.167:0/112254961 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f9551aa3700 1 -- 172.21.15.167:0/112254961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95480094f0 con 0x7f954c10a0b0 2023-10-05T19:50:13.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f9551aa3700 1 --2- 172.21.15.167:0/112254961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c10a0b0 0x7f954c121230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f954000c690 tx=0x7f9540007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f953dffb700 1 -- 172.21.15.167:0/112254961 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9540005b90 con 0x7f954c10a0b0 2023-10-05T19:50:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f953dffb700 1 -- 172.21.15.167:0/112254961 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9540005cf0 con 0x7f954c10a0b0 2023-10-05T19:50:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c1218c0 con 0x7f954c10a0b0 2023-10-05T19:50:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f953dffb700 1 -- 172.21.15.167:0/112254961 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95400070d0 con 0x7f954c10a0b0 2023-10-05T19:50:13.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c121d90 con 0x7f954c10a0b0 2023-10-05T19:50:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f953dffb700 1 -- 172.21.15.167:0/112254961 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9540007230 con 0x7f954c10a0b0 2023-10-05T19:50:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f953dffb700 1 --2- 172.21.15.167:0/112254961 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f95300323e0 0x7f9530034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f953dffb700 1 -- 172.21.15.167:0/112254961 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4207+0+0 (secure 0 0 0) 0x7f95400431c0 con 0x7f954c10a0b0 2023-10-05T19:50:13.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f95512a2700 1 --2- 172.21.15.167:0/112254961 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f95300323e0 0x7f9530034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.737+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c0050b0 con 0x7f954c10a0b0 2023-10-05T19:50:13.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.741+0000 7f95512a2700 1 --2- 172.21.15.167:0/112254961 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f95300323e0 0x7f9530034890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9548009930 tx=0x7f9548016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:13.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.749+0000 7f953dffb700 1 -- 172.21.15.167:0/112254961 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f954000fc70 con 0x7f954c10a0b0 2023-10-05T19:50:13.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:13.925+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f952c0058e0 con 0x7f954c10a0b0 2023-10-05T19:50:14.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.561+0000 7f953dffb700 1 -- 172.21.15.167:0/112254961 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9540017020 con 0x7f954c10a0b0 2023-10-05T19:50:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f95300323e0 msgr2=0x7f9530034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 --2- 172.21.15.167:0/112254961 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f95300323e0 0x7f9530034890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9548009930 tx=0x7f9548016000 comp rx=0 tx=0).stop 2023-10-05T19:50:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c10a0b0 msgr2=0x7f954c121230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 --2- 172.21.15.167:0/112254961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c10a0b0 0x7f954c121230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f954000c690 tx=0x7f9540007f40 comp rx=0 tx=0).stop 2023-10-05T19:50:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 shutdown_connections 2023-10-05T19:50:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 --2- 172.21.15.167:0/112254961 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f95300323e0 0x7f9530034890 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 --2- 172.21.15.167:0/112254961 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f954c10a0b0 0x7f954c121230 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 >> 172.21.15.167:0/112254961 conn(0x7f954c06b170 msgr2=0x7f954c06b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:14.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 shutdown_connections 2023-10-05T19:50:14.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.573+0000 7f9552aa5700 1 -- 172.21.15.167:0/112254961 wait complete. 2023-10-05T19:50:14.584 INFO:teuthology.orchestra.run.smithi167.stderr:pool 'default.rgw.buckets.index' created 2023-10-05T19:50:14.596 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2023-10-05T19:50:14.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f7070d9b700 1 Processor -- start 2023-10-05T19:50:14.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f7070d9b700 1 -- start start 2023-10-05T19:50:14.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f7070d9b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f706c1116b0 0x7f706c113a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:14.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f7070d9b700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c113fd0 con 0x7f706c10ea30 2023-10-05T19:50:14.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f7070d9b700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c04c3e0 con 0x7f706c1116b0 2023-10-05T19:50:14.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f706affd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f706c1116b0 0x7f706c113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:14.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f706affd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f706c1116b0 0x7f706c113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:49640/0 (socket says 172.21.15.167:49640) 2023-10-05T19:50:14.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f706affd700 1 -- 172.21.15.167:0/2013065520 learned_addr learned my addr 172.21.15.167:0/2013065520 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:14.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f706affd700 1 -- 172.21.15.167:0/2013065520 >> v1:172.21.15.118:6789/0 conn(0x7f706c10ea30 legacy=0x7f706c10ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:14.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f706affd700 1 -- 172.21.15.167:0/2013065520 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c115170 con 0x7f706c1116b0 2023-10-05T19:50:14.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f706affd700 1 --2- 172.21.15.167:0/2013065520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c1116b0 0x7f706c113a90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f705c00aad0 tx=0x7f705c00a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29e362c5777d6e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:14.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f706a7fc700 1 -- 172.21.15.167:0/2013065520 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f705c00ca40 con 0x7f706c1116b0 2023-10-05T19:50:14.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f706a7fc700 1 -- 172.21.15.167:0/2013065520 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c00cba0 con 0x7f706c1116b0 2023-10-05T19:50:14.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.681+0000 7f706a7fc700 1 -- 172.21.15.167:0/2013065520 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f705c00cd30 con 0x7f706c1116b0 2023-10-05T19:50:14.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 -- 172.21.15.167:0/2013065520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c1116b0 msgr2=0x7f706c113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:14.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 --2- 172.21.15.167:0/2013065520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c1116b0 0x7f706c113a90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f705c00aad0 tx=0x7f705c00a3f0 comp rx=0 tx=0).stop 2023-10-05T19:50:14.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 -- 172.21.15.167:0/2013065520 shutdown_connections 2023-10-05T19:50:14.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 --2- 172.21.15.167:0/2013065520 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c1116b0 0x7f706c113a90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:14.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 -- 172.21.15.167:0/2013065520 >> 172.21.15.167:0/2013065520 conn(0x7f706c06b160 msgr2=0x7f706c06d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:14.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 -- 172.21.15.167:0/2013065520 shutdown_connections 2023-10-05T19:50:14.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 -- 172.21.15.167:0/2013065520 wait complete. 2023-10-05T19:50:14.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 Processor -- start 2023-10-05T19:50:14.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 -- start start 2023-10-05T19:50:14.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c10ea30 0x7f706c11f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:14.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f7070d9b700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c113c90 con 0x7f706c10ea30 2023-10-05T19:50:14.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f706b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c10ea30 0x7f706c11f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:14.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f706b7fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c10ea30 0x7f706c11f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:49646/0 (socket says 172.21.15.167:49646) 2023-10-05T19:50:14.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.685+0000 7f706b7fe700 1 -- 172.21.15.167:0/608293824 learned_addr learned my addr 172.21.15.167:0/608293824 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:14.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f706b7fe700 1 -- 172.21.15.167:0/608293824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c00a690 con 0x7f706c10ea30 2023-10-05T19:50:14.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f706b7fe700 1 --2- 172.21.15.167:0/608293824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c10ea30 0x7f706c11f050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f706000c490 tx=0x7f7060007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:14.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f70537fe700 1 -- 172.21.15.167:0/608293824 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7060011590 con 0x7f706c10ea30 2023-10-05T19:50:14.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f70537fe700 1 -- 172.21.15.167:0/608293824 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70600116f0 con 0x7f706c10ea30 2023-10-05T19:50:14.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c11f6e0 con 0x7f706c10ea30 2023-10-05T19:50:14.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f70537fe700 1 -- 172.21.15.167:0/608293824 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70600119e0 con 0x7f706c10ea30 2023-10-05T19:50:14.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c11fbb0 con 0x7f706c10ea30 2023-10-05T19:50:14.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c05ecb0 con 0x7f706c10ea30 2023-10-05T19:50:14.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f70537fe700 1 -- 172.21.15.167:0/608293824 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7060011b40 con 0x7f706c10ea30 2023-10-05T19:50:14.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.689+0000 7f70537fe700 1 --2- 172.21.15.167:0/608293824 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70580323d0 0x7f7058034880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:14.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.693+0000 7f70537fe700 1 -- 172.21.15.167:0/608293824 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4571+0+0 (secure 0 0 0) 0x7f7060043270 con 0x7f706c10ea30 2023-10-05T19:50:14.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.693+0000 7f706affd700 1 --2- 172.21.15.167:0/608293824 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70580323d0 0x7f7058034880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:14.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.693+0000 7f706affd700 1 --2- 172.21.15.167:0/608293824 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70580323d0 0x7f7058034880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f705c00aad0 tx=0x7f705c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:14.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.701+0000 7f70537fe700 1 -- 172.21.15.167:0/608293824 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f7060019b20 con 0x7f706c10ea30 2023-10-05T19:50:14.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:14.861+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f706c111740 con 0x7f706c10ea30 2023-10-05T19:50:15.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.569+0000 7f70537fe700 1 -- 172.21.15.167:0/608293824 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) v1 ==== 187+0+0 (secure 0 0 0) 0x7f7060019730 con 0x7f706c10ea30 2023-10-05T19:50:15.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70580323d0 msgr2=0x7f7058034880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:15.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 --2- 172.21.15.167:0/608293824 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70580323d0 0x7f7058034880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f705c00aad0 tx=0x7f705c019000 comp rx=0 tx=0).stop 2023-10-05T19:50:15.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c10ea30 msgr2=0x7f706c11f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:15.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 --2- 172.21.15.167:0/608293824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c10ea30 0x7f706c11f050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f706000c490 tx=0x7f7060007f10 comp rx=0 tx=0).stop 2023-10-05T19:50:15.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 shutdown_connections 2023-10-05T19:50:15.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 --2- 172.21.15.167:0/608293824 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f70580323d0 0x7f7058034880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:15.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 --2- 172.21.15.167:0/608293824 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f706c10ea30 0x7f706c11f050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:15.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 >> 172.21.15.167:0/608293824 conn(0x7f706c06b160 msgr2=0x7f706c06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:15.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 shutdown_connections 2023-10-05T19:50:15.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:15.585+0000 7f7070d9b700 1 -- 172.21.15.167:0/608293824 wait complete. 2023-10-05T19:50:15.596 INFO:teuthology.orchestra.run.smithi167.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-10-05T19:50:15.607 DEBUG:tasks.rgw:Pools created 2023-10-05T19:50:15.608 INFO:tasks.rgw:Starting rgw... 2023-10-05T19:50:15.608 INFO:tasks.rgw:rgw client.0 config is {} 2023-10-05T19:50:15.608 INFO:tasks.rgw:Using beast as radosgw frontend 2023-10-05T19:50:15.608 INFO:tasks.rgw.client.0:Restarting daemon 2023-10-05T19:50:15.608 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2023-10-05T19:50:15.610 INFO:tasks.rgw.client.0:Started 2023-10-05T19:50:15.610 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi167.front.sepia.ceph.com:80/ 2023-10-05T19:50:15.610 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2023-10-05T19:50:15.655 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T19:50:15.655 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2023-10-05T19:50:15.658 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T19:50:15.658 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-10-05T19:50:15.658 INFO:teuthology.orchestra.run.smithi167.stderr:curl: (7) Failed to connect to smithi167.front.sepia.ceph.com port 80: Connection refused 2023-10-05T19:50:16.659 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2023-10-05T19:50:16.676 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T19:50:16.677 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2023-10-05T19:50:16.677 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T19:50:16.678 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-10-05T19:50:16.678 INFO:teuthology.orchestra.run.smithi167.stderr:curl: (7) Failed to connect to smithi167.front.sepia.ceph.com port 80: Connection refused 2023-10-05T19:50:18.680 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2023-10-05T19:50:18.696 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T19:50:18.697 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2023-10-05T19:50:18.697 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-10-05T19:50:18.697 INFO:teuthology.orchestra.run.smithi167.stderr:curl: (7) Failed to connect to smithi167.front.sepia.ceph.com port 80: Connection refused 2023-10-05T19:50:18.698 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T19:50:22.698 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2023-10-05T19:50:22.715 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T19:50:22.716 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T19:50:22.716 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2023-10-05T19:50:22.716 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-10-05T19:50:22.716 INFO:teuthology.orchestra.run.smithi167.stderr:curl: (7) Failed to connect to smithi167.front.sepia.ceph.com port 80: Connection refused 2023-10-05T19:50:30.717 DEBUG:teuthology.orchestra.run.smithi167:> curl http://smithi167.front.sepia.ceph.com:80/ 2023-10-05T19:50:30.733 INFO:teuthology.orchestra.run.smithi167.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T19:50:30.733 INFO:teuthology.orchestra.run.smithi167.stderr: Dload Upload Total Spent Left Speed 2023-10-05T19:50:30.754 INFO:teuthology.orchestra.run.smithi167.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 10700 0 --:--:-- --:--:-- --:--:-- 10700 2023-10-05T19:50:30.755 INFO:teuthology.orchestra.run.smithi167.stdout:anonymous 2023-10-05T19:50:30.755 INFO:teuthology.run_tasks:Running task radosgw-admin... 2023-10-05T19:50:30.842 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2023-10-05T19:50:30.842 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2023-10-05T19:50:30.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2023-10-05T19:50:30.843 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2023-10-05T19:50:30.883 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:30.883 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:30.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5b25ebe40 1 Processor -- start 2023-10-05T19:50:30.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5b25ebe40 1 -- start start 2023-10-05T19:50:30.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5b25ebe40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ca04fa1aa0 0x55ca05035a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5b25ebe40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ca04f79c00 con 0x55ca04fa2db0 2023-10-05T19:50:30.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5b25ebe40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ca04f36ee0 con 0x55ca04fa1aa0 2023-10-05T19:50:30.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5af91f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ca04fa1aa0 0x55ca05035a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5b0120700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55ca04fa2db0 0x55ca04fa1390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39780/0 (socket says 172.21.15.167:39780) 2023-10-05T19:50:30.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5af91f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ca04fa1aa0 0x55ca05035a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46482/0 (socket says 172.21.15.167:46482) 2023-10-05T19:50:30.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5b0120700 1 -- 172.21.15.167:0/1063800634 learned_addr learned my addr 172.21.15.167:0/1063800634 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:30.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5af91f700 1 -- 172.21.15.167:0/1063800634 >> v1:172.21.15.118:6789/0 conn(0x55ca04fa2db0 legacy=0x55ca04fa1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:30.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.877+0000 7fb5af91f700 1 -- 172.21.15.167:0/1063800634 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca04fa3240 con 0x55ca04fa1aa0 2023-10-05T19:50:30.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5af91f700 1 --2- 172.21.15.167:0/1063800634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca05035a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb59800a5d0 tx=0x7fb598005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bbbcc251df8fc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5af11e700 1 -- 172.21.15.167:0/1063800634 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5980086a0 con 0x55ca04fa1aa0 2023-10-05T19:50:30.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5af11e700 1 -- 172.21.15.167:0/1063800634 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb598008800 con 0x55ca04fa1aa0 2023-10-05T19:50:30.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5af11e700 1 -- 172.21.15.167:0/1063800634 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb598008ad0 con 0x55ca04fa1aa0 2023-10-05T19:50:30.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1063800634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 msgr2=0x55ca05035a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:30.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/1063800634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca05035a40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb59800a5d0 tx=0x7fb598005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:30.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1063800634 shutdown_connections 2023-10-05T19:50:30.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/1063800634 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca05035a40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:30.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1063800634 >> 172.21.15.167:0/1063800634 conn(0x55ca05028330 msgr2=0x55ca0502a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:30.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1063800634 shutdown_connections 2023-10-05T19:50:30.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1063800634 wait complete. 2023-10-05T19:50:30.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 Processor -- start 2023-10-05T19:50:30.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 -- start start 2023-10-05T19:50:30.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca0504dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b25ebe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca04efae30 con 0x55ca04fa1aa0 2023-10-05T19:50:30.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b0120700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca0504dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b0120700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca0504dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46484/0 (socket says 172.21.15.167:46484) 2023-10-05T19:50:30.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b0120700 1 -- 172.21.15.167:0/630587052 learned_addr learned my addr 172.21.15.167:0/630587052 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:30.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b0120700 1 -- 172.21.15.167:0/630587052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598005cf0 con 0x55ca04fa1aa0 2023-10-05T19:50:30.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.881+0000 7fb5b0120700 1 --2- 172.21.15.167:0/630587052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca0504dbb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00014a0 tx=0x7fb5a0006b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388aadf94f1db3eb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5ae11c700 1 -- 172.21.15.167:0/630587052 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5a0006110 con 0x55ca04fa1aa0 2023-10-05T19:50:30.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5ae11c700 1 -- 172.21.15.167:0/630587052 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0006270 con 0x55ca04fa1aa0 2023-10-05T19:50:30.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5ae11c700 1 -- 172.21.15.167:0/630587052 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5a0004520 con 0x55ca04fa1aa0 2023-10-05T19:50:30.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/630587052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 msgr2=0x55ca0504dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:30.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/630587052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca0504dbb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00014a0 tx=0x7fb5a0006b90 comp rx=0 tx=0).stop 2023-10-05T19:50:30.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/630587052 shutdown_connections 2023-10-05T19:50:30.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/630587052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca0504dbb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:30.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/630587052 >> 172.21.15.167:0/630587052 conn(0x55ca05028330 msgr2=0x55ca05049770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:30.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/630587052 shutdown_connections 2023-10-05T19:50:30.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/630587052 wait complete. 2023-10-05T19:50:30.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 Processor -- start 2023-10-05T19:50:30.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 -- start start 2023-10-05T19:50:30.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca05054990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b25ebe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca04ecded0 con 0x55ca04fa1aa0 2023-10-05T19:50:30.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.885+0000 7fb5b0120700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca05054990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5b0120700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca05054990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46488/0 (socket says 172.21.15.167:46488) 2023-10-05T19:50:30.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 learned_addr learned my addr 172.21.15.167:0/3861236326 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:30.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca04f79c00 con 0x55ca04fa1aa0 2023-10-05T19:50:30.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5b0120700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca05054990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55ca0504a290 tx=0x7fb5a0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5ac919700 1 -- 172.21.15.167:0/3861236326 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5a0013630 con 0x55ca04fa1aa0 2023-10-05T19:50:30.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5ac919700 1 -- 172.21.15.167:0/3861236326 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0013790 con 0x55ca04fa1aa0 2023-10-05T19:50:30.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca05054ed0 con 0x55ca04fa1aa0 2023-10-05T19:50:30.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5ac919700 1 -- 172.21.15.167:0/3861236326 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5a0013a40 con 0x55ca04fa1aa0 2023-10-05T19:50:30.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca05055310 con 0x55ca04fa1aa0 2023-10-05T19:50:30.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.889+0000 7fb5ac919700 1 -- 172.21.15.167:0/3861236326 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fb5a0013c30 con 0x55ca04fa1aa0 2023-10-05T19:50:30.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5ac919700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb590030c90 0x7fb590033140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5ac919700 1 -- 172.21.15.167:0/3861236326 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fb5a0045130 con 0x55ca04fa1aa0 2023-10-05T19:50:30.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5af91f700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb590030c90 0x7fb590033140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca04fa2db0 0x55ca05060420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05060b20 con 0x55ca04fa2db0 2023-10-05T19:50:30.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b0921700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca04fa2db0 0x55ca05060420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5af91f700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb590030c90 0x7fb590033140 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb598005a90 tx=0x7fb598015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b0921700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca04fa2db0 0x55ca05060420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5a800a500 con 0x55ca04fa2db0 2023-10-05T19:50:30.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 20 realm 2023-10-05T19:50:30.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0505da80 con 0x55ca04fa2db0 2023-10-05T19:50:30.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5a800a500 con 0x55ca04fa2db0 2023-10-05T19:50:30.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:30.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05061600 con 0x55ca04fa2db0 2023-10-05T19:50:30.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5a800a500 con 0x55ca04fa2db0 2023-10-05T19:50:30.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.893+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca05061230 0x55ca05064470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05064ba0 con 0x55ca05061230 2023-10-05T19:50:30.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b0120700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca05061230 0x55ca05064470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b0120700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca05061230 0x55ca05064470 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b25ebe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:30.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05065470 con 0x55ca04fa2db0 2023-10-05T19:50:30.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb5a800a500 con 0x55ca04fa2db0 2023-10-05T19:50:30.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b25ebe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:30.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b25ebe40 20 searching for the correct realm 2023-10-05T19:50:30.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca05064fe0 0x55ca05069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05064fe0 2023-10-05T19:50:30.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5af91f700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca05064fe0 0x55ca05069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.897+0000 7fb5af91f700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca05064fe0 0x55ca05069240 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05061230 2023-10-05T19:50:30.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0120700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb5a001d350 0x7fb5a00421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x7fb5a001d350 2023-10-05T19:50:30.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0921700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb5a001d350 0x7fb5a00421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0921700 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb5a001d350 0x7fb5a00421a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x7fb5a001d350 2023-10-05T19:50:30.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05064fe0 2023-10-05T19:50:30.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.901+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05061230 2023-10-05T19:50:30.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05061230 2023-10-05T19:50:30.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x7fb5a001d350 2023-10-05T19:50:30.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x7fb5a001d350 2023-10-05T19:50:30.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x7fb5a001d350 2023-10-05T19:50:30.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x7fb5a001d350 2023-10-05T19:50:30.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.905+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05061230 2023-10-05T19:50:30.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05064fe0 2023-10-05T19:50:30.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05061230 2023-10-05T19:50:30.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05064fe0 2023-10-05T19:50:30.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.909+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05064fe0 2023-10-05T19:50:30.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x7fb5a001d350 2023-10-05T19:50:30.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x7fb5a001d350 2023-10-05T19:50:30.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca04fa2db0 2023-10-05T19:50:30.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x7fb5a001d350 2023-10-05T19:50:30.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x7fb5a001d350 2023-10-05T19:50:30.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05064fe0 2023-10-05T19:50:30.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.913+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x7fb5a001d350 2023-10-05T19:50:30.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x7fb5a001d350 2023-10-05T19:50:30.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05061230 2023-10-05T19:50:30.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05061230 2023-10-05T19:50:30.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05064fe0 2023-10-05T19:50:30.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05061230 2023-10-05T19:50:30.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.917+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05069820 con 0x55ca05061230 2023-10-05T19:50:30.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:30.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:30.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:30.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:30.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05065fe0 con 0x55ca04fa2db0 2023-10-05T19:50:30.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05066960 con 0x55ca05061230 2023-10-05T19:50:30.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:30.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05065bd0 con 0x55ca05061230 2023-10-05T19:50:30.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:30.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.921+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a1d0 con 0x55ca05064fe0 2023-10-05T19:50:30.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a930 con 0x55ca05061230 2023-10-05T19:50:30.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b25ebe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:30.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506bcf0 con 0x55ca05064fe0 2023-10-05T19:50:30.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506bcf0 con 0x55ca05061230 2023-10-05T19:50:30.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.925+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506bcf0 con 0x7fb5a001d350 2023-10-05T19:50:30.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x7fb5a001d350 2023-10-05T19:50:30.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05064fe0 2023-10-05T19:50:30.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05061230 2023-10-05T19:50:30.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.929+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05061230 2023-10-05T19:50:30.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x7fb5a001d350 2023-10-05T19:50:30.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x7fb5a001d350 2023-10-05T19:50:30.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x7fb5a001d350 2023-10-05T19:50:30.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x7fb5a001d350 2023-10-05T19:50:30.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05061230 2023-10-05T19:50:30.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.933+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05064fe0 2023-10-05T19:50:30.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05061230 2023-10-05T19:50:30.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05064fe0 2023-10-05T19:50:30.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8014040 con 0x55ca04fa2db0 2023-10-05T19:50:30.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.937+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05064fe0 2023-10-05T19:50:30.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x7fb5a001d350 2023-10-05T19:50:30.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca04fa2db0 2023-10-05T19:50:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x7fb5a001d350 2023-10-05T19:50:30.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05064fe0 2023-10-05T19:50:30.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x7fb5a001d350 2023-10-05T19:50:30.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.941+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05061230 2023-10-05T19:50:30.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05061230 2023-10-05T19:50:30.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05064fe0 2023-10-05T19:50:30.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05061230 2023-10-05T19:50:30.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506a580 con 0x55ca05061230 2023-10-05T19:50:30.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b25ebe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:30.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b25ebe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:30.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b25ebe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:30.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b25ebe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:30.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.945+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506ace0 con 0x55ca05061230 2023-10-05T19:50:30.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b25ebe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:30.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:30.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b25ebe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:30.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b930 con 0x55ca05061230 2023-10-05T19:50:30.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b25ebe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:30.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.949+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506bce0 con 0x55ca05061230 2023-10-05T19:50:30.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:30.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506bce0 con 0x7fb5a001d350 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 zone default found 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 4 Realm: () 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 zonegroup default 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506bce0 con 0x7fb5a001d350 2023-10-05T19:50:30.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506d660 con 0x55ca05064fe0 2023-10-05T19:50:30.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:30.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506da10 con 0x55ca05064fe0 2023-10-05T19:50:30.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:30.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 started sync module instance, tier type = 2023-10-05T19:50:30.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:30.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.953+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506cd20 con 0x55ca05061230 2023-10-05T19:50:30.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.957+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.957+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94326156080192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506ddc0 con 0x55ca05061230 2023-10-05T19:50:30.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.957+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506e660 con 0x55ca04fa2db0 2023-10-05T19:50:30.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.961+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.961+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94326156090816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506e7c0 con 0x55ca04fa2db0 2023-10-05T19:50:30.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.961+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94326156080192] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.961+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506ee50 con 0x55ca05061230 2023-10-05T19:50:30.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.961+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94326156090816] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.961+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.961+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94326156087552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506e740 con 0x55ca05061230 2023-10-05T19:50:30.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.961+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506f740 con 0x7fb5a001d350 2023-10-05T19:50:30.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.965+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.965+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94326156096080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506fb90 con 0x7fb5a001d350 2023-10-05T19:50:30.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.965+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca050705a0 con 0x55ca05061230 2023-10-05T19:50:30.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.965+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94326156087552] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.965+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94326156096080] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.965+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.965+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94326156097184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506faf0 con 0x55ca05061230 2023-10-05T19:50:30.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.965+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05070a90 con 0x55ca05064fe0 2023-10-05T19:50:30.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94326156101024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05071330 con 0x55ca05064fe0 2023-10-05T19:50:30.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05071d40 con 0x55ca05064fe0 2023-10-05T19:50:30.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94326156097184] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94326156101024] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94326156105808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05072140 con 0x55ca05064fe0 2023-10-05T19:50:30.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca050729e0 con 0x7fb5a001d350 2023-10-05T19:50:30.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94326156109600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca050730e0 con 0x7fb5a001d350 2023-10-05T19:50:30.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 20 add_watcher() i=0 2023-10-05T19:50:30.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 20 add_watcher() i=1 2023-10-05T19:50:30.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 20 add_watcher() i=2 2023-10-05T19:50:30.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 20 add_watcher() i=3 2023-10-05T19:50:30.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 20 add_watcher() i=4 2023-10-05T19:50:30.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.969+0000 7fb5b25ebe40 20 add_watcher() i=5 2023-10-05T19:50:30.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94326156105808] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb598008ae0 con 0x55ca05064fe0 2023-10-05T19:50:30.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb5b25ebe40 20 add_watcher() i=6 2023-10-05T19:50:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94326156109600] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb5b25ebe40 20 add_watcher() i=7 2023-10-05T19:50:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb5b25ebe40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca050700b0 con 0x55ca04fa2db0 2023-10-05T19:50:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94326156110768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05073600 con 0x55ca04fa2db0 2023-10-05T19:50:30.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94326156110768] v30'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.973+0000 7fb581fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:30.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:30.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:30.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 Processor -- start 2023-10-05T19:50:30.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 -- start start 2023-10-05T19:50:30.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca050807b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca05080cf0 con 0x55ca050803e0 2023-10-05T19:50:30.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5af91f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca050807b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5af91f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca050807b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46504/0 (socket says 172.21.15.167:46504) 2023-10-05T19:50:30.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5af91f700 1 -- 172.21.15.167:0/1813155932 learned_addr learned my addr 172.21.15.167:0/1813155932 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:30.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5af91f700 1 -- 172.21.15.167:0/1813155932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca05080e30 con 0x55ca050803e0 2023-10-05T19:50:30.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5af91f700 1 --2- 172.21.15.167:0/1813155932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca050807b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55ca04fa3210 tx=0x7fb598012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98786c1db25fbc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5817e2700 1 -- 172.21.15.167:0/1813155932 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb59802d040 con 0x55ca050803e0 2023-10-05T19:50:30.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5817e2700 1 -- 172.21.15.167:0/1813155932 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb598028810 con 0x55ca050803e0 2023-10-05T19:50:30.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5817e2700 1 -- 172.21.15.167:0/1813155932 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5980129e0 con 0x55ca050803e0 2023-10-05T19:50:30.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1813155932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 msgr2=0x55ca050807b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:30.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/1813155932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca050807b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55ca04fa3210 tx=0x7fb598012000 comp rx=0 tx=0).stop 2023-10-05T19:50:30.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1813155932 shutdown_connections 2023-10-05T19:50:30.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/1813155932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca050807b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:30.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1813155932 >> 172.21.15.167:0/1813155932 conn(0x55ca0507b7a0 msgr2=0x55ca05079950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:30.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1813155932 shutdown_connections 2023-10-05T19:50:30.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1813155932 wait complete. 2023-10-05T19:50:30.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.977+0000 7fb5b25ebe40 1 Processor -- start 2023-10-05T19:50:30.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5b25ebe40 1 -- start start 2023-10-05T19:50:30.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5b25ebe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca05085da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5b25ebe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca05086da0 con 0x55ca050803e0 2023-10-05T19:50:30.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5af91f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca05085da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5af91f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca05085da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46520/0 (socket says 172.21.15.167:46520) 2023-10-05T19:50:30.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5af91f700 1 -- 172.21.15.167:0/1883423087 learned_addr learned my addr 172.21.15.167:0/1883423087 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:30.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5af91f700 1 -- 172.21.15.167:0/1883423087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca04fa3240 con 0x55ca050803e0 2023-10-05T19:50:30.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5af91f700 1 --2- 172.21.15.167:0/1883423087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca05085da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb598035040 tx=0x7fb59802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb4fb7fe700 1 -- 172.21.15.167:0/1883423087 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5980338b0 con 0x55ca050803e0 2023-10-05T19:50:30.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb4fb7fe700 1 -- 172.21.15.167:0/1883423087 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59803f070 con 0x55ca050803e0 2023-10-05T19:50:30.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1883423087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca050863a0 con 0x55ca050803e0 2023-10-05T19:50:30.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb4fb7fe700 1 -- 172.21.15.167:0/1883423087 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb598033a50 con 0x55ca050803e0 2023-10-05T19:50:30.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.981+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1883423087 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca050867e0 con 0x55ca050803e0 2023-10-05T19:50:30.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb4fb7fe700 1 -- 172.21.15.167:0/1883423087 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fb598033bb0 con 0x55ca050803e0 2023-10-05T19:50:30.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb4fb7fe700 1 --2- 172.21.15.167:0/1883423087 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb4f0030c50 0x7fb4f0033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:30.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb4fb7fe700 1 -- 172.21.15.167:0/1883423087 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fb598041070 con 0x55ca050803e0 2023-10-05T19:50:30.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb5b25ebe40 5 note: GC not initialized 2023-10-05T19:50:30.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb5b0921700 1 --2- 172.21.15.167:0/1883423087 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb4f0030c50 0x7fb4f0033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:30.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb5b0921700 1 --2- 172.21.15.167:0/1883423087 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb4f0030c50 0x7fb4f0033100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x55ca05073070 tx=0x7fb5a800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:30.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb4f8ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:30.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb4ee7fc700 20 reqs_thread_entry: start 2023-10-05T19:50:30.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb5b25ebe40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:30.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.985+0000 7fb5b25ebe40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:30.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb4ecff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:01 2023 2023-10-05T19:50:30.994 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:30.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb4d3fff700 20 reqs_thread_entry: start 2023-10-05T19:50:30.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:102 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca050ee000 con 0x55ca05064fe0 2023-10-05T19:50:30.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(102 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:30.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05072140 con 0x55ca05061230 2023-10-05T19:50:30.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(103 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b930 con 0x55ca04fa2db0 2023-10-05T19:50:30.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:30.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(105 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x7fb5a001d350 2023-10-05T19:50:30.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(106 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:30.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.989+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05061230 2023-10-05T19:50:30.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:30.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:30.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(108 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:30.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05064fe0 2023-10-05T19:50:30.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(109 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:30.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x7fb5a001d350 2023-10-05T19:50:30.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(110 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:31.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05061230 2023-10-05T19:50:31.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(111 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:31.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:31.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:31.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05064fe0 2023-10-05T19:50:31.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(113 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:31.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:114 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:31.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(114 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:31.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.993+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05064fe0 2023-10-05T19:50:31.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(115 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:31.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:116 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x7fb5a001d350 2023-10-05T19:50:31.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(116 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:31.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05064fe0 2023-10-05T19:50:31.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(117 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:31.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:31.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(118 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:31.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05061230 2023-10-05T19:50:31.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(119 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:31.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:120 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x7fb5a001d350 2023-10-05T19:50:31.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(120 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:31.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:30.997+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05061230 2023-10-05T19:50:31.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(121 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:31.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:31.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(122 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:31.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:123 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05064fe0 2023-10-05T19:50:31.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(123 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:31.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:124 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x7fb5a001d350 2023-10-05T19:50:31.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(124 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:31.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:125 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:31.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(125 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:31.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:126 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:31.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(126 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:31.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:127 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05064fe0 2023-10-05T19:50:31.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(127 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:31.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:128 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05064fe0 2023-10-05T19:50:31.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(128 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:31.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.001+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:129 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x7fb5a001d350 2023-10-05T19:50:31.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(129 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:31.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:130 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca04fa2db0 2023-10-05T19:50:31.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(130 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:31.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:131 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05061230 2023-10-05T19:50:31.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(131 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:31.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:132 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x55ca05064fe0 2023-10-05T19:50:31.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(132 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:31.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:133 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b090 con 0x7fb5a001d350 2023-10-05T19:50:31.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(133 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:31.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.005+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94326156080192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05072140 con 0x55ca05061230 2023-10-05T19:50:31.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.009+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 94326156080192] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:31.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.009+0000 7fb5b25ebe40 20 remove_watcher() i=0 2023-10-05T19:50:31.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.009+0000 7fb5b25ebe40 2 removed watcher, disabling cache 2023-10-05T19:50:31.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.009+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94326156090816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b930 con 0x55ca04fa2db0 2023-10-05T19:50:31.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.009+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 94326156090816] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:31.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.009+0000 7fb5b25ebe40 20 remove_watcher() i=1 2023-10-05T19:50:31.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.009+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94326156087552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b930 con 0x55ca05061230 2023-10-05T19:50:31.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.013+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 94326156087552] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:31.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.013+0000 7fb5b25ebe40 20 remove_watcher() i=2 2023-10-05T19:50:31.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.013+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94326156096080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b930 con 0x7fb5a001d350 2023-10-05T19:50:31.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.013+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 94326156096080] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:31.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.013+0000 7fb5b25ebe40 20 remove_watcher() i=3 2023-10-05T19:50:31.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.013+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94326156097184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b930 con 0x55ca05061230 2023-10-05T19:50:31.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.017+0000 7fb5b0120700 1 -- 172.21.15.167:0/3861236326 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 94326156097184] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a0024020 con 0x55ca05061230 2023-10-05T19:50:31.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.017+0000 7fb5b25ebe40 20 remove_watcher() i=4 2023-10-05T19:50:31.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.017+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94326156101024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506b930 con 0x55ca05064fe0 2023-10-05T19:50:31.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.021+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 94326156101024] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:31.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.021+0000 7fb5b25ebe40 20 remove_watcher() i=5 2023-10-05T19:50:31.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.021+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94326156105808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca0506f740 con 0x55ca05064fe0 2023-10-05T19:50:31.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.021+0000 7fb5af91f700 1 -- 172.21.15.167:0/3861236326 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 94326156105808] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb598039020 con 0x55ca05064fe0 2023-10-05T19:50:31.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.021+0000 7fb5b25ebe40 20 remove_watcher() i=6 2023-10-05T19:50:31.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.021+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94326156109600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca05071850 con 0x7fb5a001d350 2023-10-05T19:50:31.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.025+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 94326156109600] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x7fb5a001d350 2023-10-05T19:50:31.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.025+0000 7fb5b25ebe40 20 remove_watcher() i=7 2023-10-05T19:50:31.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.025+0000 7fb581fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:31.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.025+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94326156110768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca050af0e0 con 0x55ca04fa2db0 2023-10-05T19:50:31.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 <== osd.1 v2:172.21.15.167:6808/26775 43 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94326156110768] v30'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb5a8033040 con 0x55ca04fa2db0 2023-10-05T19:50:31.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca05061230 msgr2=0x55ca05064470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca05061230 0x55ca05064470 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca04fa2db0 msgr2=0x55ca05060420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca04fa2db0 0x55ca05060420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb5a001d350 msgr2=0x7fb5a00421a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb5a001d350 0x7fb5a00421a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca05064fe0 msgr2=0x55ca05069240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca05064fe0 0x55ca05069240 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb590030c90 msgr2=0x7fb590033140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb590030c90 0x7fb590033140 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb598005a90 tx=0x7fb598015000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b0921700 1 -- 172.21.15.167:0/3861236326 reap_dead start 2023-10-05T19:50:31.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 msgr2=0x55ca05054990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca05054990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55ca0504a290 tx=0x7fb5a0014000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 shutdown_connections 2023-10-05T19:50:31.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/3861236326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca04fa1aa0 0x55ca05054990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 >> 172.21.15.167:0/3861236326 conn(0x55ca05028330 msgr2=0x55ca050481f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 shutdown_connections 2023-10-05T19:50:31.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/3861236326 wait complete. 2023-10-05T19:50:31.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1883423087 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb4f0030c50 msgr2=0x7fb4f0033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/1883423087 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb4f0030c50 0x7fb4f0033100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x55ca05073070 tx=0x7fb5a800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:31.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1883423087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 msgr2=0x55ca05085da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/1883423087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca05085da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb598035040 tx=0x7fb59802c000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1883423087 shutdown_connections 2023-10-05T19:50:31.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/1883423087 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb4f0030c50 0x7fb4f0033100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 --2- 172.21.15.167:0/1883423087 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca050803e0 0x55ca05085da0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1883423087 >> 172.21.15.167:0/1883423087 conn(0x55ca0507b7a0 msgr2=0x55ca050798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1883423087 shutdown_connections 2023-10-05T19:50:31.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.029+0000 7fb5b25ebe40 1 -- 172.21.15.167:0/1883423087 wait complete. 2023-10-05T19:50:31.039 INFO:teuthology.orchestra.run.smithi167.stdout:[] 2023-10-05T19:50:31.042 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T19:50:31.043 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2023-10-05T19:50:31.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2023-10-05T19:50:31.043 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2023-10-05T19:50:31.130 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:31.131 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:31.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b2ce5e40 1 Processor -- start 2023-10-05T19:50:31.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b2ce5e40 1 -- start start 2023-10-05T19:50:31.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b2ce5e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5636a0e71260 0x5636a0f05a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b2ce5e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5636a0e49bd0 con 0x5636a0e72570 2023-10-05T19:50:31.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b2ce5e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5636a0e06ee0 con 0x5636a0e71260 2023-10-05T19:50:31.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b0019700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5636a0e71260 0x5636a0f05a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b0019700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5636a0e71260 0x5636a0f05a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46536/0 (socket says 172.21.15.167:46536) 2023-10-05T19:50:31.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b0019700 1 -- 172.21.15.167:0/312496382 learned_addr learned my addr 172.21.15.167:0/312496382 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b0019700 1 -- 172.21.15.167:0/312496382 >> v1:172.21.15.118:6789/0 conn(0x5636a0e72570 legacy=0x5636a0e70b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b0019700 1 -- 172.21.15.167:0/312496382 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636a0e72a00 con 0x5636a0e71260 2023-10-05T19:50:31.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b0019700 1 --2- 172.21.15.167:0/312496382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f05a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f589800a650 tx=0x7f5898005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76c1d6958514ced server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58af818700 1 -- 172.21.15.167:0/312496382 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5898008760 con 0x5636a0e71260 2023-10-05T19:50:31.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58af818700 1 -- 172.21.15.167:0/312496382 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58980088c0 con 0x5636a0e71260 2023-10-05T19:50:31.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58af818700 1 -- 172.21.15.167:0/312496382 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5898008bb0 con 0x5636a0e71260 2023-10-05T19:50:31.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/312496382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 msgr2=0x5636a0f05a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/312496382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f05a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f589800a650 tx=0x7f5898005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:31.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/312496382 shutdown_connections 2023-10-05T19:50:31.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.125+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/312496382 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f05a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/312496382 >> 172.21.15.167:0/312496382 conn(0x5636a0ef8340 msgr2=0x5636a0efa750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/312496382 shutdown_connections 2023-10-05T19:50:31.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/312496382 wait complete. 2023-10-05T19:50:31.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b2ce5e40 1 Processor -- start 2023-10-05T19:50:31.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b2ce5e40 1 -- start start 2023-10-05T19:50:31.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b2ce5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f1dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b2ce5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636a0dcae30 con 0x5636a0e71260 2023-10-05T19:50:31.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b081a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f1dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b081a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f1dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46540/0 (socket says 172.21.15.167:46540) 2023-10-05T19:50:31.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b081a700 1 -- 172.21.15.167:0/1873164635 learned_addr learned my addr 172.21.15.167:0/1873164635 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b081a700 1 -- 172.21.15.167:0/1873164635 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898005db0 con 0x5636a0e71260 2023-10-05T19:50:31.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58b081a700 1 --2- 172.21.15.167:0/1873164635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f1dbe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f58a0001d30 tx=0x7f58a0001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ce47f7be7880e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58ae816700 1 -- 172.21.15.167:0/1873164635 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58a0014070 con 0x5636a0e71260 2023-10-05T19:50:31.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58ae816700 1 -- 172.21.15.167:0/1873164635 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a0008070 con 0x5636a0e71260 2023-10-05T19:50:31.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.129+0000 7f58ae816700 1 -- 172.21.15.167:0/1873164635 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58a000bd30 con 0x5636a0e71260 2023-10-05T19:50:31.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/1873164635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 msgr2=0x5636a0f1dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/1873164635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f1dbe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f58a0001d30 tx=0x7f58a0001900 comp rx=0 tx=0).stop 2023-10-05T19:50:31.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/1873164635 shutdown_connections 2023-10-05T19:50:31.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/1873164635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f1dbe0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/1873164635 >> 172.21.15.167:0/1873164635 conn(0x5636a0ef8340 msgr2=0x5636a0f197a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/1873164635 shutdown_connections 2023-10-05T19:50:31.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/1873164635 wait complete. 2023-10-05T19:50:31.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 Processor -- start 2023-10-05T19:50:31.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 -- start start 2023-10-05T19:50:31.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f249b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b2ce5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636a0d9ded0 con 0x5636a0e71260 2023-10-05T19:50:31.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b081a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b081a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f249b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46552/0 (socket says 172.21.15.167:46552) 2023-10-05T19:50:31.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 learned_addr learned my addr 172.21.15.167:0/471237339 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a000a040 con 0x5636a0e71260 2023-10-05T19:50:31.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58b081a700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f249b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f58a000b850 tx=0x7f58a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.133+0000 7f58ad013700 1 -- 172.21.15.167:0/471237339 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58a001a480 con 0x5636a0e71260 2023-10-05T19:50:31.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58ad013700 1 -- 172.21.15.167:0/471237339 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a0021070 con 0x5636a0e71260 2023-10-05T19:50:31.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5636a0f24ef0 con 0x5636a0e71260 2023-10-05T19:50:31.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58ad013700 1 -- 172.21.15.167:0/471237339 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58a001a720 con 0x5636a0e71260 2023-10-05T19:50:31.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636a0f25390 con 0x5636a0e71260 2023-10-05T19:50:31.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58ad013700 1 -- 172.21.15.167:0/471237339 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f58a001a950 con 0x5636a0e71260 2023-10-05T19:50:31.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58ad013700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5894030c40 0x7f58940330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58ad013700 1 -- 172.21.15.167:0/471237339 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f58a0044dd0 con 0x5636a0e71260 2023-10-05T19:50:31.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58b0019700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5894030c40 0x7f58940330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0e72570 0x5636a0f304a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f30b50 con 0x5636a0e72570 2023-10-05T19:50:31.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58b101b700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0e72570 0x5636a0f304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58b0019700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5894030c40 0x7f58940330f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58980030a0 tx=0x7f5898015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.137+0000 7f58b101b700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0e72570 0x5636a0f304a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 20 realm 2023-10-05T19:50:31.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f2dac0 con 0x5636a0e72570 2023-10-05T19:50:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:31.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f31630 con 0x5636a0e72570 2023-10-05T19:50:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f31260 0x5636a0f34440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f34b70 con 0x5636a0f31260 2023-10-05T19:50:31.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b081a700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f31260 0x5636a0f34440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b081a700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f31260 0x5636a0f34440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f58a0016070 con 0x5636a0f31260 2023-10-05T19:50:31.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.141+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f35410 con 0x5636a0e72570 2023-10-05T19:50:31.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b2ce5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:31.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b2ce5e40 20 searching for the correct realm 2023-10-05T19:50:31.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f371d0 0x5636a0f395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f371d0 2023-10-05T19:50:31.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b0019700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f371d0 0x5636a0f395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b0019700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f371d0 0x5636a0f395b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f31260 2023-10-05T19:50:31.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a0016070 con 0x5636a0f31260 2023-10-05T19:50:31.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b081a700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f58a001ac00 0x7f58a000a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x7f58a001ac00 2023-10-05T19:50:31.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b101b700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f58a001ac00 0x7f58a000a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.145+0000 7f58b101b700 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f58a001ac00 0x7f58a000a940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f371d0 2023-10-05T19:50:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f31260 2023-10-05T19:50:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a0016070 con 0x5636a0f31260 2023-10-05T19:50:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f31260 2023-10-05T19:50:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a0016070 con 0x5636a0f31260 2023-10-05T19:50:31.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.149+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x7f58a001ac00 2023-10-05T19:50:31.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x7f58a001ac00 2023-10-05T19:50:31.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f31260 2023-10-05T19:50:31.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a0016070 con 0x5636a0f31260 2023-10-05T19:50:31.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f371d0 2023-10-05T19:50:31.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.153+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f31260 2023-10-05T19:50:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a0016070 con 0x5636a0f31260 2023-10-05T19:50:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f371d0 2023-10-05T19:50:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f371d0 2023-10-05T19:50:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x7f58a001ac00 2023-10-05T19:50:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.157+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0e72570 2023-10-05T19:50:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x7f58a001ac00 2023-10-05T19:50:31.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f371d0 2023-10-05T19:50:31.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x7f58a001ac00 2023-10-05T19:50:31.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f31260 2023-10-05T19:50:31.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a0016070 con 0x5636a0f31260 2023-10-05T19:50:31.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f31260 2023-10-05T19:50:31.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a0016070 con 0x5636a0f31260 2023-10-05T19:50:31.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.161+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f371d0 2023-10-05T19:50:31.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f31260 2023-10-05T19:50:31.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f58a0016070 con 0x5636a0f31260 2023-10-05T19:50:31.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f39bc0 con 0x5636a0f31260 2023-10-05T19:50:31.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:31.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:31.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:31.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:31.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f35f80 con 0x5636a0e72570 2023-10-05T19:50:31.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f368d0 con 0x5636a0f31260 2023-10-05T19:50:31.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.165+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3a030 con 0x5636a0f31260 2023-10-05T19:50:31.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:31.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3a3e0 con 0x5636a0f371d0 2023-10-05T19:50:31.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3a790 con 0x5636a0e72570 2023-10-05T19:50:31.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f36470 con 0x5636a0f31260 2023-10-05T19:50:31.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f371d0 2023-10-05T19:50:31.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.169+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f31260 2023-10-05T19:50:31.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x7f58a001ac00 2023-10-05T19:50:31.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f371d0 2023-10-05T19:50:31.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.173+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f31260 2023-10-05T19:50:31.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f31260 2023-10-05T19:50:31.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x7f58a001ac00 2023-10-05T19:50:31.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.177+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x7f58a001ac00 2023-10-05T19:50:31.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f31260 2023-10-05T19:50:31.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f371d0 2023-10-05T19:50:31.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f31260 2023-10-05T19:50:31.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.181+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f371d0 2023-10-05T19:50:31.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f371d0 2023-10-05T19:50:31.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x7f58a001ac00 2023-10-05T19:50:31.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0e72570 2023-10-05T19:50:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.185+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x7f58a001ac00 2023-10-05T19:50:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f371d0 2023-10-05T19:50:31.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x7f58a001ac00 2023-10-05T19:50:31.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f31260 2023-10-05T19:50:31.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f31260 2023-10-05T19:50:31.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f371d0 2023-10-05T19:50:31.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.189+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f31260 2023-10-05T19:50:31.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3c090 con 0x5636a0f31260 2023-10-05T19:50:31.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:31.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:31.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3b080 con 0x5636a0f31260 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3b080 con 0x5636a0e72570 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.193+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3b970 con 0x5636a0f31260 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3b970 con 0x5636a0f31260 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3b970 con 0x7f58a001ac00 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 zone default found 2023-10-05T19:50:31.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 4 Realm: () 2023-10-05T19:50:31.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:31.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:31.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:31.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 zonegroup default 2023-10-05T19:50:31.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3b970 con 0x7f58a001ac00 2023-10-05T19:50:31.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3b970 con 0x5636a0f371d0 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.197+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3ddc0 con 0x5636a0f371d0 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b2ce5e40 20 started sync module instance, tier type = 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b2ce5e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:31.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3d480 con 0x5636a0f31260 2023-10-05T19:50:31.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94792628548736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3d480 con 0x5636a0f31260 2023-10-05T19:50:31.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.201+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3e660 con 0x5636a0e72570 2023-10-05T19:50:31.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.205+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.205+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94792628560240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3eab0 con 0x5636a0e72570 2023-10-05T19:50:31.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.205+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3f350 con 0x5636a0f31260 2023-10-05T19:50:31.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.205+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94792628548736] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.205+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94792628560240] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.205+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.205+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94792628558016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3eab0 con 0x5636a0f31260 2023-10-05T19:50:31.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.205+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3f5c0 con 0x7f58a001ac00 2023-10-05T19:50:31.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.209+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94792628558016] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.209+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.209+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94792628564112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3eab0 con 0x7f58a001ac00 2023-10-05T19:50:31.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.209+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3fef0 con 0x5636a0f31260 2023-10-05T19:50:31.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.209+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94792628564112] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94792628566464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f3eab0 con 0x5636a0f31260 2023-10-05T19:50:31.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f40950 con 0x5636a0f371d0 2023-10-05T19:50:31.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94792628569184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f411f0 con 0x5636a0f371d0 2023-10-05T19:50:31.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f41c40 con 0x5636a0f371d0 2023-10-05T19:50:31.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94792628566464] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94792628569184] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94792628561344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f42530 con 0x5636a0f371d0 2023-10-05T19:50:31.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.213+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f428e0 con 0x7f58a001ac00 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94792628578528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f43220 con 0x7f58a001ac00 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 20 add_watcher() i=0 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 20 add_watcher() i=1 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 20 add_watcher() i=2 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 20 add_watcher() i=3 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 20 add_watcher() i=4 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 20 add_watcher() i=5 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94792628561344] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5898012450 con 0x5636a0f371d0 2023-10-05T19:50:31.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 20 add_watcher() i=6 2023-10-05T19:50:31.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94792628578528] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 20 add_watcher() i=7 2023-10-05T19:50:31.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:31.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f46250 con 0x5636a0e72570 2023-10-05T19:50:31.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.217+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94792628579632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f43670 con 0x5636a0e72570 2023-10-05T19:50:31.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94792628579632] v30'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58817f2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:31.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b2ce5e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:31.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b2ce5e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:31.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b2ce5e40 1 Processor -- start 2023-10-05T19:50:31.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b2ce5e40 1 -- start start 2023-10-05T19:50:31.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b2ce5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f50a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b2ce5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636a0f50f70 con 0x5636a0f50660 2023-10-05T19:50:31.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b0019700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f50a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b0019700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f50a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46562/0 (socket says 172.21.15.167:46562) 2023-10-05T19:50:31.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b0019700 1 -- 172.21.15.167:0/2262946442 learned_addr learned my addr 172.21.15.167:0/2262946442 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b0019700 1 -- 172.21.15.167:0/2262946442 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636a0f510b0 con 0x5636a0f50660 2023-10-05T19:50:31.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f58b0019700 1 --2- 172.21.15.167:0/2262946442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f50a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5636a0e729d0 tx=0x7f5898012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684e6b1dc77cc243 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f5880ff1700 1 -- 172.21.15.167:0/2262946442 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f589802d040 con 0x5636a0f50660 2023-10-05T19:50:31.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f5880ff1700 1 -- 172.21.15.167:0/2262946442 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898028810 con 0x5636a0f50660 2023-10-05T19:50:31.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.221+0000 7f5880ff1700 1 -- 172.21.15.167:0/2262946442 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58980289c0 con 0x5636a0f50660 2023-10-05T19:50:31.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/2262946442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 msgr2=0x5636a0f50a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/2262946442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f50a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5636a0e729d0 tx=0x7f5898012000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/2262946442 shutdown_connections 2023-10-05T19:50:31.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/2262946442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f50a30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/2262946442 >> 172.21.15.167:0/2262946442 conn(0x5636a0f4ba20 msgr2=0x5636a0f49b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/2262946442 shutdown_connections 2023-10-05T19:50:31.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/2262946442 wait complete. 2023-10-05T19:50:31.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 Processor -- start 2023-10-05T19:50:31.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 -- start start 2023-10-05T19:50:31.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f56140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636a0f57140 con 0x5636a0f50660 2023-10-05T19:50:31.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b0019700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f56140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b0019700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f56140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46570/0 (socket says 172.21.15.167:46570) 2023-10-05T19:50:31.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b0019700 1 -- 172.21.15.167:0/4093755439 learned_addr learned my addr 172.21.15.167:0/4093755439 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b0019700 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636a0e72a00 con 0x5636a0f50660 2023-10-05T19:50:31.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b0019700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f56140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5636a0f4a6e0 tx=0x7f589802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f57faffd700 1 -- 172.21.15.167:0/4093755439 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5898009640 con 0x5636a0f50660 2023-10-05T19:50:31.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f57faffd700 1 -- 172.21.15.167:0/4093755439 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58980097a0 con 0x5636a0f50660 2023-10-05T19:50:31.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5636a0f56740 con 0x5636a0f50660 2023-10-05T19:50:31.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f57faffd700 1 -- 172.21.15.167:0/4093755439 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5898009930 con 0x5636a0f50660 2023-10-05T19:50:31.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.225+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636a0f56be0 con 0x5636a0f50660 2023-10-05T19:50:31.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.229+0000 7f57faffd700 1 -- 172.21.15.167:0/4093755439 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5898009a90 con 0x5636a0f50660 2023-10-05T19:50:31.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.229+0000 7f57faffd700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f57f0030ca0 0x7f57f0033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.229+0000 7f57faffd700 1 -- 172.21.15.167:0/4093755439 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f5898046c20 con 0x5636a0f50660 2023-10-05T19:50:31.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.229+0000 7f58b101b700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f57f0030ca0 0x7f57f0033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.229+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f60d60 0x5636a0f63170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.229+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f637c0 con 0x5636a0f60d60 2023-10-05T19:50:31.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.229+0000 7f58b081a700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f60d60 0x5636a0f63170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.229+0000 7f58b101b700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f57f0030ca0 0x7f57f0033150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x5636a0f42210 tx=0x7f58a800ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.229+0000 7f58b081a700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f60d60 0x5636a0f63170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.233+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.233+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5636a0f64490 0x5636a0f66870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.233+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f66fa0 con 0x5636a0f64490 2023-10-05T19:50:31.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.233+0000 7f58b0019700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5636a0f64490 0x5636a0f66870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.233+0000 7f58b0019700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5636a0f64490 0x5636a0f66870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.233+0000 7f58b0019700 1 -- 172.21.15.167:0/4093755439 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5898039020 con 0x5636a0f64490 2023-10-05T19:50:31.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.233+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f67c70 0x5636a0f6a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.233+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f6a7b0 con 0x5636a0f67c70 2023-10-05T19:50:31.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.233+0000 7f58b101b700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f67c70 0x5636a0f6a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.237+0000 7f58b101b700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f67c70 0x5636a0f6a080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.237+0000 7f58b101b700 1 -- 172.21.15.167:0/4093755439 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0f67c70 2023-10-05T19:50:31.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.237+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0f6b4c0 0x5636a0f6d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.237+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f6dfd0 con 0x5636a0f6b4c0 2023-10-05T19:50:31.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.237+0000 7f58b081a700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0f6b4c0 0x5636a0f6d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.237+0000 7f58b081a700 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0f6b4c0 0x5636a0f6d8a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.241+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f6b4c0 2023-10-05T19:50:31.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.241+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f6e620 con 0x5636a0f60d60 2023-10-05T19:50:31.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.241+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.241+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f6eb10 con 0x5636a0f67c70 2023-10-05T19:50:31.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.245+0000 7f58b101b700 1 -- 172.21.15.167:0/4093755439 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0f67c70 2023-10-05T19:50:31.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.245+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.245+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.245+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f6b4c0 2023-10-05T19:50:31.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.249+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f6b4c0 2023-10-05T19:50:31.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.249+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.249+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.249+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.253+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.253+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.257+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.257+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f67c70 2023-10-05T19:50:31.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.257+0000 7f58b101b700 1 -- 172.21.15.167:0/4093755439 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0f67c70 2023-10-05T19:50:31.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.257+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.261+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.261+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f6b4c0 2023-10-05T19:50:31.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.261+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f6b4c0 2023-10-05T19:50:31.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.261+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f6b4c0 2023-10-05T19:50:31.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.265+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f6b4c0 2023-10-05T19:50:31.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.265+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.265+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.265+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.269+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'22 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.269+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f67c70 2023-10-05T19:50:31.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.269+0000 7f58b101b700 1 -- 172.21.15.167:0/4093755439 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0f67c70 2023-10-05T19:50:31.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.269+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.273+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.273+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f6b4c0 2023-10-05T19:50:31.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.277+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f6b4c0 2023-10-05T19:50:31.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.277+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.277+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.277+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.281+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.281+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f67c70 2023-10-05T19:50:31.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.281+0000 7f58b101b700 1 -- 172.21.15.167:0/4093755439 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0f67c70 2023-10-05T19:50:31.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.281+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c680 con 0x5636a0f60d60 2023-10-05T19:50:31.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.285+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.285+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c8f0 con 0x5636a0f67c70 2023-10-05T19:50:31.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.289+0000 7f58b101b700 1 -- 172.21.15.167:0/4093755439 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0f67c70 2023-10-05T19:50:31.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.289+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c8f0 con 0x5636a0f67c70 2023-10-05T19:50:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.289+0000 7f58b101b700 1 -- 172.21.15.167:0/4093755439 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'14 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0f67c70 2023-10-05T19:50:31.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.289+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c8f0 con 0x5636a0f67c70 2023-10-05T19:50:31.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.293+0000 7f58b101b700 1 -- 172.21.15.167:0/4093755439 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0f67c70 2023-10-05T19:50:31.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.293+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c8f0 con 0x5636a0f60d60 2023-10-05T19:50:31.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.293+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.293+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f6f680 con 0x5636a0f6b4c0 2023-10-05T19:50:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.297+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'14 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f6b4c0 2023-10-05T19:50:31.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.297+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f6f680 con 0x5636a0f60d60 2023-10-05T19:50:31.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.297+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'16 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f60d60 2023-10-05T19:50:31.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.297+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c8f0 con 0x5636a0f6b4c0 2023-10-05T19:50:31.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.301+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'20 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f6b4c0 2023-10-05T19:50:31.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.301+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0f5c8f0 con 0x5636a0f64490 2023-10-05T19:50:31.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.305+0000 7f58b0019700 1 -- 172.21.15.167:0/4093755439 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5898039020 con 0x5636a0f64490 2023-10-05T19:50:31.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.305+0000 7f57effff700 20 reqs_thread_entry: start 2023-10-05T19:50:31.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.305+0000 7f57edffb700 20 reqs_thread_entry: start 2023-10-05T19:50:31.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.305+0000 7f58b2ce5e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:31.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f58b2ce5e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:31.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f57dbfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:01 2023 2023-10-05T19:50:31.315 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:31.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f57db7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:31.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f58b2ce5e40 20 get_system_obj_state: rctx=0x7ffc35b120d8 obj=default.rgw.meta:users.uid:bud state=0x5636a0dd60b0 s->prefetch_data=0 2023-10-05T19:50:31.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f58b2ce5e40 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2023-10-05T19:50:31.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x7f58a001ac00 2023-10-05T19:50:31.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 bud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f58b2ce5e40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2023-10-05T19:50:31.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f58b2ce5e40 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T19:50:31.316 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, user does not exist 2023-10-05T19:50:31.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.309+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94792628548736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x5636a0f31260 2023-10-05T19:50:31.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.313+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94792628548736] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.313+0000 7f58b2ce5e40 20 remove_watcher() i=0 2023-10-05T19:50:31.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.313+0000 7f58b2ce5e40 2 removed watcher, disabling cache 2023-10-05T19:50:31.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.313+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94792628560240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x5636a0e72570 2023-10-05T19:50:31.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.313+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94792628560240] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.313+0000 7f58b2ce5e40 20 remove_watcher() i=1 2023-10-05T19:50:31.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.313+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94792628558016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x5636a0f31260 2023-10-05T19:50:31.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.317+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94792628558016] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.317+0000 7f58b2ce5e40 20 remove_watcher() i=2 2023-10-05T19:50:31.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.317+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94792628564112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x7f58a001ac00 2023-10-05T19:50:31.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.317+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94792628564112] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.317+0000 7f58b2ce5e40 20 remove_watcher() i=3 2023-10-05T19:50:31.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.317+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94792628566464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x5636a0f31260 2023-10-05T19:50:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.321+0000 7f58b081a700 1 -- 172.21.15.167:0/471237339 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94792628566464] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a004b040 con 0x5636a0f31260 2023-10-05T19:50:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.321+0000 7f58b2ce5e40 20 remove_watcher() i=4 2023-10-05T19:50:31.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.321+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94792628569184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x5636a0f371d0 2023-10-05T19:50:31.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.321+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94792628569184] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5898039020 con 0x5636a0f371d0 2023-10-05T19:50:31.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.321+0000 7f58b2ce5e40 20 remove_watcher() i=5 2023-10-05T19:50:31.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.321+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94792628561344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x5636a0f371d0 2023-10-05T19:50:31.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.325+0000 7f58b0019700 1 -- 172.21.15.167:0/471237339 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94792628561344] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5898039020 con 0x5636a0f371d0 2023-10-05T19:50:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.325+0000 7f58b2ce5e40 20 remove_watcher() i=6 2023-10-05T19:50:31.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.325+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94792628578528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x7f58a001ac00 2023-10-05T19:50:31.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.325+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94792628578528] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x7f58a001ac00 2023-10-05T19:50:31.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.325+0000 7f58b2ce5e40 20 remove_watcher() i=7 2023-10-05T19:50:31.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58817f2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:31.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94792628579632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636a0fce0b0 con 0x5636a0e72570 2023-10-05T19:50:31.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 94792628579632] v30'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f58a800a5a0 con 0x5636a0e72570 2023-10-05T19:50:31.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f31260 msgr2=0x5636a0f34440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f31260 0x5636a0f34440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0e72570 msgr2=0x5636a0f304a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0e72570 0x5636a0f304a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f58a001ac00 msgr2=0x7f58a000a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f58a001ac00 0x7f58a000a940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f371d0 msgr2=0x5636a0f395b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f371d0 0x5636a0f395b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5894030c40 msgr2=0x7f58940330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5894030c40 0x7f58940330f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58980030a0 tx=0x7f5898015000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 msgr2=0x5636a0f249b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f249b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f58a000b850 tx=0x7f58a0016000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b101b700 1 -- 172.21.15.167:0/471237339 reap_dead start 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 shutdown_connections 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/471237339 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0e71260 0x5636a0f249b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 >> 172.21.15.167:0/471237339 conn(0x5636a0ef8340 msgr2=0x5636a0f18220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 shutdown_connections 2023-10-05T19:50:31.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/471237339 wait complete. 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f60d60 msgr2=0x5636a0f63170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5636a0f60d60 0x5636a0f63170 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0f6b4c0 msgr2=0x5636a0f6d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5636a0f6b4c0 0x5636a0f6d8a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5636a0f64490 msgr2=0x5636a0f66870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5636a0f64490 0x5636a0f66870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f67c70 msgr2=0x5636a0f6a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.329+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5636a0f67c70 0x5636a0f6a080 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f57f0030ca0 msgr2=0x7f57f0033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f57f0030ca0 0x7f57f0033150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x5636a0f42210 tx=0x7f58a800ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:31.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 msgr2=0x5636a0f56140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b2ce5e40 1 --2- 172.21.15.167:0/4093755439 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5636a0f50660 0x5636a0f56140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5636a0f4a6e0 tx=0x7f589802c000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 reap_dead start 2023-10-05T19:50:31.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b081a700 1 -- 172.21.15.167:0/4093755439 reap_dead start 2023-10-05T19:50:31.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 shutdown_connections 2023-10-05T19:50:31.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 >> 172.21.15.167:0/4093755439 conn(0x5636a0f4ba20 msgr2=0x5636a0f49ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 shutdown_connections 2023-10-05T19:50:31.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.333+0000 7f58b2ce5e40 1 -- 172.21.15.167:0/4093755439 wait complete. 2023-10-05T19:50:31.343 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-05T19:50:31.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2023-10-05T19:50:31.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2023-10-05T19:50:31.345 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2023-10-05T19:50:31.384 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:31.384 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:31.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.377+0000 7f0567588e40 1 Processor -- start 2023-10-05T19:50:31.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.377+0000 7f0567588e40 1 -- start start 2023-10-05T19:50:31.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.377+0000 7f0567588e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56322db68260 0x56322dbfca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.377+0000 7f0567588e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56322db40bd0 con 0x56322db69570 2023-10-05T19:50:31.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.377+0000 7f0567588e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x56322dafdee0 con 0x56322db68260 2023-10-05T19:50:31.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f05648bc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56322db68260 0x56322dbfca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f05650bd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x56322db69570 0x56322db67b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39804/0 (socket says 172.21.15.167:39804) 2023-10-05T19:50:31.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f05650bd700 1 -- 172.21.15.167:0/4116098192 learned_addr learned my addr 172.21.15.167:0/4116098192 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:31.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f05648bc700 1 -- 172.21.15.167:0/4116098192 >> v1:172.21.15.118:6789/0 conn(0x56322db69570 legacy=0x56322db67b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f05648bc700 1 -- 172.21.15.167:0/4116098192 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56322db69a00 con 0x56322db68260 2023-10-05T19:50:31.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f05648bc700 1 --2- 172.21.15.167:0/4116098192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dbfca50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f055000a5d0 tx=0x7f0550005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab156142e4f6230c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f055ffff700 1 -- 172.21.15.167:0/4116098192 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05500086a0 con 0x56322db68260 2023-10-05T19:50:31.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f055ffff700 1 -- 172.21.15.167:0/4116098192 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0550008800 con 0x56322db68260 2023-10-05T19:50:31.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f055ffff700 1 -- 172.21.15.167:0/4116098192 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0550008ad0 con 0x56322db68260 2023-10-05T19:50:31.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 -- 172.21.15.167:0/4116098192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 msgr2=0x56322dbfca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 --2- 172.21.15.167:0/4116098192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dbfca50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f055000a5d0 tx=0x7f0550005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:31.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 -- 172.21.15.167:0/4116098192 shutdown_connections 2023-10-05T19:50:31.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 --2- 172.21.15.167:0/4116098192 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dbfca50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 -- 172.21.15.167:0/4116098192 >> 172.21.15.167:0/4116098192 conn(0x56322dbef340 msgr2=0x56322dbf1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 -- 172.21.15.167:0/4116098192 shutdown_connections 2023-10-05T19:50:31.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 -- 172.21.15.167:0/4116098192 wait complete. 2023-10-05T19:50:31.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 Processor -- start 2023-10-05T19:50:31.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 -- start start 2023-10-05T19:50:31.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc14be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.381+0000 7f0567588e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322dac1e30 con 0x56322db68260 2023-10-05T19:50:31.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f05650bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc14be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f05650bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc14be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46596/0 (socket says 172.21.15.167:46596) 2023-10-05T19:50:31.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f05650bd700 1 -- 172.21.15.167:0/2664802142 learned_addr learned my addr 172.21.15.167:0/2664802142 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f05650bd700 1 -- 172.21.15.167:0/2664802142 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550005cf0 con 0x56322db68260 2023-10-05T19:50:31.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f05650bd700 1 --2- 172.21.15.167:0/2664802142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc14be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0558001c30 tx=0x7f05580017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c946261093c4d137 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f055effd700 1 -- 172.21.15.167:0/2664802142 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f055800bbf0 con 0x56322db68260 2023-10-05T19:50:31.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f055effd700 1 -- 172.21.15.167:0/2664802142 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055800bd50 con 0x56322db68260 2023-10-05T19:50:31.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f055effd700 1 -- 172.21.15.167:0/2664802142 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f055800e470 con 0x56322db68260 2023-10-05T19:50:31.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f0567588e40 1 -- 172.21.15.167:0/2664802142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 msgr2=0x56322dc14be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f0567588e40 1 --2- 172.21.15.167:0/2664802142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc14be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0558001c30 tx=0x7f05580017e0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f0567588e40 1 -- 172.21.15.167:0/2664802142 shutdown_connections 2023-10-05T19:50:31.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f0567588e40 1 --2- 172.21.15.167:0/2664802142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc14be0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f0567588e40 1 -- 172.21.15.167:0/2664802142 >> 172.21.15.167:0/2664802142 conn(0x56322dbef340 msgr2=0x56322dc107a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f0567588e40 1 -- 172.21.15.167:0/2664802142 shutdown_connections 2023-10-05T19:50:31.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f0567588e40 1 -- 172.21.15.167:0/2664802142 wait complete. 2023-10-05T19:50:31.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.385+0000 7f0567588e40 1 Processor -- start 2023-10-05T19:50:31.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f0567588e40 1 -- start start 2023-10-05T19:50:31.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f0567588e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc1b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f0567588e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322da94ed0 con 0x56322db68260 2023-10-05T19:50:31.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f05650bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc1b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f05650bd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc1b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46610/0 (socket says 172.21.15.167:46610) 2023-10-05T19:50:31.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 learned_addr learned my addr 172.21.15.167:0/1198924557 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56322db40bd0 con 0x56322db68260 2023-10-05T19:50:31.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f05650bd700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc1b9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0558000c00 tx=0x7f0558016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f055d7fa700 1 -- 172.21.15.167:0/1198924557 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f055801f070 con 0x56322db68260 2023-10-05T19:50:31.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f055d7fa700 1 -- 172.21.15.167:0/1198924557 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0558019690 con 0x56322db68260 2023-10-05T19:50:31.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56322dc1bef0 con 0x56322db68260 2023-10-05T19:50:31.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f055d7fa700 1 -- 172.21.15.167:0/1198924557 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0558019840 con 0x56322db68260 2023-10-05T19:50:31.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56322dc1c330 con 0x56322db68260 2023-10-05T19:50:31.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f055d7fa700 1 -- 172.21.15.167:0/1198924557 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f0558022020 con 0x56322db68260 2023-10-05T19:50:31.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f055d7fa700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0548030bf0 0x7f05480330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f055d7fa700 1 -- 172.21.15.167:0/1198924557 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f0558044f00 con 0x56322db68260 2023-10-05T19:50:31.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.389+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f05648bc700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0548030bf0 0x7f05480330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322db69570 0x56322dc27470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc27b20 con 0x56322db69570 2023-10-05T19:50:31.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f05658be700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322db69570 0x56322dc27470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f05648bc700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0548030bf0 0x7f05480330a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0550005a90 tx=0x7f0550015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f05658be700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322db69570 0x56322dc27470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 20 realm 2023-10-05T19:50:31.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc24ad0 con 0x56322db69570 2023-10-05T19:50:31.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:31.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc28600 con 0x56322db69570 2023-10-05T19:50:31.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc29430 0x56322dc2b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc2bd50 con 0x56322dc29430 2023-10-05T19:50:31.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.393+0000 7f05650bd700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc29430 0x56322dc2b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f05650bd700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc29430 0x56322dc2b810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f0567588e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc2c5f0 con 0x56322db69570 2023-10-05T19:50:31.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f0567588e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:31.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f0567588e40 20 searching for the correct realm 2023-10-05T19:50:31.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc2e3b0 0x56322dc30790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc2e3b0 2023-10-05T19:50:31.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f05648bc700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc2e3b0 0x56322dc30790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f05648bc700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc2e3b0 0x56322dc30790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.397+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc29430 2023-10-05T19:50:31.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05650bd700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0558016b80 0x7f05580420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x7f0558016b80 2023-10-05T19:50:31.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0558016b80 0x7f05580420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0558016b80 0x7f05580420e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc2e3b0 2023-10-05T19:50:31.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.401+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc29430 2023-10-05T19:50:31.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc29430 2023-10-05T19:50:31.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x7f0558016b80 2023-10-05T19:50:31.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x7f0558016b80 2023-10-05T19:50:31.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.405+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc29430 2023-10-05T19:50:31.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc2e3b0 2023-10-05T19:50:31.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc29430 2023-10-05T19:50:31.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc2e3b0 2023-10-05T19:50:31.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.409+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc2e3b0 2023-10-05T19:50:31.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x7f0558016b80 2023-10-05T19:50:31.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322db69570 2023-10-05T19:50:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x7f0558016b80 2023-10-05T19:50:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.413+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc2e3b0 2023-10-05T19:50:31.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x7f0558016b80 2023-10-05T19:50:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc29430 2023-10-05T19:50:31.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc29430 2023-10-05T19:50:31.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc2e3b0 2023-10-05T19:50:31.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.417+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc29430 2023-10-05T19:50:31.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc30cd0 con 0x56322dc29430 2023-10-05T19:50:31.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:31.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:31.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:31.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:31.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc2d160 con 0x56322db69570 2023-10-05T19:50:31.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc2dab0 con 0x56322dc29430 2023-10-05T19:50:31.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc31080 con 0x56322dc29430 2023-10-05T19:50:31.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:31.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.421+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc31430 con 0x56322dc2e3b0 2023-10-05T19:50:31.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc317e0 con 0x56322db69570 2023-10-05T19:50:31.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc2d650 con 0x56322dc29430 2023-10-05T19:50:31.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f0567588e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc2e3b0 2023-10-05T19:50:31.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc29430 2023-10-05T19:50:31.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.425+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x7f0558016b80 2023-10-05T19:50:31.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc2e3b0 2023-10-05T19:50:31.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc29430 2023-10-05T19:50:31.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.429+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc29430 2023-10-05T19:50:31.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x7f0558016b80 2023-10-05T19:50:31.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x7f0558016b80 2023-10-05T19:50:31.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc29430 2023-10-05T19:50:31.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.433+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc2e3b0 2023-10-05T19:50:31.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc29430 2023-10-05T19:50:31.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc2e3b0 2023-10-05T19:50:31.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.437+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc2e3b0 2023-10-05T19:50:31.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x7f0558016b80 2023-10-05T19:50:31.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322db69570 2023-10-05T19:50:31.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x7f0558016b80 2023-10-05T19:50:31.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc2e3b0 2023-10-05T19:50:31.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.441+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x7f0558016b80 2023-10-05T19:50:31.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc29430 2023-10-05T19:50:31.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc29430 2023-10-05T19:50:31.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc2e3b0 2023-10-05T19:50:31.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc29430 2023-10-05T19:50:31.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc330e0 con 0x56322dc29430 2023-10-05T19:50:31.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f0567588e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:31.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f0567588e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:31.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f0567588e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:31.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.445+0000 7f0567588e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:31.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc320d0 con 0x56322dc29430 2023-10-05T19:50:31.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc320d0 con 0x56322db69570 2023-10-05T19:50:31.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:31.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc329c0 con 0x56322dc29430 2023-10-05T19:50:31.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc329c0 con 0x56322dc29430 2023-10-05T19:50:31.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:31.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.449+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc329c0 con 0x7f0558016b80 2023-10-05T19:50:31.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 zone default found 2023-10-05T19:50:31.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 4 Realm: () 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 zonegroup default 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc329c0 con 0x7f0558016b80 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc329c0 con 0x56322dc2e3b0 2023-10-05T19:50:31.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc34e10 con 0x56322dc2e3b0 2023-10-05T19:50:31.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 started sync module instance, tier type = 2023-10-05T19:50:31.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:31.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.453+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc344d0 con 0x56322dc29430 2023-10-05T19:50:31.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.457+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.457+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94773516117200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc344d0 con 0x56322dc29430 2023-10-05T19:50:31.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.457+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc356b0 con 0x56322db69570 2023-10-05T19:50:31.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.457+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.457+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94773516117200] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.457+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94773516128704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc35b00 con 0x56322db69570 2023-10-05T19:50:31.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.457+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc35eb0 con 0x56322dc29430 2023-10-05T19:50:31.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.461+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94773516128704] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.461+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.461+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94773516126336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc35b00 con 0x56322dc29430 2023-10-05T19:50:31.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.461+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc36580 con 0x7f0558016b80 2023-10-05T19:50:31.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.461+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.461+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94773516132432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc364a0 con 0x7f0558016b80 2023-10-05T19:50:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.461+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc374d0 con 0x56322dc29430 2023-10-05T19:50:31.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.461+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94773516126336] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.465+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94773516132432] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.465+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.465+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94773516134784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc36fe0 con 0x56322dc29430 2023-10-05T19:50:31.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.465+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc37880 con 0x56322dc2e3b0 2023-10-05T19:50:31.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.465+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.465+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94773516136976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc38120 con 0x56322dc2e3b0 2023-10-05T19:50:31.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.465+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc38b30 con 0x56322dc2e3b0 2023-10-05T19:50:31.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.465+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94773516134784] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94773516136976] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94773516142144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc38f30 con 0x56322dc2e3b0 2023-10-05T19:50:31.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc397d0 con 0x7f0558016b80 2023-10-05T19:50:31.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94773516142144] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0550008ae0 con 0x56322dc2e3b0 2023-10-05T19:50:31.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94773516145376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc39c20 con 0x7f0558016b80 2023-10-05T19:50:31.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 20 add_watcher() i=0 2023-10-05T19:50:31.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 20 add_watcher() i=1 2023-10-05T19:50:31.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 20 add_watcher() i=2 2023-10-05T19:50:31.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 20 add_watcher() i=3 2023-10-05T19:50:31.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 20 add_watcher() i=4 2023-10-05T19:50:31.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 20 add_watcher() i=5 2023-10-05T19:50:31.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 20 add_watcher() i=6 2023-10-05T19:50:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94773516145376] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 20 add_watcher() i=7 2023-10-05T19:50:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:31.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.469+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc3cc90 con 0x56322db69570 2023-10-05T19:50:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94773516146480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc3a280 con 0x56322db69570 2023-10-05T19:50:31.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94773516146480] v30'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f05367e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:31.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f0567588e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:31.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f0567588e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:31.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f0567588e40 1 Processor -- start 2023-10-05T19:50:31.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f0567588e40 1 -- start start 2023-10-05T19:50:31.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f0567588e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc478e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f0567588e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322dc47e20 con 0x56322dc47510 2023-10-05T19:50:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f05648bc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f05648bc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46614/0 (socket says 172.21.15.167:46614) 2023-10-05T19:50:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.473+0000 7f05648bc700 1 -- 172.21.15.167:0/910355165 learned_addr learned my addr 172.21.15.167:0/910355165 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f05648bc700 1 -- 172.21.15.167:0/910355165 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56322dc47f60 con 0x56322dc47510 2023-10-05T19:50:31.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f05648bc700 1 --2- 172.21.15.167:0/910355165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc478e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0550002000 tx=0x7f0550012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5877ed00f2ba53 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0535fe3700 1 -- 172.21.15.167:0/910355165 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f055002d040 con 0x56322dc47510 2023-10-05T19:50:31.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0535fe3700 1 -- 172.21.15.167:0/910355165 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0550012e90 con 0x56322dc47510 2023-10-05T19:50:31.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0535fe3700 1 -- 172.21.15.167:0/910355165 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0550028890 con 0x56322dc47510 2023-10-05T19:50:31.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 -- 172.21.15.167:0/910355165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 msgr2=0x56322dc478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 --2- 172.21.15.167:0/910355165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc478e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0550002000 tx=0x7f0550012000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 -- 172.21.15.167:0/910355165 shutdown_connections 2023-10-05T19:50:31.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 --2- 172.21.15.167:0/910355165 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc478e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 -- 172.21.15.167:0/910355165 >> 172.21.15.167:0/910355165 conn(0x56322dc428d0 msgr2=0x56322dc40a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 -- 172.21.15.167:0/910355165 shutdown_connections 2023-10-05T19:50:31.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 -- 172.21.15.167:0/910355165 wait complete. 2023-10-05T19:50:31.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 Processor -- start 2023-10-05T19:50:31.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 -- start start 2023-10-05T19:50:31.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc4cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f0567588e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56322dc4dfa0 con 0x56322dc47510 2023-10-05T19:50:31.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.477+0000 7f05648bc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc4cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f05648bc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc4cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46618/0 (socket says 172.21.15.167:46618) 2023-10-05T19:50:31.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f05648bc700 1 -- 172.21.15.167:0/2695983205 learned_addr learned my addr 172.21.15.167:0/2695983205 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f05648bc700 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56322db69a00 con 0x56322dc47510 2023-10-05T19:50:31.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f05648bc700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc4cfa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0550035040 tx=0x7f055002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f04a7fff700 1 -- 172.21.15.167:0/2695983205 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0550033890 con 0x56322dc47510 2023-10-05T19:50:31.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f04a7fff700 1 -- 172.21.15.167:0/2695983205 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055003f070 con 0x56322dc47510 2023-10-05T19:50:31.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f04a7fff700 1 -- 172.21.15.167:0/2695983205 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0550033a30 con 0x56322dc47510 2023-10-05T19:50:31.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56322dc4d5a0 con 0x56322dc47510 2023-10-05T19:50:31.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56322dc4d980 con 0x56322dc47510 2023-10-05T19:50:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f04a7fff700 1 -- 172.21.15.167:0/2695983205 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f0550033c60 con 0x56322dc47510 2023-10-05T19:50:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f04a7fff700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04ac030c00 0x7f04ac0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f04a7fff700 1 -- 172.21.15.167:0/2695983205 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f0550041070 con 0x56322dc47510 2023-10-05T19:50:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f05658be700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04ac030c00 0x7f04ac0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc57bf0 0x56322dc5a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc5a6a0 con 0x56322dc57bf0 2023-10-05T19:50:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f05650bd700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc57bf0 0x56322dc5a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.481+0000 7f05658be700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04ac030c00 0x7f04ac0330b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x56322dc3a1e0 tx=0x7f056000ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.485+0000 7f05650bd700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc57bf0 0x56322dc5a000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.485+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.485+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56322dc5b370 0x56322dc5d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.485+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc5de80 con 0x56322dc5b370 2023-10-05T19:50:31.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.485+0000 7f05648bc700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56322dc5b370 0x56322dc5d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.485+0000 7f05648bc700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56322dc5b370 0x56322dc5d750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.489+0000 7f05648bc700 1 -- 172.21.15.167:0/2695983205 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f055004a070 con 0x56322dc5b370 2023-10-05T19:50:31.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.489+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc5eb50 0x56322dc60f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.489+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc61630 con 0x56322dc5eb50 2023-10-05T19:50:31.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.489+0000 7f05658be700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc5eb50 0x56322dc60f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.489+0000 7f05658be700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc5eb50 0x56322dc60f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.489+0000 7f05658be700 1 -- 172.21.15.167:0/2695983205 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322dc5eb50 2023-10-05T19:50:31.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.489+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322dc622d0 0x56322dc646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.489+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc64e10 con 0x56322dc622d0 2023-10-05T19:50:31.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.489+0000 7f05650bd700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322dc622d0 0x56322dc646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.493+0000 7f05650bd700 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322dc622d0 0x56322dc646e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.493+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc622d0 2023-10-05T19:50:31.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.493+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc65460 con 0x56322dc57bf0 2023-10-05T19:50:31.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.497+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.497+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc654a0 con 0x56322dc5eb50 2023-10-05T19:50:31.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.497+0000 7f05658be700 1 -- 172.21.15.167:0/2695983205 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322dc5eb50 2023-10-05T19:50:31.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.497+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.501+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.501+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc622d0 2023-10-05T19:50:31.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.501+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc622d0 2023-10-05T19:50:31.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.501+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.505+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.505+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.505+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.505+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc65d00 con 0x56322dc57bf0 2023-10-05T19:50:31.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.509+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.509+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc5eb50 2023-10-05T19:50:31.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.509+0000 7f05658be700 1 -- 172.21.15.167:0/2695983205 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322dc5eb50 2023-10-05T19:50:31.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.509+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.513+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.513+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc622d0 2023-10-05T19:50:31.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.513+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc622d0 2023-10-05T19:50:31.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.513+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc622d0 2023-10-05T19:50:31.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.517+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc622d0 2023-10-05T19:50:31.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.517+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.521+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.521+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.521+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'25 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.521+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc5eb50 2023-10-05T19:50:31.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.525+0000 7f05658be700 1 -- 172.21.15.167:0/2695983205 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322dc5eb50 2023-10-05T19:50:31.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.525+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.529+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.529+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc622d0 2023-10-05T19:50:31.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.529+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'34 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc622d0 2023-10-05T19:50:31.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.529+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.533+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.533+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.533+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.533+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc5eb50 2023-10-05T19:50:31.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.537+0000 7f05658be700 1 -- 172.21.15.167:0/2695983205 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322dc5eb50 2023-10-05T19:50:31.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.537+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc57bf0 2023-10-05T19:50:31.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.541+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.541+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc5eb50 2023-10-05T19:50:31.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.541+0000 7f05658be700 1 -- 172.21.15.167:0/2695983205 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322dc5eb50 2023-10-05T19:50:31.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.541+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc5eb50 2023-10-05T19:50:31.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.545+0000 7f05658be700 1 -- 172.21.15.167:0/2695983205 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'16 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322dc5eb50 2023-10-05T19:50:31.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.545+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc658d0 con 0x56322dc5eb50 2023-10-05T19:50:31.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.545+0000 7f05658be700 1 -- 172.21.15.167:0/2695983205 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322dc5eb50 2023-10-05T19:50:31.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.545+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc65900 con 0x56322dc57bf0 2023-10-05T19:50:31.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.549+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.549+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc65900 con 0x56322dc622d0 2023-10-05T19:50:31.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.549+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'16 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc622d0 2023-10-05T19:50:31.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.549+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc65900 con 0x56322dc57bf0 2023-10-05T19:50:31.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.553+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc57bf0 2023-10-05T19:50:31.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.553+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc65900 con 0x56322dc622d0 2023-10-05T19:50:31.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.557+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'22 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc622d0 2023-10-05T19:50:31.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.557+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc65900 con 0x56322dc5b370 2023-10-05T19:50:31.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.557+0000 7f05648bc700 1 -- 172.21.15.167:0/2695983205 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f055004a070 con 0x56322dc5b370 2023-10-05T19:50:31.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f04a57fa700 20 reqs_thread_entry: start 2023-10-05T19:50:31.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f049effd700 20 reqs_thread_entry: start 2023-10-05T19:50:31.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f0567588e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:31.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f0567588e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:31.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f049d7fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:01 2023 2023-10-05T19:50:31.569 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:31.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f049cff9700 20 reqs_thread_entry: start 2023-10-05T19:50:31.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f0567588e40 20 get_system_obj_state: rctx=0x7fff9d825fc8 obj=default.rgw.meta:users.uid:bar state=0x56322dacd0b0 s->prefetch_data=0 2023-10-05T19:50:31.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f0567588e40 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2023-10-05T19:50:31.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dcc4950 con 0x7f0558016b80 2023-10-05T19:50:31.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 bar [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f0567588e40 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2023-10-05T19:50:31.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.561+0000 7f0567588e40 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T19:50:31.571 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, user does not exist 2023-10-05T19:50:31.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.565+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94773516117200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dcc4950 con 0x56322dc29430 2023-10-05T19:50:31.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.565+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94773516117200] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.565+0000 7f0567588e40 20 remove_watcher() i=0 2023-10-05T19:50:31.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.565+0000 7f0567588e40 2 removed watcher, disabling cache 2023-10-05T19:50:31.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.565+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94773516128704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dcc4950 con 0x56322db69570 2023-10-05T19:50:31.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.569+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94773516128704] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.569+0000 7f0567588e40 20 remove_watcher() i=1 2023-10-05T19:50:31.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.569+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94773516126336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dcc4950 con 0x56322dc29430 2023-10-05T19:50:31.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.569+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94773516126336] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.569+0000 7f0567588e40 20 remove_watcher() i=2 2023-10-05T19:50:31.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.569+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94773516132432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dcc4950 con 0x7f0558016b80 2023-10-05T19:50:31.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.573+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94773516132432] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.573+0000 7f0567588e40 20 remove_watcher() i=3 2023-10-05T19:50:31.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.573+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94773516134784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dcc4950 con 0x56322dc29430 2023-10-05T19:50:31.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.573+0000 7f05650bd700 1 -- 172.21.15.167:0/1198924557 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94773516134784] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055800d7f0 con 0x56322dc29430 2023-10-05T19:50:31.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.573+0000 7f0567588e40 20 remove_watcher() i=4 2023-10-05T19:50:31.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.573+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94773516136976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dcc4950 con 0x56322dc2e3b0 2023-10-05T19:50:31.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.577+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94773516136976] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055004a070 con 0x56322dc2e3b0 2023-10-05T19:50:31.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.577+0000 7f0567588e40 20 remove_watcher() i=5 2023-10-05T19:50:31.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.577+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94773516142144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc351c0 con 0x56322dc2e3b0 2023-10-05T19:50:31.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.577+0000 7f05648bc700 1 -- 172.21.15.167:0/1198924557 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94773516142144] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f055004a070 con 0x56322dc2e3b0 2023-10-05T19:50:31.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.577+0000 7f0567588e40 20 remove_watcher() i=6 2023-10-05T19:50:31.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.577+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94773516145376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc36050 con 0x7f0558016b80 2023-10-05T19:50:31.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.581+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94773516145376] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x7f0558016b80 2023-10-05T19:50:31.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.581+0000 7f0567588e40 20 remove_watcher() i=7 2023-10-05T19:50:31.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.581+0000 7f05367e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:31.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.581+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94773516146480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56322dc83e90 con 0x56322db69570 2023-10-05T19:50:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 94773516146480] v30'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f056000a5a0 con 0x56322db69570 2023-10-05T19:50:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc29430 msgr2=0x56322dc2b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc29430 0x56322dc2b810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322db69570 msgr2=0x56322dc27470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322db69570 0x56322dc27470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0558016b80 msgr2=0x7f05580420e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0558016b80 0x7f05580420e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc2e3b0 msgr2=0x56322dc30790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc2e3b0 0x56322dc30790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0548030bf0 msgr2=0x7f05480330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0548030bf0 0x7f05480330a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0550005a90 tx=0x7f0550015000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f05658be700 1 -- 172.21.15.167:0/1198924557 reap_dead start 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 msgr2=0x56322dc1b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc1b9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0558000c00 tx=0x7f0558016000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 shutdown_connections 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/1198924557 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322db68260 0x56322dc1b9b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 >> 172.21.15.167:0/1198924557 conn(0x56322dbef340 msgr2=0x56322dc0f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 shutdown_connections 2023-10-05T19:50:31.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/1198924557 wait complete. 2023-10-05T19:50:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc57bf0 msgr2=0x56322dc5a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56322dc57bf0 0x56322dc5a000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322dc622d0 msgr2=0x56322dc646e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56322dc622d0 0x56322dc646e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56322dc5b370 msgr2=0x56322dc5d750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56322dc5b370 0x56322dc5d750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc5eb50 msgr2=0x56322dc60f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56322dc5eb50 0x56322dc60f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04ac030c00 msgr2=0x7f04ac0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04ac030c00 0x7f04ac0330b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x56322dc3a1e0 tx=0x7f056000ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:31.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 msgr2=0x56322dc4cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 --2- 172.21.15.167:0/2695983205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56322dc47510 0x56322dc4cfa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0550035040 tx=0x7f055002c000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f05650bd700 1 -- 172.21.15.167:0/2695983205 reap_dead start 2023-10-05T19:50:31.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 shutdown_connections 2023-10-05T19:50:31.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 >> 172.21.15.167:0/2695983205 conn(0x56322dc428d0 msgr2=0x56322dc40970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 shutdown_connections 2023-10-05T19:50:31.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.585+0000 7f0567588e40 1 -- 172.21.15.167:0/2695983205 wait complete. 2023-10-05T19:50:31.599 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-05T19:50:31.599 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2023-10-05T19:50:31.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2023-10-05T19:50:31.600 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2023-10-05T19:50:31.636 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:31.636 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:31.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.629+0000 7fac7ca10e40 1 Processor -- start 2023-10-05T19:50:31.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.629+0000 7fac7ca10e40 1 -- start start 2023-10-05T19:50:31.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.629+0000 7fac7ca10e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5564a4f11120 0x5564a4f13500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.629+0000 7fac7ca10e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5564a4e57bd0 con 0x5564a4f0cb50 2023-10-05T19:50:31.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.629+0000 7fac7ca10e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5564a4e14ee0 con 0x5564a4f11120 2023-10-05T19:50:31.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.629+0000 7fac79d44700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5564a4f11120 0x5564a4f13500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.629+0000 7fac7a545700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x5564a4f0cb50 0x5564a4f0cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39814/0 (socket says 172.21.15.167:39814) 2023-10-05T19:50:31.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.629+0000 7fac7a545700 1 -- 172.21.15.167:0/485625150 learned_addr learned my addr 172.21.15.167:0/485625150 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:31.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac79543700 1 -- 172.21.15.167:0/485625150 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285375862 0 0) 0x5564a4e57bd0 con 0x5564a4f0cb50 2023-10-05T19:50:31.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac79543700 1 -- 172.21.15.167:0/485625150 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac64001e10 con 0x5564a4f0cb50 2023-10-05T19:50:31.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac79d44700 1 -- 172.21.15.167:0/485625150 >> v1:172.21.15.118:6789/0 conn(0x5564a4f0cb50 legacy=0x5564a4f0cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac79d44700 1 -- 172.21.15.167:0/485625150 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a4f0d760 con 0x5564a4f11120 2023-10-05T19:50:31.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac79d44700 1 --2- 172.21.15.167:0/485625150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f11120 0x5564a4f13500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac7000a5d0 tx=0x7fac70005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f5bd6726f7db9a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac79543700 1 -- 172.21.15.167:0/485625150 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac70007610 con 0x5564a4f11120 2023-10-05T19:50:31.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac79543700 1 -- 172.21.15.167:0/485625150 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac70007770 con 0x5564a4f11120 2023-10-05T19:50:31.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac79543700 1 -- 172.21.15.167:0/485625150 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac70007a40 con 0x5564a4f11120 2023-10-05T19:50:31.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 -- 172.21.15.167:0/485625150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f11120 msgr2=0x5564a4f13500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/485625150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f11120 0x5564a4f13500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac7000a5d0 tx=0x7fac70005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:31.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 -- 172.21.15.167:0/485625150 shutdown_connections 2023-10-05T19:50:31.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/485625150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f11120 0x5564a4f13500 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 -- 172.21.15.167:0/485625150 >> 172.21.15.167:0/485625150 conn(0x5564a4e805c0 msgr2=0x5564a4e809c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 -- 172.21.15.167:0/485625150 shutdown_connections 2023-10-05T19:50:31.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 -- 172.21.15.167:0/485625150 wait complete. 2023-10-05T19:50:31.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 Processor -- start 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 -- start start 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f2b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7ca10e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a4dd8e30 con 0x5564a4f0cb50 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7a545700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f2b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7a545700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f2b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46640/0 (socket says 172.21.15.167:46640) 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7a545700 1 -- 172.21.15.167:0/2696590753 learned_addr learned my addr 172.21.15.167:0/2696590753 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.633+0000 7fac7a545700 1 -- 172.21.15.167:0/2696590753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70005cf0 con 0x5564a4f0cb50 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7a545700 1 --2- 172.21.15.167:0/2696590753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f2b9e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fac74006e70 tx=0x7fac74006a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1711b934bd18867 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac6bfff700 1 -- 172.21.15.167:0/2696590753 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac74006110 con 0x5564a4f0cb50 2023-10-05T19:50:31.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac6bfff700 1 -- 172.21.15.167:0/2696590753 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac74006290 con 0x5564a4f0cb50 2023-10-05T19:50:31.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac6bfff700 1 -- 172.21.15.167:0/2696590753 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac74004520 con 0x5564a4f0cb50 2023-10-05T19:50:31.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 -- 172.21.15.167:0/2696590753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 msgr2=0x5564a4f2b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/2696590753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f2b9e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fac74006e70 tx=0x7fac74006a20 comp rx=0 tx=0).stop 2023-10-05T19:50:31.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 -- 172.21.15.167:0/2696590753 shutdown_connections 2023-10-05T19:50:31.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/2696590753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f2b9e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 -- 172.21.15.167:0/2696590753 >> 172.21.15.167:0/2696590753 conn(0x5564a4e805c0 msgr2=0x5564a4f275a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 -- 172.21.15.167:0/2696590753 shutdown_connections 2023-10-05T19:50:31.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 -- 172.21.15.167:0/2696590753 wait complete. 2023-10-05T19:50:31.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 Processor -- start 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 -- start start 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f327e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a4dabed0 con 0x5564a4f0cb50 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7a545700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7a545700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f327e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46642/0 (socket says 172.21.15.167:46642) 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 learned_addr learned my addr 172.21.15.167:0/365582798 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64001e10 con 0x5564a4f0cb50 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7a545700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f327e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5564a4f280c0 tx=0x7fac74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac6a7fc700 1 -- 172.21.15.167:0/365582798 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac74013540 con 0x5564a4f0cb50 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac6a7fc700 1 -- 172.21.15.167:0/365582798 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac740136a0 con 0x5564a4f0cb50 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564a4f32d20 con 0x5564a4f0cb50 2023-10-05T19:50:31.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac6a7fc700 1 -- 172.21.15.167:0/365582798 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac74013990 con 0x5564a4f0cb50 2023-10-05T19:50:31.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.637+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564a4f33160 con 0x5564a4f0cb50 2023-10-05T19:50:31.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac6a7fc700 1 -- 172.21.15.167:0/365582798 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fac7401a070 con 0x5564a4f0cb50 2023-10-05T19:50:31.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac6a7fc700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fac5c030c50 0x7fac5c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac6a7fc700 1 -- 172.21.15.167:0/365582798 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fac74044cb0 con 0x5564a4f0cb50 2023-10-05T19:50:31.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac79d44700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fac5c030c50 0x7fac5c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f11120 0x5564a4f3e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f3e9d0 con 0x5564a4f11120 2023-10-05T19:50:31.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ad46700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f11120 0x5564a4f3e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ad46700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f11120 0x5564a4f3e2d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac79d44700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fac5c030c50 0x7fac5c033100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac7000afd0 tx=0x7fac70014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac6c00a500 con 0x5564a4f11120 2023-10-05T19:50:31.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ca10e40 20 realm 2023-10-05T19:50:31.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.641+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f3b930 con 0x5564a4f11120 2023-10-05T19:50:31.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac6c00a500 con 0x5564a4f11120 2023-10-05T19:50:31.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:31.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f3f4b0 con 0x5564a4f11120 2023-10-05T19:50:31.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac6c00a500 con 0x5564a4f11120 2023-10-05T19:50:31.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f402e0 0x5564a4f426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f42c00 con 0x5564a4f402e0 2023-10-05T19:50:31.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7a545700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f402e0 0x5564a4f426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7a545700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f402e0 0x5564a4f426c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f434a0 con 0x5564a4f11120 2023-10-05T19:50:31.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fac6c00a500 con 0x5564a4f11120 2023-10-05T19:50:31.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:31.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 20 searching for the correct realm 2023-10-05T19:50:31.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f45260 0x5564a4f47640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f45260 2023-10-05T19:50:31.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.645+0000 7fac79d44700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f45260 0x5564a4f47640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac79d44700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f45260 0x5564a4f47640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac70007da0 con 0x5564a4f45260 2023-10-05T19:50:31.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f402e0 2023-10-05T19:50:31.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7a545700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fac7403fc30 0x7fac740113e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x7fac7403fc30 2023-10-05T19:50:31.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7ad46700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fac7403fc30 0x7fac740113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7ad46700 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fac7403fc30 0x7fac740113e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x7fac7403fc30 2023-10-05T19:50:31.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f45260 2023-10-05T19:50:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.649+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f402e0 2023-10-05T19:50:31.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f402e0 2023-10-05T19:50:31.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x7fac7403fc30 2023-10-05T19:50:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x7fac7403fc30 2023-10-05T19:50:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x7fac7403fc30 2023-10-05T19:50:31.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x7fac7403fc30 2023-10-05T19:50:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.653+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f402e0 2023-10-05T19:50:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f45260 2023-10-05T19:50:31.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f402e0 2023-10-05T19:50:31.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f45260 2023-10-05T19:50:31.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.657+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f45260 2023-10-05T19:50:31.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x7fac7403fc30 2023-10-05T19:50:31.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x7fac7403fc30 2023-10-05T19:50:31.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f11120 2023-10-05T19:50:31.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x7fac7403fc30 2023-10-05T19:50:31.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x7fac7403fc30 2023-10-05T19:50:31.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f45260 2023-10-05T19:50:31.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x7fac7403fc30 2023-10-05T19:50:31.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x7fac7403fc30 2023-10-05T19:50:31.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f402e0 2023-10-05T19:50:31.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.661+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f402e0 2023-10-05T19:50:31.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f45260 2023-10-05T19:50:31.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f402e0 2023-10-05T19:50:31.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47b80 con 0x5564a4f402e0 2023-10-05T19:50:31.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:31.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:31.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:31.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:31.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f44010 con 0x5564a4f11120 2023-10-05T19:50:31.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f44960 con 0x5564a4f402e0 2023-10-05T19:50:31.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.665+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f47fc0 con 0x5564a4f402e0 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48370 con 0x5564a4f45260 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f444a0 con 0x5564a4f402e0 2023-10-05T19:50:31.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f49fd0 con 0x5564a4f45260 2023-10-05T19:50:31.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f49fd0 con 0x5564a4f402e0 2023-10-05T19:50:31.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.669+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f49fd0 con 0x7fac7403fc30 2023-10-05T19:50:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x7fac7403fc30 2023-10-05T19:50:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f45260 2023-10-05T19:50:31.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f402e0 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f402e0 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.673+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x7fac7403fc30 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x7fac7403fc30 2023-10-05T19:50:31.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x7fac7403fc30 2023-10-05T19:50:31.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x7fac7403fc30 2023-10-05T19:50:31.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f402e0 2023-10-05T19:50:31.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f45260 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.677+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f402e0 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f45260 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c014040 con 0x5564a4f11120 2023-10-05T19:50:31.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f45260 2023-10-05T19:50:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x7fac7403fc30 2023-10-05T19:50:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f11120 2023-10-05T19:50:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.681+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x7fac7403fc30 2023-10-05T19:50:31.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f45260 2023-10-05T19:50:31.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x7fac7403fc30 2023-10-05T19:50:31.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f402e0 2023-10-05T19:50:31.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f402e0 2023-10-05T19:50:31.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f45260 2023-10-05T19:50:31.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.685+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f402e0 2023-10-05T19:50:31.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48720 con 0x5564a4f402e0 2023-10-05T19:50:31.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:31.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:31.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:31.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:31.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f48fc0 con 0x5564a4f402e0 2023-10-05T19:50:31.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f493c0 con 0x5564a4f11120 2023-10-05T19:50:31.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:31.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.689+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f49cb0 con 0x5564a4f402e0 2023-10-05T19:50:31.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f49cb0 con 0x5564a4f402e0 2023-10-05T19:50:31.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:31.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f49cb0 con 0x7fac7403fc30 2023-10-05T19:50:31.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 zone default found 2023-10-05T19:50:31.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 4 Realm: () 2023-10-05T19:50:31.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:31.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:31.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:31.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 zonegroup default 2023-10-05T19:50:31.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f49cb0 con 0x7fac7403fc30 2023-10-05T19:50:31.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f49cb0 con 0x5564a4f45260 2023-10-05T19:50:31.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4bc90 con 0x5564a4f45260 2023-10-05T19:50:31.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 started sync module instance, tier type = 2023-10-05T19:50:31.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.693+0000 7fac7ca10e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:31.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.697+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4b350 con 0x5564a4f402e0 2023-10-05T19:50:31.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.697+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.697+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93890752583616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4b350 con 0x5564a4f402e0 2023-10-05T19:50:31.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.697+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4c530 con 0x5564a4f11120 2023-10-05T19:50:31.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.701+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93890752583616] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.701+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.701+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93890752591696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4c530 con 0x5564a4f11120 2023-10-05T19:50:31.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.701+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4cdd0 con 0x5564a4f402e0 2023-10-05T19:50:31.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.701+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93890752591696] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.701+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.701+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93890752594272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4caa0 con 0x5564a4f402e0 2023-10-05T19:50:31.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.701+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4d4f0 con 0x7fac7403fc30 2023-10-05T19:50:31.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.705+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.705+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93890752597952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4d410 con 0x7fac7403fc30 2023-10-05T19:50:31.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.705+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4e440 con 0x5564a4f402e0 2023-10-05T19:50:31.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.705+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93890752594272] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.705+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93890752597952] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.705+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.705+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93890752600304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4df50 con 0x5564a4f402e0 2023-10-05T19:50:31.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.705+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4e7f0 con 0x5564a4f45260 2023-10-05T19:50:31.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93890752602496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4f090 con 0x5564a4f45260 2023-10-05T19:50:31.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4faa0 con 0x5564a4f45260 2023-10-05T19:50:31.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93890752600304] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 93890752602496] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93890752607664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4fea0 con 0x5564a4f45260 2023-10-05T19:50:31.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f50740 con 0x7fac7403fc30 2023-10-05T19:50:31.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93890752607664] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac7001f480 con 0x5564a4f45260 2023-10-05T19:50:31.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93890752611456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f50e00 con 0x7fac7403fc30 2023-10-05T19:50:31.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 20 add_watcher() i=0 2023-10-05T19:50:31.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 20 add_watcher() i=1 2023-10-05T19:50:31.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 20 add_watcher() i=2 2023-10-05T19:50:31.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 20 add_watcher() i=3 2023-10-05T19:50:31.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 20 add_watcher() i=4 2023-10-05T19:50:31.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 20 add_watcher() i=5 2023-10-05T19:50:31.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.709+0000 7fac7ca10e40 20 add_watcher() i=6 2023-10-05T19:50:31.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93890752611456] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ca10e40 20 add_watcher() i=7 2023-10-05T19:50:31.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ca10e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:31.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4c670 con 0x5564a4f11120 2023-10-05T19:50:31.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93890752612560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4c670 con 0x5564a4f11120 2023-10-05T19:50:31.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93890752612560] v30'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac4bfdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:31.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ca10e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:31.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ca10e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:31.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ca10e40 1 Processor -- start 2023-10-05T19:50:31.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.713+0000 7fac7ca10e40 1 -- start start 2023-10-05T19:50:31.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f5e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a4f5ed90 con 0x5564a4f5e480 2023-10-05T19:50:31.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac79d44700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f5e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac79d44700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f5e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46654/0 (socket says 172.21.15.167:46654) 2023-10-05T19:50:31.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac79d44700 1 -- 172.21.15.167:0/153123855 learned_addr learned my addr 172.21.15.167:0/153123855 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac79d44700 1 -- 172.21.15.167:0/153123855 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a4f5eed0 con 0x5564a4f5e480 2023-10-05T19:50:31.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac79d44700 1 --2- 172.21.15.167:0/153123855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f5e850 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5564a4f0db80 tx=0x7fac70011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f192e67680690baf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac4b7de700 1 -- 172.21.15.167:0/153123855 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac70025040 con 0x5564a4f5e480 2023-10-05T19:50:31.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac4b7de700 1 -- 172.21.15.167:0/153123855 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac70031040 con 0x5564a4f5e480 2023-10-05T19:50:31.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac4b7de700 1 -- 172.21.15.167:0/153123855 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac7002b8a0 con 0x5564a4f5e480 2023-10-05T19:50:31.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 -- 172.21.15.167:0/153123855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 msgr2=0x5564a4f5e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/153123855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f5e850 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5564a4f0db80 tx=0x7fac70011000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 -- 172.21.15.167:0/153123855 shutdown_connections 2023-10-05T19:50:31.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/153123855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f5e850 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 -- 172.21.15.167:0/153123855 >> 172.21.15.167:0/153123855 conn(0x5564a4f59840 msgr2=0x5564a4f57990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 -- 172.21.15.167:0/153123855 shutdown_connections 2023-10-05T19:50:31.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 -- 172.21.15.167:0/153123855 wait complete. 2023-10-05T19:50:31.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 Processor -- start 2023-10-05T19:50:31.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 -- start start 2023-10-05T19:50:31.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f63eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.717+0000 7fac7ca10e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564a4f64eb0 con 0x5564a4f5e480 2023-10-05T19:50:31.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac79d44700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f63eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac79d44700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f63eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46668/0 (socket says 172.21.15.167:46668) 2023-10-05T19:50:31.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac79d44700 1 -- 172.21.15.167:0/32199243 learned_addr learned my addr 172.21.15.167:0/32199243 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac79d44700 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564a4f0d760 con 0x5564a4f5e480 2023-10-05T19:50:31.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac79d44700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f63eb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5564a4f58500 tx=0x7fac70036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac49fdb700 1 -- 172.21.15.167:0/32199243 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac70025040 con 0x5564a4f5e480 2023-10-05T19:50:31.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac49fdb700 1 -- 172.21.15.167:0/32199243 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac70043070 con 0x5564a4f5e480 2023-10-05T19:50:31.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac49fdb700 1 -- 172.21.15.167:0/32199243 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac70037c60 con 0x5564a4f5e480 2023-10-05T19:50:31.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564a4f644b0 con 0x5564a4f5e480 2023-10-05T19:50:31.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564a4f648f0 con 0x5564a4f5e480 2023-10-05T19:50:31.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac49fdb700 1 -- 172.21.15.167:0/32199243 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fac70028040 con 0x5564a4f5e480 2023-10-05T19:50:31.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac49fdb700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fabc0030c50 0x7fabc0033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac49fdb700 1 -- 172.21.15.167:0/32199243 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fac70045070 con 0x5564a4f5e480 2023-10-05T19:50:31.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac7ad46700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fabc0030c50 0x7fabc0033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f6eb90 0x5564a4f70fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.721+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f715f0 con 0x5564a4f6eb90 2023-10-05T19:50:31.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.725+0000 7fac7a545700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f6eb90 0x5564a4f70fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.725+0000 7fac7ad46700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fabc0030c50 0x7fabc0033100 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x5564a4f50d90 tx=0x7fac6c00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.725+0000 7fac7a545700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f6eb90 0x5564a4f70fa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.725+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.725+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5564a4f722c0 0x5564a4f746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.725+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f74e00 con 0x5564a4f722c0 2023-10-05T19:50:31.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.725+0000 7fac79d44700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5564a4f722c0 0x5564a4f746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.725+0000 7fac79d44700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5564a4f722c0 0x5564a4f746d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.729+0000 7fac79d44700 1 -- 172.21.15.167:0/32199243 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac7003d020 con 0x5564a4f722c0 2023-10-05T19:50:31.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.729+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f75ad0 0x5564a4f77eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.729+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f785b0 con 0x5564a4f75ad0 2023-10-05T19:50:31.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.729+0000 7fac7ad46700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f75ad0 0x5564a4f77eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.729+0000 7fac7ad46700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f75ad0 0x5564a4f77eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.729+0000 7fac7ad46700 1 -- 172.21.15.167:0/32199243 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f75ad0 2023-10-05T19:50:31.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.729+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f79250 0x5564a4f7b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.729+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7bd90 con 0x5564a4f79250 2023-10-05T19:50:31.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.733+0000 7fac7a545700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f79250 0x5564a4f7b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.733+0000 7fac7a545700 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f79250 0x5564a4f7b660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.733+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'37 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f79250 2023-10-05T19:50:31.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.733+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7c3e0 con 0x5564a4f6eb90 2023-10-05T19:50:31.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.737+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.737+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7ca00 con 0x5564a4f75ad0 2023-10-05T19:50:31.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.737+0000 7fac7ad46700 1 -- 172.21.15.167:0/32199243 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f75ad0 2023-10-05T19:50:31.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.737+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7d020 con 0x5564a4f6eb90 2023-10-05T19:50:31.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.741+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.741+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7d510 con 0x5564a4f79250 2023-10-05T19:50:31.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.741+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f79250 2023-10-05T19:50:31.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.741+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7d510 con 0x5564a4f6eb90 2023-10-05T19:50:31.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.745+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.745+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7d510 con 0x5564a4f6eb90 2023-10-05T19:50:31.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.745+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.745+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7d510 con 0x5564a4f6eb90 2023-10-05T19:50:31.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.749+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.749+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7d510 con 0x5564a4f75ad0 2023-10-05T19:50:31.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.749+0000 7fac7ad46700 1 -- 172.21.15.167:0/32199243 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f75ad0 2023-10-05T19:50:31.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.749+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f6eb90 2023-10-05T19:50:31.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.753+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.753+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f79250 2023-10-05T19:50:31.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.753+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f79250 2023-10-05T19:50:31.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.753+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f79250 2023-10-05T19:50:31.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.757+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f79250 2023-10-05T19:50:31.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.757+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f6eb90 2023-10-05T19:50:31.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.757+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.757+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f6eb90 2023-10-05T19:50:31.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.761+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.761+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f75ad0 2023-10-05T19:50:31.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.765+0000 7fac7ad46700 1 -- 172.21.15.167:0/32199243 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f75ad0 2023-10-05T19:50:31.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.765+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7dd30 con 0x5564a4f6eb90 2023-10-05T19:50:31.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.765+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.765+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7dd30 con 0x5564a4f79250 2023-10-05T19:50:31.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.769+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'39 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f79250 2023-10-05T19:50:31.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.769+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f6eb90 2023-10-05T19:50:31.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.769+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.769+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f6eb90 2023-10-05T19:50:31.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.773+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.773+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db70 con 0x5564a4f75ad0 2023-10-05T19:50:31.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.773+0000 7fac7ad46700 1 -- 172.21.15.167:0/32199243 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f75ad0 2023-10-05T19:50:31.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.773+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7dc20 con 0x5564a4f6eb90 2023-10-05T19:50:31.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.777+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.777+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7dc20 con 0x5564a4f75ad0 2023-10-05T19:50:31.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.781+0000 7fac7ad46700 1 -- 172.21.15.167:0/32199243 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f75ad0 2023-10-05T19:50:31.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.781+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7dbc0 con 0x5564a4f75ad0 2023-10-05T19:50:31.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.781+0000 7fac7ad46700 1 -- 172.21.15.167:0/32199243 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'18 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f75ad0 2023-10-05T19:50:31.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.781+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f75ad0 2023-10-05T19:50:31.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.785+0000 7fac7ad46700 1 -- 172.21.15.167:0/32199243 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f75ad0 2023-10-05T19:50:31.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.785+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f6eb90 2023-10-05T19:50:31.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.785+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.785+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f79250 2023-10-05T19:50:31.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.789+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'18 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f79250 2023-10-05T19:50:31.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.789+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f6eb90 2023-10-05T19:50:31.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.793+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f6eb90 2023-10-05T19:50:31.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.793+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f79250 2023-10-05T19:50:31.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.793+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'24 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f79250 2023-10-05T19:50:31.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.793+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f7db30 con 0x5564a4f722c0 2023-10-05T19:50:31.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.793+0000 7fac79d44700 1 -- 172.21.15.167:0/32199243 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac7003d020 con 0x5564a4f722c0 2023-10-05T19:50:31.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.797+0000 7fabbaffd700 20 reqs_thread_entry: start 2023-10-05T19:50:31.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.797+0000 7fac7ca10e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:31.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.797+0000 7fabb8ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:31.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.797+0000 7fac7ca10e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:31.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.797+0000 7fabaeffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:01 2023 2023-10-05T19:50:31.806 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:31.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.797+0000 7fabae7fc700 20 reqs_thread_entry: start 2023-10-05T19:50:31.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.797+0000 7fac7ca10e40 20 get_system_obj_state: rctx=0x7ffe4fe28778 obj=default.rgw.meta:users.uid:fud state=0x5564a4de40b0 s->prefetch_data=0 2023-10-05T19:50:31.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.797+0000 7fac7ca10e40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T19:50:31.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.797+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4fdcce0 con 0x7fac7403fc30 2023-10-05T19:50:31.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.801+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 fud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.801+0000 7fac7ca10e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-10-05T19:50:31.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.801+0000 7fac7ca10e40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:31.807 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, user does not exist 2023-10-05T19:50:31.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.801+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93890752583616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4fdcce0 con 0x5564a4f402e0 2023-10-05T19:50:31.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.801+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 93890752583616] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.801+0000 7fac7ca10e40 20 remove_watcher() i=0 2023-10-05T19:50:31.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.801+0000 7fac7ca10e40 2 removed watcher, disabling cache 2023-10-05T19:50:31.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.801+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93890752591696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4fdcce0 con 0x5564a4f11120 2023-10-05T19:50:31.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.805+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 93890752591696] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.805+0000 7fac7ca10e40 20 remove_watcher() i=1 2023-10-05T19:50:31.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.805+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93890752594272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4fdcce0 con 0x5564a4f402e0 2023-10-05T19:50:31.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.805+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 93890752594272] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.805+0000 7fac7ca10e40 20 remove_watcher() i=2 2023-10-05T19:50:31.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.805+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93890752597952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4fdcce0 con 0x7fac7403fc30 2023-10-05T19:50:31.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.809+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 93890752597952] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.809+0000 7fac7ca10e40 20 remove_watcher() i=3 2023-10-05T19:50:31.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.809+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93890752600304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4fdcce0 con 0x5564a4f402e0 2023-10-05T19:50:31.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.809+0000 7fac7a545700 1 -- 172.21.15.167:0/365582798 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 93890752600304] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac74044040 con 0x5564a4f402e0 2023-10-05T19:50:31.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.809+0000 7fac7ca10e40 20 remove_watcher() i=4 2023-10-05T19:50:31.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.809+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93890752602496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4fdcce0 con 0x5564a4f45260 2023-10-05T19:50:31.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.813+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 93890752602496] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac7003d020 con 0x5564a4f45260 2023-10-05T19:50:31.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.813+0000 7fac7ca10e40 20 remove_watcher() i=5 2023-10-05T19:50:31.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.813+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93890752607664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4b750 con 0x5564a4f45260 2023-10-05T19:50:31.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.813+0000 7fac79d44700 1 -- 172.21.15.167:0/365582798 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 93890752607664] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac7003d020 con 0x5564a4f45260 2023-10-05T19:50:31.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.813+0000 7fac7ca10e40 20 remove_watcher() i=6 2023-10-05T19:50:31.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.813+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93890752611456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4cfc0 con 0x7fac7403fc30 2023-10-05T19:50:31.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.817+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 93890752611456] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x7fac7403fc30 2023-10-05T19:50:31.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.817+0000 7fac7ca10e40 20 remove_watcher() i=7 2023-10-05T19:50:31.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.817+0000 7fac4bfdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:31.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.817+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93890752612560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5564a4f4cfc0 con 0x5564a4f11120 2023-10-05T19:50:31.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 93890752612560] v30'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fac6c033040 con 0x5564a4f11120 2023-10-05T19:50:31.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f402e0 msgr2=0x5564a4f426c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f402e0 0x5564a4f426c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f11120 msgr2=0x5564a4f3e2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f11120 0x5564a4f3e2d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fac7403fc30 msgr2=0x7fac740113e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fac7403fc30 0x7fac740113e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f45260 msgr2=0x5564a4f47640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f45260 0x5564a4f47640 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fac5c030c50 msgr2=0x7fac5c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fac5c030c50 0x7fac5c033100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac7000afd0 tx=0x7fac70014000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 msgr2=0x5564a4f327e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ad46700 1 -- 172.21.15.167:0/365582798 reap_dead start 2023-10-05T19:50:31.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f327e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5564a4f280c0 tx=0x7fac74014000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 shutdown_connections 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/365582798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f0cb50 0x5564a4f327e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 >> 172.21.15.167:0/365582798 conn(0x5564a4e805c0 msgr2=0x5564a4f26020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 shutdown_connections 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/365582798 wait complete. 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f6eb90 msgr2=0x5564a4f70fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5564a4f6eb90 0x5564a4f70fa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f79250 msgr2=0x5564a4f7b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5564a4f79250 0x5564a4f7b660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5564a4f722c0 msgr2=0x5564a4f746d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5564a4f722c0 0x5564a4f746d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f75ad0 msgr2=0x5564a4f77eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5564a4f75ad0 0x5564a4f77eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fabc0030c50 msgr2=0x7fabc0033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fabc0030c50 0x7fabc0033100 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x5564a4f50d90 tx=0x7fac6c00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 msgr2=0x5564a4f63eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f63eb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5564a4f58500 tx=0x7fac70036000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7a545700 1 -- 172.21.15.167:0/32199243 reap_dead start 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 shutdown_connections 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 --2- 172.21.15.167:0/32199243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5564a4f5e480 0x5564a4f63eb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 >> 172.21.15.167:0/32199243 conn(0x5564a4f59840 msgr2=0x5564a4f578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 shutdown_connections 2023-10-05T19:50:31.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.821+0000 7fac7ca10e40 1 -- 172.21.15.167:0/32199243 wait complete. 2023-10-05T19:50:31.833 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-05T19:50:31.834 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2023-10-05T19:50:31.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2023-10-05T19:50:31.834 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2023-10-05T19:50:31.872 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:31.872 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:31.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f255b755e40 1 Processor -- start 2023-10-05T19:50:31.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f255b755e40 1 -- start start 2023-10-05T19:50:31.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f255b755e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5576e671eb50 0x5576e671ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f255b755e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5576e6669bd0 con 0x5576e671f460 2023-10-05T19:50:31.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f255b755e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5576e6626ee0 con 0x5576e671eb50 2023-10-05T19:50:31.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f255928a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5576e671eb50 0x5576e671ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f2558a89700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x5576e671f460 0x5576e671fef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39816/0 (socket says 172.21.15.167:39816) 2023-10-05T19:50:31.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f2558a89700 1 -- 172.21.15.167:0/3594375418 learned_addr learned my addr 172.21.15.167:0/3594375418 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:31.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f2553fff700 1 -- 172.21.15.167:0/3594375418 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815650540 0 0) 0x5576e6669bd0 con 0x5576e671f460 2023-10-05T19:50:31.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.865+0000 7f2553fff700 1 -- 172.21.15.167:0/3594375418 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f253c001e10 con 0x5576e671f460 2023-10-05T19:50:31.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255928a700 1 -- 172.21.15.167:0/3594375418 >> v1:172.21.15.118:6789/0 conn(0x5576e671f460 legacy=0x5576e671fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255928a700 1 -- 172.21.15.167:0/3594375418 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e6720600 con 0x5576e671eb50 2023-10-05T19:50:31.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255928a700 1 --2- 172.21.15.167:0/3594375418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e671ef20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f255400a5d0 tx=0x7f2554005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c10f25a68ec14c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f2553fff700 1 -- 172.21.15.167:0/3594375418 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2554007610 con 0x5576e671eb50 2023-10-05T19:50:31.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f2553fff700 1 -- 172.21.15.167:0/3594375418 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2554007770 con 0x5576e671eb50 2023-10-05T19:50:31.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f2553fff700 1 -- 172.21.15.167:0/3594375418 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2554007a40 con 0x5576e671eb50 2023-10-05T19:50:31.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 -- 172.21.15.167:0/3594375418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 msgr2=0x5576e671ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 --2- 172.21.15.167:0/3594375418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e671ef20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f255400a5d0 tx=0x7f2554005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:31.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 -- 172.21.15.167:0/3594375418 shutdown_connections 2023-10-05T19:50:31.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 --2- 172.21.15.167:0/3594375418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e671ef20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 -- 172.21.15.167:0/3594375418 >> 172.21.15.167:0/3594375418 conn(0x5576e66925c0 msgr2=0x5576e66929c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 -- 172.21.15.167:0/3594375418 shutdown_connections 2023-10-05T19:50:31.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 -- 172.21.15.167:0/3594375418 wait complete. 2023-10-05T19:50:31.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 Processor -- start 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 -- start start 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e673d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255b755e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e65eae30 con 0x5576e671eb50 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255928a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e673d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255928a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e673d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46696/0 (socket says 172.21.15.167:46696) 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255928a700 1 -- 172.21.15.167:0/3737766947 learned_addr learned my addr 172.21.15.167:0/3737766947 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.869+0000 7f255928a700 1 -- 172.21.15.167:0/3737766947 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554005cf0 con 0x5576e671eb50 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255928a700 1 --2- 172.21.15.167:0/3737766947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e673d9d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2554005cc0 tx=0x7f2554014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d78092ad164fd7e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f2552ffd700 1 -- 172.21.15.167:0/3737766947 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2554007a30 con 0x5576e671eb50 2023-10-05T19:50:31.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f2552ffd700 1 -- 172.21.15.167:0/3737766947 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2554007b90 con 0x5576e671eb50 2023-10-05T19:50:31.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f2552ffd700 1 -- 172.21.15.167:0/3737766947 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2554007e80 con 0x5576e671eb50 2023-10-05T19:50:31.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 -- 172.21.15.167:0/3737766947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 msgr2=0x5576e673d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 --2- 172.21.15.167:0/3737766947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e673d9d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2554005cc0 tx=0x7f2554014000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 -- 172.21.15.167:0/3737766947 shutdown_connections 2023-10-05T19:50:31.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 --2- 172.21.15.167:0/3737766947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e673d9d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 -- 172.21.15.167:0/3737766947 >> 172.21.15.167:0/3737766947 conn(0x5576e66925c0 msgr2=0x5576e6739590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 -- 172.21.15.167:0/3737766947 shutdown_connections 2023-10-05T19:50:31.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 -- 172.21.15.167:0/3737766947 wait complete. 2023-10-05T19:50:31.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 Processor -- start 2023-10-05T19:50:31.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 -- start start 2023-10-05T19:50:31.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e67445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255b755e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e65bded0 con 0x5576e671eb50 2023-10-05T19:50:31.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255928a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e67445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255928a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e67445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46710/0 (socket says 172.21.15.167:46710) 2023-10-05T19:50:31.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 learned_addr learned my addr 172.21.15.167:0/2696078531 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.873+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e6720600 con 0x5576e671eb50 2023-10-05T19:50:31.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f255928a700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e67445e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f255400afd0 tx=0x7f255401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f25517fa700 1 -- 172.21.15.167:0/2696078531 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f255401db90 con 0x5576e671eb50 2023-10-05T19:50:31.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f25517fa700 1 -- 172.21.15.167:0/2696078531 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255401dd10 con 0x5576e671eb50 2023-10-05T19:50:31.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f25517fa700 1 -- 172.21.15.167:0/2696078531 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2554012400 con 0x5576e671eb50 2023-10-05T19:50:31.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576e6744b20 con 0x5576e671eb50 2023-10-05T19:50:31.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576e6744fc0 con 0x5576e671eb50 2023-10-05T19:50:31.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f25517fa700 1 -- 172.21.15.167:0/2696078531 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f255402d070 con 0x5576e671eb50 2023-10-05T19:50:31.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f25517fa700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2540030c50 0x7f2540033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f25517fa700 1 -- 172.21.15.167:0/2696078531 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2554045c50 con 0x5576e671eb50 2023-10-05T19:50:31.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f2558a89700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2540030c50 0x7f2540033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e671f460 0x5576e6750010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6750740 con 0x5576e671f460 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f2559a8b700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e671f460 0x5576e6750010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.877+0000 7f2558a89700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2540030c50 0x7f2540033100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25440044f0 tx=0x7f2544006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f2559a8b700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e671f460 0x5576e6750010 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f254c00a500 con 0x5576e671f460 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 20 realm 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e674d5b0 con 0x5576e671f460 2023-10-05T19:50:31.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f254c00a500 con 0x5576e671f460 2023-10-05T19:50:31.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:31.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6751220 con 0x5576e671f460 2023-10-05T19:50:31.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f254c00a500 con 0x5576e671f460 2023-10-05T19:50:31.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e6752050 0x5576e6754430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6754970 con 0x5576e6752050 2023-10-05T19:50:31.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255928a700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e6752050 0x5576e6754430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255928a700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e6752050 0x5576e6754430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f255402c030 con 0x5576e6752050 2023-10-05T19:50:31.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.881+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6755210 con 0x5576e671f460 2023-10-05T19:50:31.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f254c00a500 con 0x5576e671f460 2023-10-05T19:50:31.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f255b755e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:31.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f255b755e40 20 searching for the correct realm 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e6756fd0 0x5576e67593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6756fd0 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f2558a89700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e6756fd0 0x5576e67593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f2558a89700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e6756fd0 0x5576e67593b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2544004520 con 0x5576e6756fd0 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6752050 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255402c030 con 0x5576e6752050 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f255928a700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2554038040 0x7f25540117e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x7f2554038040 2023-10-05T19:50:31.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f2559a8b700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2554038040 0x7f25540117e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f2559a8b700 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2554038040 0x7f25540117e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x7f2554038040 2023-10-05T19:50:31.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.885+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6756fd0 2023-10-05T19:50:31.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2544004520 con 0x5576e6756fd0 2023-10-05T19:50:31.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6752050 2023-10-05T19:50:31.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255402c030 con 0x5576e6752050 2023-10-05T19:50:31.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6752050 2023-10-05T19:50:31.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255402c030 con 0x5576e6752050 2023-10-05T19:50:31.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x7f2554038040 2023-10-05T19:50:31.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x7f2554038040 2023-10-05T19:50:31.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.889+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x7f2554038040 2023-10-05T19:50:31.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x7f2554038040 2023-10-05T19:50:31.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6752050 2023-10-05T19:50:31.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255402c030 con 0x5576e6752050 2023-10-05T19:50:31.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6756fd0 2023-10-05T19:50:31.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2544004520 con 0x5576e6756fd0 2023-10-05T19:50:31.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6752050 2023-10-05T19:50:31.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255402c030 con 0x5576e6752050 2023-10-05T19:50:31.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.893+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6756fd0 2023-10-05T19:50:31.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6756fd0 2023-10-05T19:50:31.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x7f2554038040 2023-10-05T19:50:31.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x7f2554038040 2023-10-05T19:50:31.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e671f460 2023-10-05T19:50:31.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x7f2554038040 2023-10-05T19:50:31.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x7f2554038040 2023-10-05T19:50:31.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6756fd0 2023-10-05T19:50:31.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.897+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x7f2554038040 2023-10-05T19:50:31.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x7f2554038040 2023-10-05T19:50:31.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6752050 2023-10-05T19:50:31.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255402c030 con 0x5576e6752050 2023-10-05T19:50:31.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6752050 2023-10-05T19:50:31.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255402c030 con 0x5576e6752050 2023-10-05T19:50:31.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6756fd0 2023-10-05T19:50:31.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6752050 2023-10-05T19:50:31.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67598f0 con 0x5576e6752050 2023-10-05T19:50:31.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.901+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:31.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:31.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:31.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:31.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6755d80 con 0x5576e671f460 2023-10-05T19:50:31.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67566d0 con 0x5576e6752050 2023-10-05T19:50:31.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6759d30 con 0x5576e6752050 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a0e0 con 0x5576e6756fd0 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.905+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6756210 con 0x5576e6752050 2023-10-05T19:50:31.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f255b755e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675bd40 con 0x5576e6756fd0 2023-10-05T19:50:31.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675bd40 con 0x5576e6752050 2023-10-05T19:50:31.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6756210 con 0x7f2554038040 2023-10-05T19:50:31.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x7f2554038040 2023-10-05T19:50:31.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.909+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6756fd0 2023-10-05T19:50:31.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6752050 2023-10-05T19:50:31.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6752050 2023-10-05T19:50:31.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x7f2554038040 2023-10-05T19:50:31.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x7f2554038040 2023-10-05T19:50:31.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.913+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x7f2554038040 2023-10-05T19:50:31.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x7f2554038040 2023-10-05T19:50:31.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6752050 2023-10-05T19:50:31.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6756fd0 2023-10-05T19:50:31.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6752050 2023-10-05T19:50:31.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.917+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6756fd0 2023-10-05T19:50:31.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c014040 con 0x5576e671f460 2023-10-05T19:50:31.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:31.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:31.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6756fd0 2023-10-05T19:50:31.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x7f2554038040 2023-10-05T19:50:31.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:31.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e671f460 2023-10-05T19:50:31.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:31.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.921+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x7f2554038040 2023-10-05T19:50:31.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:31.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6756fd0 2023-10-05T19:50:31.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x7f2554038040 2023-10-05T19:50:31.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:31.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6752050 2023-10-05T19:50:31.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6752050 2023-10-05T19:50:31.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6756fd0 2023-10-05T19:50:31.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.925+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6752050 2023-10-05T19:50:31.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675a490 con 0x5576e6752050 2023-10-05T19:50:31.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:31.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:31.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:31.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:31.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67561e0 con 0x5576e6752050 2023-10-05T19:50:31.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67561e0 con 0x5576e671f460 2023-10-05T19:50:31.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:31.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:31.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675aee0 con 0x5576e6752050 2023-10-05T19:50:31.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:31.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.929+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675b310 con 0x5576e6752050 2023-10-05T19:50:31.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:31.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675b310 con 0x7f2554038040 2023-10-05T19:50:31.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:31.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 zone default found 2023-10-05T19:50:31.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 4 Realm: () 2023-10-05T19:50:31.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:31.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:31.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:31.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 zonegroup default 2023-10-05T19:50:31.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675b310 con 0x7f2554038040 2023-10-05T19:50:31.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:31.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675b310 con 0x5576e6756fd0 2023-10-05T19:50:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675d0d0 con 0x5576e6756fd0 2023-10-05T19:50:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 started sync module instance, tier type = 2023-10-05T19:50:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.933+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675c790 con 0x5576e6752050 2023-10-05T19:50:31.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.937+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.937+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969160972768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675d480 con 0x5576e6752050 2023-10-05T19:50:31.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.937+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675d480 con 0x5576e671f460 2023-10-05T19:50:31.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.937+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:31.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.941+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93969160972768] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.941+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969160983680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675d8d0 con 0x5576e671f460 2023-10-05T19:50:31.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.941+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675e2e0 con 0x5576e6752050 2023-10-05T19:50:31.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.941+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93969160983680] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:31.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.941+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.941+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969160981312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675e2e0 con 0x5576e6752050 2023-10-05T19:50:31.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.941+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675eb80 con 0x7f2554038040 2023-10-05T19:50:31.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.945+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:31.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.945+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969160987648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675ef80 con 0x7f2554038040 2023-10-05T19:50:31.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.945+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93969160981312] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.945+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675ddf0 con 0x5576e6752050 2023-10-05T19:50:31.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.945+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93969160987648] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:31.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.945+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.945+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969160986096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675f4a0 con 0x5576e6752050 2023-10-05T19:50:31.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.945+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675feb0 con 0x5576e6756fd0 2023-10-05T19:50:31.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93969160986096] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e6752050 2023-10-05T19:50:31.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969160993216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6760750 con 0x5576e6756fd0 2023-10-05T19:50:31.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6760c70 con 0x5576e6756fd0 2023-10-05T19:50:31.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 93969160993216] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969160995424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6761510 con 0x5576e6756fd0 2023-10-05T19:50:31.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6761db0 con 0x7f2554038040 2023-10-05T19:50:31.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93969160995424] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:31.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:31.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969161001152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6762200 con 0x7f2554038040 2023-10-05T19:50:31.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 20 add_watcher() i=0 2023-10-05T19:50:31.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 20 add_watcher() i=1 2023-10-05T19:50:31.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 20 add_watcher() i=2 2023-10-05T19:50:31.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 20 add_watcher() i=3 2023-10-05T19:50:31.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 20 add_watcher() i=4 2023-10-05T19:50:31.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 20 add_watcher() i=5 2023-10-05T19:50:31.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.949+0000 7f255b755e40 20 add_watcher() i=6 2023-10-05T19:50:31.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93969161001152] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:31.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 20 add_watcher() i=7 2023-10-05T19:50:31.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:31.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6765260 con 0x5576e671f460 2023-10-05T19:50:31.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:31.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969161002256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6762650 con 0x5576e671f460 2023-10-05T19:50:31.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93969161002256] v30'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:31.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f2529feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:31.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:31.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:31.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 1 Processor -- start 2023-10-05T19:50:31.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 1 -- start start 2023-10-05T19:50:31.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e676fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.953+0000 7f255b755e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e67703e0 con 0x5576e676fad0 2023-10-05T19:50:31.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f2558a89700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e676fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f2558a89700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e676fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46722/0 (socket says 172.21.15.167:46722) 2023-10-05T19:50:31.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f2558a89700 1 -- 172.21.15.167:0/3177109845 learned_addr learned my addr 172.21.15.167:0/3177109845 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f2558a89700 1 -- 172.21.15.167:0/3177109845 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576e6770520 con 0x5576e676fad0 2023-10-05T19:50:31.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f2558a89700 1 --2- 172.21.15.167:0/3177109845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e676fea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f255401c9a0 tx=0x7f2544006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb5722859de6c6b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f25297ea700 1 -- 172.21.15.167:0/3177109845 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f254401a040 con 0x5576e676fad0 2023-10-05T19:50:31.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f25297ea700 1 -- 172.21.15.167:0/3177109845 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254401b040 con 0x5576e676fad0 2023-10-05T19:50:31.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f25297ea700 1 -- 172.21.15.167:0/3177109845 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2544004980 con 0x5576e676fad0 2023-10-05T19:50:31.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 -- 172.21.15.167:0/3177109845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 msgr2=0x5576e676fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:31.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 --2- 172.21.15.167:0/3177109845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e676fea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f255401c9a0 tx=0x7f2544006000 comp rx=0 tx=0).stop 2023-10-05T19:50:31.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 -- 172.21.15.167:0/3177109845 shutdown_connections 2023-10-05T19:50:31.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 --2- 172.21.15.167:0/3177109845 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e676fea0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:31.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 -- 172.21.15.167:0/3177109845 >> 172.21.15.167:0/3177109845 conn(0x5576e676ae90 msgr2=0x5576e6768fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:31.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 -- 172.21.15.167:0/3177109845 shutdown_connections 2023-10-05T19:50:31.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 -- 172.21.15.167:0/3177109845 wait complete. 2023-10-05T19:50:31.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 Processor -- start 2023-10-05T19:50:31.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 -- start start 2023-10-05T19:50:31.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e6775680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.957+0000 7f255b755e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576e6776680 con 0x5576e676fad0 2023-10-05T19:50:31.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f2558a89700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e6775680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f2558a89700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e6775680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46738/0 (socket says 172.21.15.167:46738) 2023-10-05T19:50:31.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f2558a89700 1 -- 172.21.15.167:0/3894292194 learned_addr learned my addr 172.21.15.167:0/3894292194 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:31.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f2558a89700 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c001e10 con 0x5576e676fad0 2023-10-05T19:50:31.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f2558a89700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e6775680 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f254403a040 tx=0x7f2544030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f24a37fe700 1 -- 172.21.15.167:0/3894292194 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f254401a070 con 0x5576e676fad0 2023-10-05T19:50:31.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f24a37fe700 1 -- 172.21.15.167:0/3894292194 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544004260 con 0x5576e676fad0 2023-10-05T19:50:31.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5576e6775c80 con 0x5576e676fad0 2023-10-05T19:50:31.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f24a37fe700 1 -- 172.21.15.167:0/3894292194 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f254402c940 con 0x5576e676fad0 2023-10-05T19:50:31.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576e67760c0 con 0x5576e676fad0 2023-10-05T19:50:31.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f24a37fe700 1 -- 172.21.15.167:0/3894292194 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f254402caa0 con 0x5576e676fad0 2023-10-05T19:50:31.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f24a37fe700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2498030c50 0x7f2498033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f24a37fe700 1 -- 172.21.15.167:0/3894292194 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2544027040 con 0x5576e676fad0 2023-10-05T19:50:31.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f2559a8b700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2498030c50 0x7f2498033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e67802d0 0x5576e67826e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.961+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6782d30 con 0x5576e67802d0 2023-10-05T19:50:31.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.965+0000 7f255928a700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e67802d0 0x5576e67826e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.965+0000 7f2559a8b700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2498030c50 0x7f2498033100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x5576e6765360 tx=0x7f254c00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.965+0000 7f255928a700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e67802d0 0x5576e67826e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.965+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f255404c0c0 con 0x5576e67802d0 2023-10-05T19:50:31.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.965+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5576e6783a00 0x5576e6785de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.965+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67864e0 con 0x5576e6783a00 2023-10-05T19:50:31.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.965+0000 7f2558a89700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5576e6783a00 0x5576e6785de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.965+0000 7f2558a89700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5576e6783a00 0x5576e6785de0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.969+0000 7f2558a89700 1 -- 172.21.15.167:0/3894292194 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6783a00 2023-10-05T19:50:31.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.969+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e67871b0 0x5576e67895c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.969+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e6789cf0 con 0x5576e67871b0 2023-10-05T19:50:31.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.969+0000 7f2559a8b700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e67871b0 0x5576e67895c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.969+0000 7f2559a8b700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e67871b0 0x5576e67895c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.969+0000 7f2559a8b700 1 -- 172.21.15.167:0/3894292194 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e67871b0 2023-10-05T19:50:31.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.969+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e678a9c0 0x5576e678cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:31.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.969+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678d500 con 0x5576e678a9c0 2023-10-05T19:50:31.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.969+0000 7f255928a700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e678a9c0 0x5576e678cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:31.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.973+0000 7f255928a700 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e678a9c0 0x5576e678cdd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:31.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.973+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'42 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e678a9c0 2023-10-05T19:50:31.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.973+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678db50 con 0x5576e67802d0 2023-10-05T19:50:31.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.977+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:31.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.977+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678e170 con 0x5576e67871b0 2023-10-05T19:50:31.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.977+0000 7f2559a8b700 1 -- 172.21.15.167:0/3894292194 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e67871b0 2023-10-05T19:50:31.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.977+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678e790 con 0x5576e67802d0 2023-10-05T19:50:31.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.981+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:31.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.981+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678e790 con 0x5576e678a9c0 2023-10-05T19:50:31.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.981+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e678a9c0 2023-10-05T19:50:31.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.981+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678e790 con 0x5576e67802d0 2023-10-05T19:50:31.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.985+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:31.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.985+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678e820 con 0x5576e67802d0 2023-10-05T19:50:31.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.985+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:31.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.985+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678e8b0 con 0x5576e67802d0 2023-10-05T19:50:31.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.989+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:31.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.989+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678e8b0 con 0x5576e67871b0 2023-10-05T19:50:31.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.993+0000 7f2559a8b700 1 -- 172.21.15.167:0/3894292194 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e67871b0 2023-10-05T19:50:31.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.993+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678eed0 con 0x5576e67802d0 2023-10-05T19:50:32.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.993+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:32.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.993+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e678a9c0 2023-10-05T19:50:32.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.997+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e678a9c0 2023-10-05T19:50:32.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.997+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e678a9c0 2023-10-05T19:50:32.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.997+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e678a9c0 2023-10-05T19:50:32.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:31.997+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e67802d0 2023-10-05T19:50:32.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.001+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:32.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.001+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e67802d0 2023-10-05T19:50:32.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.001+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:32.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.001+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e67871b0 2023-10-05T19:50:32.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.005+0000 7f2559a8b700 1 -- 172.21.15.167:0/3894292194 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e67871b0 2023-10-05T19:50:32.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.005+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e67802d0 2023-10-05T19:50:32.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.009+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:32.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.009+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e678a9c0 2023-10-05T19:50:32.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.009+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e678a9c0 2023-10-05T19:50:32.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.009+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e67802d0 2023-10-05T19:50:32.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.013+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:32.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.013+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e67802d0 2023-10-05T19:50:32.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.013+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:32.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.013+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef30 con 0x5576e67871b0 2023-10-05T19:50:32.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.017+0000 7f2559a8b700 1 -- 172.21.15.167:0/3894292194 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e67871b0 2023-10-05T19:50:32.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.017+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678ef90 con 0x5576e67802d0 2023-10-05T19:50:32.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.021+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:32.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.021+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678efc0 con 0x5576e67871b0 2023-10-05T19:50:32.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.021+0000 7f2559a8b700 1 -- 172.21.15.167:0/3894292194 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e67871b0 2023-10-05T19:50:32.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.021+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678f050 con 0x5576e67871b0 2023-10-05T19:50:32.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.025+0000 7f2559a8b700 1 -- 172.21.15.167:0/3894292194 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'20 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e67871b0 2023-10-05T19:50:32.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.025+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678f0e0 con 0x5576e67871b0 2023-10-05T19:50:32.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.025+0000 7f2559a8b700 1 -- 172.21.15.167:0/3894292194 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e67871b0 2023-10-05T19:50:32.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.025+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678f0e0 con 0x5576e67802d0 2023-10-05T19:50:32.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.029+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:32.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.029+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678f0e0 con 0x5576e678a9c0 2023-10-05T19:50:32.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.029+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'20 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e678a9c0 2023-10-05T19:50:32.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.029+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678f0e0 con 0x5576e67802d0 2023-10-05T19:50:32.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.033+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e67802d0 2023-10-05T19:50:32.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.033+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678f0e0 con 0x5576e678a9c0 2023-10-05T19:50:32.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.033+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'26 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e678a9c0 2023-10-05T19:50:32.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.033+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e678f0e0 con 0x5576e6783a00 2023-10-05T19:50:32.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.037+0000 7f2558a89700 1 -- 172.21.15.167:0/3894292194 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6783a00 2023-10-05T19:50:32.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.037+0000 7f24a0ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.037+0000 7f24967fc700 20 reqs_thread_entry: start 2023-10-05T19:50:32.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.037+0000 7f255b755e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f2483fff700 20 reqs_thread_entry: start 2023-10-05T19:50:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 20 get_system_obj_state: rctx=0x7ffd2b660748 obj=default.rgw.meta:users.uid:foo state=0x5576e65f60b0 s->prefetch_data=0 2023-10-05T19:50:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67ee040 con 0x5576e671f460 2023-10-05T19:50:32.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f2494ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:02 2023 2023-10-05T19:50:32.047 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:32.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:32.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2023-10-05T19:50:32.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:32.048 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, user does not exist 2023-10-05T19:50:32.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969160972768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67ee040 con 0x5576e6752050 2023-10-05T19:50:32.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 93969160972768] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e6752050 2023-10-05T19:50:32.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 20 remove_watcher() i=0 2023-10-05T19:50:32.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 2 removed watcher, disabling cache 2023-10-05T19:50:32.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.041+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969160983680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67ee040 con 0x5576e671f460 2023-10-05T19:50:32.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.045+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 93969160983680] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:32.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.045+0000 7f255b755e40 20 remove_watcher() i=1 2023-10-05T19:50:32.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.045+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969160981312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67ee040 con 0x5576e6752050 2023-10-05T19:50:32.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.045+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 93969160981312] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e6752050 2023-10-05T19:50:32.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.045+0000 7f255b755e40 20 remove_watcher() i=2 2023-10-05T19:50:32.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.045+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969160987648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67ee040 con 0x7f2554038040 2023-10-05T19:50:32.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.049+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 93969160987648] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:32.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.049+0000 7f255b755e40 20 remove_watcher() i=3 2023-10-05T19:50:32.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.049+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969160986096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67ee040 con 0x5576e6752050 2023-10-05T19:50:32.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.049+0000 7f255928a700 1 -- 172.21.15.167:0/2696078531 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 93969160986096] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2554064040 con 0x5576e6752050 2023-10-05T19:50:32.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.049+0000 7f255b755e40 20 remove_watcher() i=4 2023-10-05T19:50:32.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.049+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969160993216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67ee040 con 0x5576e6756fd0 2023-10-05T19:50:32.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.053+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 93969160993216] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:32.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.053+0000 7f255b755e40 20 remove_watcher() i=5 2023-10-05T19:50:32.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.053+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969160995424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e67ee040 con 0x5576e6756fd0 2023-10-05T19:50:32.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.053+0000 7f2558a89700 1 -- 172.21.15.167:0/2696078531 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 93969160995424] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254401d040 con 0x5576e6756fd0 2023-10-05T19:50:32.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.053+0000 7f255b755e40 20 remove_watcher() i=6 2023-10-05T19:50:32.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.053+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969161001152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675ddf0 con 0x7f2554038040 2023-10-05T19:50:32.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.057+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 93969161001152] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f254c033040 con 0x7f2554038040 2023-10-05T19:50:32.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.057+0000 7f255b755e40 20 remove_watcher() i=7 2023-10-05T19:50:32.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.057+0000 7f2529feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:32.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.057+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969161002256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5576e675ddf0 con 0x5576e671f460 2023-10-05T19:50:32.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 93969161002256] v30'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f254c033040 con 0x5576e671f460 2023-10-05T19:50:32.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e6752050 msgr2=0x5576e6754430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e6752050 0x5576e6754430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e671f460 msgr2=0x5576e6750010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e671f460 0x5576e6750010 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2554038040 msgr2=0x7f25540117e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2554038040 0x7f25540117e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e6756fd0 msgr2=0x5576e67593b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e6756fd0 0x5576e67593b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2540030c50 msgr2=0x7f2540033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2540030c50 0x7f2540033100 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25440044f0 tx=0x7f2544006690 comp rx=0 tx=0).stop 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f2559a8b700 1 -- 172.21.15.167:0/2696078531 reap_dead start 2023-10-05T19:50:32.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 msgr2=0x5576e67445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e67445e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f255400afd0 tx=0x7f255401c000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 shutdown_connections 2023-10-05T19:50:32.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/2696078531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e671eb50 0x5576e67445e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 >> 172.21.15.167:0/2696078531 conn(0x5576e66925c0 msgr2=0x5576e6738010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 shutdown_connections 2023-10-05T19:50:32.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/2696078531 wait complete. 2023-10-05T19:50:32.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e67802d0 msgr2=0x5576e67826e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5576e67802d0 0x5576e67826e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e678a9c0 msgr2=0x5576e678cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5576e678a9c0 0x5576e678cdd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5576e6783a00 msgr2=0x5576e6785de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5576e6783a00 0x5576e6785de0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e67871b0 msgr2=0x5576e67895c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5576e67871b0 0x5576e67895c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2498030c50 msgr2=0x7f2498033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2498030c50 0x7f2498033100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x5576e6765360 tx=0x7f254c00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 msgr2=0x5576e6775680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255928a700 1 -- 172.21.15.167:0/3894292194 reap_dead start 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e6775680 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f254403a040 tx=0x7f2544030000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 shutdown_connections 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 --2- 172.21.15.167:0/3894292194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5576e676fad0 0x5576e6775680 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 >> 172.21.15.167:0/3894292194 conn(0x5576e676ae90 msgr2=0x5576e6768f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 shutdown_connections 2023-10-05T19:50:32.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.061+0000 7f255b755e40 1 -- 172.21.15.167:0/3894292194 wait complete. 2023-10-05T19:50:32.073 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-05T19:50:32.074 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-10-05T19:50:32.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-10-05T19:50:32.074 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2023-10-05T19:50:32.160 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:32.160 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:32.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.153+0000 7f19bf25de40 1 Processor -- start 2023-10-05T19:50:32.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.153+0000 7f19bf25de40 1 -- start start 2023-10-05T19:50:32.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.153+0000 7f19bf25de40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ef9dfcb510 0x55ef9dfc9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.153+0000 7f19bf25de40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ef9dfa2bd0 con 0x55ef9dfca030 2023-10-05T19:50:32.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.153+0000 7f19bf25de40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ef9df5fee0 con 0x55ef9dfcb510 2023-10-05T19:50:32.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.153+0000 7f19bcd92700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ef9dfcb510 0x55ef9dfc9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.153+0000 7f19bcd92700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ef9dfcb510 0x55ef9dfc9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46740/0 (socket says 172.21.15.167:46740) 2023-10-05T19:50:32.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.153+0000 7f19bcd92700 1 -- 172.21.15.167:0/1092850056 learned_addr learned my addr 172.21.15.167:0/1092850056 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bcd92700 1 -- 172.21.15.167:0/1092850056 >> v1:172.21.15.118:6789/0 conn(0x55ef9dfca030 legacy=0x55ef9e05da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bcd92700 1 -- 172.21.15.167:0/1092850056 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef9dfcb9a0 con 0x55ef9dfcb510 2023-10-05T19:50:32.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bcd92700 1 --2- 172.21.15.167:0/1092850056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfcb510 0x55ef9dfc9af0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f19b400a5c0 tx=0x7f19b4005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f71ecf7e333d6c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bbd90700 1 -- 172.21.15.167:0/1092850056 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b400e510 con 0x55ef9dfcb510 2023-10-05T19:50:32.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bbd90700 1 -- 172.21.15.167:0/1092850056 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b400e670 con 0x55ef9dfcb510 2023-10-05T19:50:32.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bbd90700 1 -- 172.21.15.167:0/1092850056 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b400e920 con 0x55ef9dfcb510 2023-10-05T19:50:32.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bf25de40 1 -- 172.21.15.167:0/1092850056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfcb510 msgr2=0x55ef9dfc9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1092850056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfcb510 0x55ef9dfc9af0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f19b400a5c0 tx=0x7f19b4005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:32.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bf25de40 1 -- 172.21.15.167:0/1092850056 shutdown_connections 2023-10-05T19:50:32.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1092850056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfcb510 0x55ef9dfc9af0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bf25de40 1 -- 172.21.15.167:0/1092850056 >> 172.21.15.167:0/1092850056 conn(0x55ef9e051380 msgr2=0x55ef9e053790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bf25de40 1 -- 172.21.15.167:0/1092850056 shutdown_connections 2023-10-05T19:50:32.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.157+0000 7f19bf25de40 1 -- 172.21.15.167:0/1092850056 wait complete. 2023-10-05T19:50:32.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 Processor -- start 2023-10-05T19:50:32.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 -- start start 2023-10-05T19:50:32.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e076cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef9df23e30 con 0x55ef9dfca030 2023-10-05T19:50:32.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bcd92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e076cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bcd92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e076cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46756/0 (socket says 172.21.15.167:46756) 2023-10-05T19:50:32.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bcd92700 1 -- 172.21.15.167:0/876010423 learned_addr learned my addr 172.21.15.167:0/876010423 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bcd92700 1 -- 172.21.15.167:0/876010423 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b400a180 con 0x55ef9dfca030 2023-10-05T19:50:32.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bcd92700 1 --2- 172.21.15.167:0/876010423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e076cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55ef9dfcb970 tx=0x7f19b4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79dc52aef835cad server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bad8e700 1 -- 172.21.15.167:0/876010423 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b40032f0 con 0x55ef9dfca030 2023-10-05T19:50:32.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bad8e700 1 -- 172.21.15.167:0/876010423 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b400e7e0 con 0x55ef9dfca030 2023-10-05T19:50:32.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bad8e700 1 -- 172.21.15.167:0/876010423 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b400ead0 con 0x55ef9dfca030 2023-10-05T19:50:32.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 -- 172.21.15.167:0/876010423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 msgr2=0x55ef9e076cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 --2- 172.21.15.167:0/876010423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e076cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55ef9dfcb970 tx=0x7f19b4013000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 -- 172.21.15.167:0/876010423 shutdown_connections 2023-10-05T19:50:32.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 --2- 172.21.15.167:0/876010423 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e076cf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 -- 172.21.15.167:0/876010423 >> 172.21.15.167:0/876010423 conn(0x55ef9e051380 msgr2=0x55ef9e072830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 -- 172.21.15.167:0/876010423 shutdown_connections 2023-10-05T19:50:32.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.161+0000 7f19bf25de40 1 -- 172.21.15.167:0/876010423 wait complete. 2023-10-05T19:50:32.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bf25de40 1 Processor -- start 2023-10-05T19:50:32.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bf25de40 1 -- start start 2023-10-05T19:50:32.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bf25de40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e07d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bf25de40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef9def6ed0 con 0x55ef9dfca030 2023-10-05T19:50:32.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bcd92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e07d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bcd92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e07d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46772/0 (socket says 172.21.15.167:46772) 2023-10-05T19:50:32.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 learned_addr learned my addr 172.21.15.167:0/1738113910 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef9dfcb9a0 con 0x55ef9dfca030 2023-10-05T19:50:32.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bcd92700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e07d940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f19b4005860 tx=0x7f19b401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19b958b700 1 -- 172.21.15.167:0/1738113910 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b40109f0 con 0x55ef9dfca030 2023-10-05T19:50:32.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19b958b700 1 -- 172.21.15.167:0/1738113910 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4010b70 con 0x55ef9dfca030 2023-10-05T19:50:32.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef9e07de80 con 0x55ef9dfca030 2023-10-05T19:50:32.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19b958b700 1 -- 172.21.15.167:0/1738113910 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b4010e60 con 0x55ef9dfca030 2023-10-05T19:50:32.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.165+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef9e07e2c0 con 0x55ef9dfca030 2023-10-05T19:50:32.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19b958b700 1 -- 172.21.15.167:0/1738113910 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f19b401c430 con 0x55ef9dfca030 2023-10-05T19:50:32.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19b958b700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f19a8030ca0 0x7f19a8033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19b958b700 1 -- 172.21.15.167:0/1738113910 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f19b4046280 con 0x55ef9dfca030 2023-10-05T19:50:32.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bc591700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f19a8030ca0 0x7f19a8033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bf25de40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:32.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bf25de40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:32.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bf25de40 1 Processor -- start 2023-10-05T19:50:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bc591700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f19a8030ca0 0x7f19a8033150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b2b0 tx=0x7f19b0001490 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bf25de40 1 -- start start 2023-10-05T19:50:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bf25de40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e08ef50 0x55ef9e08f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bf25de40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef9e08f860 con 0x55ef9e08ef50 2023-10-05T19:50:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bcd92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e08ef50 0x55ef9e08f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bcd92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e08ef50 0x55ef9e08f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46780/0 (socket says 172.21.15.167:46780) 2023-10-05T19:50:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bcd92700 1 -- 172.21.15.167:0/1525578871 learned_addr learned my addr 172.21.15.167:0/1525578871 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bcd92700 1 -- 172.21.15.167:0/1525578871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef9e08f9a0 con 0x55ef9e08ef50 2023-10-05T19:50:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f19bcd92700 1 --2- 172.21.15.167:0/1525578871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e08ef50 0x55ef9e08f320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f19b401b390 tx=0x7f19b40446a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a7ab41971c5e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f198e7e4700 1 -- 172.21.15.167:0/1525578871 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b403c040 con 0x55ef9e08ef50 2023-10-05T19:50:32.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f198e7e4700 1 -- 172.21.15.167:0/1525578871 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b40460f0 con 0x55ef9e08ef50 2023-10-05T19:50:32.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.169+0000 7f198e7e4700 1 -- 172.21.15.167:0/1525578871 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b4026540 con 0x55ef9e08ef50 2023-10-05T19:50:32.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 -- 172.21.15.167:0/1525578871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e08ef50 msgr2=0x55ef9e08f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1525578871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e08ef50 0x55ef9e08f320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f19b401b390 tx=0x7f19b40446a0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 -- 172.21.15.167:0/1525578871 shutdown_connections 2023-10-05T19:50:32.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1525578871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e08ef50 0x55ef9e08f320 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 -- 172.21.15.167:0/1525578871 >> 172.21.15.167:0/1525578871 conn(0x55ef9dfcb510 msgr2=0x55ef9e08bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 -- 172.21.15.167:0/1525578871 shutdown_connections 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 -- 172.21.15.167:0/1525578871 wait complete. 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 Processor -- start 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 -- start start 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e096380 0x55ef9e096750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef9e097380 con 0x55ef9e096380 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bcd92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e096380 0x55ef9e096750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bcd92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e096380 0x55ef9e096750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46784/0 (socket says 172.21.15.167:46784) 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bcd92700 1 -- 172.21.15.167:0/1765785837 learned_addr learned my addr 172.21.15.167:0/1765785837 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bcd92700 1 -- 172.21.15.167:0/1765785837 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef9e07e2c0 con 0x55ef9e096380 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bcd92700 1 --2- 172.21.15.167:0/1765785837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e096380 0x55ef9e096750 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19b40107b0 tx=0x7f19b4044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f198cfe1700 1 -- 172.21.15.167:0/1765785837 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b404b070 con 0x55ef9e096380 2023-10-05T19:50:32.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f198cfe1700 1 -- 172.21.15.167:0/1765785837 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4025610 con 0x55ef9e096380 2023-10-05T19:50:32.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 -- 172.21.15.167:0/1765785837 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef9e096d50 con 0x55ef9e096380 2023-10-05T19:50:32.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f198cfe1700 1 -- 172.21.15.167:0/1765785837 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19b401bcf0 con 0x55ef9e096380 2023-10-05T19:50:32.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.173+0000 7f19bf25de40 1 -- 172.21.15.167:0/1765785837 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef9e0998a0 con 0x55ef9e096380 2023-10-05T19:50:32.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bf25de40 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name=default 2023-10-05T19:50:32.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19067fc700 20 reqs_thread_entry: start 2023-10-05T19:50:32.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bf25de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ef9e0b43e0 0x55ef9e0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef9e0c7920 con 0x55ef9e0b43e0 2023-10-05T19:50:32.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f198cfe1700 1 -- 172.21.15.167:0/1765785837 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f19b400f730 con 0x55ef9e096380 2023-10-05T19:50:32.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bc591700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ef9e0b43e0 0x55ef9e0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f198cfe1700 1 --2- 172.21.15.167:0/1765785837 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f190c030c50 0x7f190c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f198cfe1700 1 -- 172.21.15.167:0/1765785837 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f19b4050c30 con 0x55ef9e096380 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bd593700 1 --2- 172.21.15.167:0/1765785837 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f190c030c50 0x7f190c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bc591700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ef9e0b43e0 0x55ef9e0b4880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bd593700 1 --2- 172.21.15.167:0/1765785837 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f190c030c50 0x7f190c033100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00a370 tx=0x7f19ac005500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bf25de40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bf25de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ef9e0c81e0 0x55ef9e0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef9e0cab00 con 0x55ef9e0c81e0 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.177+0000 7f19bcd92700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ef9e0c81e0 0x55ef9e0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bcd92700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ef9e0c81e0 0x55ef9e0ca5c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(2 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bf25de40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:32.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ef9e0cc3d0 0x55ef9e0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef9e0cecf0 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bc591700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ef9e0cc3d0 0x55ef9e0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bc591700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ef9e0cc3d0 0x55ef9e0ce7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef9e0cecf0 con 0x55ef9e0b43e0 2023-10-05T19:50:32.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(4 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bc591700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f19b000f3c0 0x7f19b000f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:5 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef9e0cecf0 con 0x7f19b000f3c0 2023-10-05T19:50:32.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.181+0000 7f19bd593700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f19b000f3c0 0x7f19b000f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bd593700 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f19b000f3c0 0x7f19b000f7f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(5 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19ac011040 con 0x7f19b000f3c0 2023-10-05T19:50:32.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:6 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef9e0cecf0 con 0x55ef9e0c81e0 2023-10-05T19:50:32.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:7 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef9e0cecf0 con 0x55ef9e0c81e0 2023-10-05T19:50:32.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:8 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0c81e0 2023-10-05T19:50:32.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0b43e0 2023-10-05T19:50:32.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0b43e0 2023-10-05T19:50:32.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.185+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0c81e0 2023-10-05T19:50:32.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(12 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:13 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x7f19b000f3c0 2023-10-05T19:50:32.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19ac011040 con 0x7f19b000f3c0 2023-10-05T19:50:32.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0c81e0 2023-10-05T19:50:32.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:15 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x7f19b000f3c0 2023-10-05T19:50:32.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19ac011040 con 0x7f19b000f3c0 2023-10-05T19:50:32.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0b43e0 2023-10-05T19:50:32.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:17 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.189+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:18 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0c81e0 2023-10-05T19:50:32.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0b43e0 2023-10-05T19:50:32.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0c81e0 2023-10-05T19:50:32.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:22 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0c81e0 2023-10-05T19:50:32.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:23 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0c81e0 2023-10-05T19:50:32.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:24 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.193+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:25 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x7f19b000f3c0 2023-10-05T19:50:32.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19ac011040 con 0x7f19b000f3c0 2023-10-05T19:50:32.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0c81e0 2023-10-05T19:50:32.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:27 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x7f19b000f3c0 2023-10-05T19:50:32.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19ac011040 con 0x7f19b000f3c0 2023-10-05T19:50:32.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:28 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:29 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x7f19b000f3c0 2023-10-05T19:50:32.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19ac011040 con 0x7f19b000f3c0 2023-10-05T19:50:32.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0b43e0 2023-10-05T19:50:32.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.197+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:31 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0b43e0 2023-10-05T19:50:32.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:32 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0cc3d0 2023-10-05T19:50:32.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0b43e0 2023-10-05T19:50:32.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(33 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19b4063040 con 0x55ef9e0b43e0 2023-10-05T19:50:32.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bc591700 1 -- 172.21.15.167:0/1738113910 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19b0010570 con 0x55ef9e0b43e0 2023-10-05T19:50:32.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bf25de40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:32.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bf25de40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:32.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bf25de40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:32.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bf25de40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:32.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bf25de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:35 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef9e0caeb0 con 0x55ef9e0c81e0 2023-10-05T19:50:32.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(35 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bf25de40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:32.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.201+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:36 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [delete,create,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ef9e0cb2f0 con 0x55ef9e0c81e0 2023-10-05T19:50:32.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bcd92700 1 -- 172.21.15.167:0/1738113910 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(36 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [delete,create,writefull 0~874] v30'2 uv2 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f19b402b070 con 0x55ef9e0c81e0 2023-10-05T19:50:32.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ef9e0b43e0 msgr2=0x55ef9e0b4880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ef9e0b43e0 0x55ef9e0b4880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ef9e0c81e0 msgr2=0x55ef9e0ca5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ef9e0c81e0 0x55ef9e0ca5c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f19b000f3c0 msgr2=0x7f19b000f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f19b000f3c0 0x7f19b000f7f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ef9e0cc3d0 msgr2=0x55ef9e0ce7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ef9e0cc3d0 0x55ef9e0ce7b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f19a8030ca0 msgr2=0x7f19a8033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f19a8030ca0 0x7f19a8033150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b2b0 tx=0x7f19b0001490 comp rx=0 tx=0).stop 2023-10-05T19:50:32.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 msgr2=0x55ef9e07d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e07d940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f19b4005860 tx=0x7f19b401c000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bd593700 1 -- 172.21.15.167:0/1738113910 reap_dead start 2023-10-05T19:50:32.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 shutdown_connections 2023-10-05T19:50:32.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1738113910 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9dfca030 0x55ef9e07d940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 >> 172.21.15.167:0/1738113910 conn(0x55ef9e051380 msgr2=0x55ef9e0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 shutdown_connections 2023-10-05T19:50:32.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.205+0000 7f19bf25de40 1 -- 172.21.15.167:0/1738113910 wait complete. 2023-10-05T19:50:32.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 -- 172.21.15.167:0/1765785837 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f190c030c50 msgr2=0x7f190c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1765785837 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f190c030c50 0x7f190c033100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00a370 tx=0x7f19ac005500 comp rx=0 tx=0).stop 2023-10-05T19:50:32.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 -- 172.21.15.167:0/1765785837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e096380 msgr2=0x55ef9e096750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1765785837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e096380 0x55ef9e096750 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19b40107b0 tx=0x7f19b4044000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 -- 172.21.15.167:0/1765785837 shutdown_connections 2023-10-05T19:50:32.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1765785837 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f190c030c50 0x7f190c033100 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 --2- 172.21.15.167:0/1765785837 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ef9e096380 0x55ef9e096750 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 -- 172.21.15.167:0/1765785837 >> 172.21.15.167:0/1765785837 conn(0x55ef9dfcb510 msgr2=0x55ef9e08b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 -- 172.21.15.167:0/1765785837 shutdown_connections 2023-10-05T19:50:32.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.209+0000 7f19bf25de40 1 -- 172.21.15.167:0/1765785837 wait complete. 2023-10-05T19:50:32.220 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:32.220 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2", 2023-10-05T19:50:32.220 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "default", 2023-10-05T19:50:32.220 INFO:teuthology.orchestra.run.smithi167.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "control_pool": "default.rgw.control", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "log_pool": "default.rgw.log", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T19:50:32.221 INFO:teuthology.orchestra.run.smithi167.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: "system_key": { 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "", 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "" 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_pools": [ 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "default-placement", 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: "val": { 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: "storage_classes": { 2023-10-05T19:50:32.222 INFO:teuthology.orchestra.run.smithi167.stdout: "STANDARD": { 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": 0, 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: "inline_data": "true" 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: "realm_id": "", 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T19:50:32.223 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:32.224 DEBUG:tasks.util.rgw: json result: {'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T19:50:32.225 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2023-10-05T19:50:32.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2023-10-05T19:50:32.225 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2023-10-05T19:50:32.264 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:32.264 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:32.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.257+0000 7fb9a76fce40 1 Processor -- start 2023-10-05T19:50:32.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.257+0000 7fb9a76fce40 1 -- start start 2023-10-05T19:50:32.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.257+0000 7fb9a76fce40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55bbc3b7a7f0 0x55bbc3b7abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.257+0000 7fb9a76fce40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bbc3ac8c00 con 0x55bbc3b7b100 2023-10-05T19:50:32.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.257+0000 7fb9a76fce40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bbc3a85ee0 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.257+0000 7fb9a5231700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55bbc3b7a7f0 0x55bbc3b7abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.257+0000 7fb9a4a30700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55bbc3b7b100 0x55bbc3b7bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39832/0 (socket says 172.21.15.167:39832) 2023-10-05T19:50:32.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.257+0000 7fb9a4a30700 1 -- 172.21.15.167:0/440757234 learned_addr learned my addr 172.21.15.167:0/440757234 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:32.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb99ffff700 1 -- 172.21.15.167:0/440757234 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418652874 0 0) 0x55bbc3ac8c00 con 0x55bbc3b7b100 2023-10-05T19:50:32.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb99ffff700 1 -- 172.21.15.167:0/440757234 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb988001e10 con 0x55bbc3b7b100 2023-10-05T19:50:32.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a5231700 1 -- 172.21.15.167:0/440757234 >> v1:172.21.15.118:6789/0 conn(0x55bbc3b7b100 legacy=0x55bbc3b7bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a5231700 1 -- 172.21.15.167:0/440757234 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbc3b7c2b0 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a5231700 1 --2- 172.21.15.167:0/440757234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3b7abc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000a5d0 tx=0x7fb9a0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e947e33fb814f047 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb99ffff700 1 -- 172.21.15.167:0/440757234 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0007610 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb99ffff700 1 -- 172.21.15.167:0/440757234 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0007770 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb99ffff700 1 -- 172.21.15.167:0/440757234 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0007a40 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 -- 172.21.15.167:0/440757234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 msgr2=0x55bbc3b7abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/440757234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3b7abc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000a5d0 tx=0x7fb9a0005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:32.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 -- 172.21.15.167:0/440757234 shutdown_connections 2023-10-05T19:50:32.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/440757234 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3b7abc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 -- 172.21.15.167:0/440757234 >> 172.21.15.167:0/440757234 conn(0x55bbc3b76210 msgr2=0x55bbc3b78620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 -- 172.21.15.167:0/440757234 shutdown_connections 2023-10-05T19:50:32.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 -- 172.21.15.167:0/440757234 wait complete. 2023-10-05T19:50:32.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 Processor -- start 2023-10-05T19:50:32.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 -- start start 2023-10-05T19:50:32.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3b9f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a76fce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc3a49e30 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a5231700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3b9f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.261+0000 7fb9a5231700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3b9f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46790/0 (socket says 172.21.15.167:46790) 2023-10-05T19:50:32.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a5231700 1 -- 172.21.15.167:0/489383923 learned_addr learned my addr 172.21.15.167:0/489383923 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a5231700 1 -- 172.21.15.167:0/489383923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0005cf0 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a5231700 1 --2- 172.21.15.167:0/489383923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3b9f330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0000c00 tx=0x7fb9a0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6487b27282f131 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb99effd700 1 -- 172.21.15.167:0/489383923 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0007a00 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb99effd700 1 -- 172.21.15.167:0/489383923 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0007b60 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb99effd700 1 -- 172.21.15.167:0/489383923 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0007d10 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 -- 172.21.15.167:0/489383923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 msgr2=0x55bbc3b9f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/489383923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3b9f330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0000c00 tx=0x7fb9a0014000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 -- 172.21.15.167:0/489383923 shutdown_connections 2023-10-05T19:50:32.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/489383923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3b9f330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 -- 172.21.15.167:0/489383923 >> 172.21.15.167:0/489383923 conn(0x55bbc3b76210 msgr2=0x55bbc3aef720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 -- 172.21.15.167:0/489383923 shutdown_connections 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 -- 172.21.15.167:0/489383923 wait complete. 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 Processor -- start 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 -- start start 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3ba3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a76fce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc3a1ced0 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a5231700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3ba3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a5231700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3ba3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46792/0 (socket says 172.21.15.167:46792) 2023-10-05T19:50:32.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.265+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 learned_addr learned my addr 172.21.15.167:0/557124081 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbc3b7c2b0 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a5231700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3ba3630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000afd0 tx=0x7fb9a001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb99d7fa700 1 -- 172.21.15.167:0/557124081 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9a002f400 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb99d7fa700 1 -- 172.21.15.167:0/557124081 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0029070 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bbc3ba3b70 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb99d7fa700 1 -- 172.21.15.167:0/557124081 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9a002f5c0 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbc3ba3f50 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb99d7fa700 1 -- 172.21.15.167:0/557124081 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fb9a0012400 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb99d7fa700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb98c030c50 0x7fb98c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb99d7fa700 1 -- 172.21.15.167:0/557124081 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fb9a00463a0 con 0x55bbc3b7a7f0 2023-10-05T19:50:32.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a4a30700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb98c030c50 0x7fb98c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bbc3b7b100 0x55bbc3baf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3baf770 con 0x55bbc3b7b100 2023-10-05T19:50:32.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a5a32700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bbc3b7b100 0x55bbc3baf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.269+0000 7fb9a4a30700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb98c030c50 0x7fb98c033100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb9900044f0 tx=0x7fb990006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a5a32700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bbc3b7b100 0x55bbc3baf0c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb99800a500 con 0x55bbc3b7b100 2023-10-05T19:50:32.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 20 realm 2023-10-05T19:50:32.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bac720 con 0x55bbc3b7b100 2023-10-05T19:50:32.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb99800a500 con 0x55bbc3b7b100 2023-10-05T19:50:32.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:32.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb0250 con 0x55bbc3b7b100 2023-10-05T19:50:32.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb99800a500 con 0x55bbc3b7b100 2023-10-05T19:50:32.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bbc3bafe80 0x55bbc3bb30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb37f0 con 0x55bbc3bafe80 2023-10-05T19:50:32.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a5231700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bbc3bafe80 0x55bbc3bb30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a5231700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bbc3bafe80 0x55bbc3bb30c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.273+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb40c0 con 0x55bbc3b7b100 2023-10-05T19:50:32.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb99800a500 con 0x55bbc3b7b100 2023-10-05T19:50:32.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a76fce40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:32.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a76fce40 20 searching for the correct realm 2023-10-05T19:50:32.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bbc3bb3c30 0x55bbc3bb7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bb3c30 2023-10-05T19:50:32.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a4a30700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bbc3bb3c30 0x55bbc3bb7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a4a30700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bbc3bb3c30 0x55bbc3bb7e90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb990004520 con 0x55bbc3bb3c30 2023-10-05T19:50:32.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bafe80 2023-10-05T19:50:32.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a5231700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb9a0007030 0x7fb9a00126b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x7fb9a0007030 2023-10-05T19:50:32.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a5a32700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb9a0007030 0x7fb9a00126b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a5a32700 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb9a0007030 0x7fb9a00126b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x7fb9a0007030 2023-10-05T19:50:32.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.277+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bb3c30 2023-10-05T19:50:32.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb990004520 con 0x55bbc3bb3c30 2023-10-05T19:50:32.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bafe80 2023-10-05T19:50:32.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bafe80 2023-10-05T19:50:32.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.281+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x7fb9a0007030 2023-10-05T19:50:32.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x7fb9a0007030 2023-10-05T19:50:32.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x7fb9a0007030 2023-10-05T19:50:32.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x7fb9a0007030 2023-10-05T19:50:32.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bafe80 2023-10-05T19:50:32.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.285+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bb3c30 2023-10-05T19:50:32.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb990004520 con 0x55bbc3bb3c30 2023-10-05T19:50:32.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bafe80 2023-10-05T19:50:32.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bb3c30 2023-10-05T19:50:32.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.289+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bb3c30 2023-10-05T19:50:32.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x7fb9a0007030 2023-10-05T19:50:32.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x7fb9a0007030 2023-10-05T19:50:32.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3b7b100 2023-10-05T19:50:32.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x7fb9a0007030 2023-10-05T19:50:32.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x7fb9a0007030 2023-10-05T19:50:32.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bb3c30 2023-10-05T19:50:32.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.293+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x7fb9a0007030 2023-10-05T19:50:32.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x7fb9a0007030 2023-10-05T19:50:32.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bafe80 2023-10-05T19:50:32.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bafe80 2023-10-05T19:50:32.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8470 con 0x55bbc3bb3c30 2023-10-05T19:50:32.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb990021040 con 0x55bbc3bafe80 2023-10-05T19:50:32.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb990021040 con 0x55bbc3bafe80 2023-10-05T19:50:32.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a76fce40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:32.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a76fce40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:32.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a76fce40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:32.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a76fce40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:32.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.297+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb4c00 con 0x55bbc3b7b100 2023-10-05T19:50:32.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb5580 con 0x55bbc3bafe80 2023-10-05T19:50:32.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb47c0 con 0x55bbc3bafe80 2023-10-05T19:50:32.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:32.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb5170 con 0x55bbc3bb3c30 2023-10-05T19:50:32.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.301+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb9340 con 0x55bbc3bafe80 2023-10-05T19:50:32.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a76fce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bba780 con 0x55bbc3bb3c30 2023-10-05T19:50:32.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bba780 con 0x55bbc3bafe80 2023-10-05T19:50:32.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bba780 con 0x7fb9a0007030 2023-10-05T19:50:32.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x7fb9a0007030 2023-10-05T19:50:32.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.305+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bb3c30 2023-10-05T19:50:32.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bafe80 2023-10-05T19:50:32.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bafe80 2023-10-05T19:50:32.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x7fb9a0007030 2023-10-05T19:50:32.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.309+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x7fb9a0007030 2023-10-05T19:50:32.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x7fb9a0007030 2023-10-05T19:50:32.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x7fb9a0007030 2023-10-05T19:50:32.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bafe80 2023-10-05T19:50:32.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bb3c30 2023-10-05T19:50:32.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.313+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bafe80 2023-10-05T19:50:32.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bb3c30 2023-10-05T19:50:32.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998014040 con 0x55bbc3b7b100 2023-10-05T19:50:32.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bb3c30 2023-10-05T19:50:32.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x7fb9a0007030 2023-10-05T19:50:32.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.317+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3b7b100 2023-10-05T19:50:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x7fb9a0007030 2023-10-05T19:50:32.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bb3c30 2023-10-05T19:50:32.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x7fb9a0007030 2023-10-05T19:50:32.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bafe80 2023-10-05T19:50:32.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bafe80 2023-10-05T19:50:32.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.321+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bb3c30 2023-10-05T19:50:32.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bafe80 2023-10-05T19:50:32.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb8910 con 0x55bbc3bafe80 2023-10-05T19:50:32.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:32.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:32.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:32.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:32.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb9770 con 0x55bbc3bafe80 2023-10-05T19:50:32.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb9b20 con 0x55bbc3b7b100 2023-10-05T19:50:32.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:32.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.325+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bba3c0 con 0x55bbc3bafe80 2023-10-05T19:50:32.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bba3c0 con 0x55bbc3bafe80 2023-10-05T19:50:32.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:32.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bba3c0 con 0x7fb9a0007030 2023-10-05T19:50:32.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 zone default found 2023-10-05T19:50:32.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 4 Realm: () 2023-10-05T19:50:32.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:32.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:32.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:32.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 zonegroup default 2023-10-05T19:50:32.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bba3c0 con 0x7fb9a0007030 2023-10-05T19:50:32.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bba3c0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.329+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbc500 con 0x55bbc3bb3c30 2023-10-05T19:50:32.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.333+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.333+0000 7fb9a76fce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.333+0000 7fb9a76fce40 20 started sync module instance, tier type = 2023-10-05T19:50:32.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.333+0000 7fb9a76fce40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:32.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.333+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbbbc0 con 0x55bbc3bafe80 2023-10-05T19:50:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.333+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.333+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94264931098320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbbbc0 con 0x55bbc3bafe80 2023-10-05T19:50:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.333+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbcda0 con 0x55bbc3b7b100 2023-10-05T19:50:32.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.337+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.337+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94264931098320] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.337+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94264931106752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbcda0 con 0x55bbc3b7b100 2023-10-05T19:50:32.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.337+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbd640 con 0x55bbc3bafe80 2023-10-05T19:50:32.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.337+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94264931106752] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.337+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.337+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94264931109040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbd1f0 con 0x55bbc3bafe80 2023-10-05T19:50:32.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.337+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbdd80 con 0x7fb9a0007030 2023-10-05T19:50:32.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.341+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.341+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94264931109040] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.341+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94264931113040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbdca0 con 0x7fb9a0007030 2023-10-05T19:50:32.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.341+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbe6b0 con 0x55bbc3bafe80 2023-10-05T19:50:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.341+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94264931113040] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94264931110144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbe6b0 con 0x55bbc3bafe80 2023-10-05T19:50:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbf0c0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94264931118032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbf960 con 0x55bbc3bb3c30 2023-10-05T19:50:32.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bc03e0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94264931110144] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94264931115456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bc0cd0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.345+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bc15b0 con 0x7fb9a0007030 2023-10-05T19:50:32.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94264931118032] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94264931115456] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94264931120240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bc0cd0 con 0x7fb9a0007030 2023-10-05T19:50:32.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 20 add_watcher() i=0 2023-10-05T19:50:32.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 20 add_watcher() i=1 2023-10-05T19:50:32.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 20 add_watcher() i=2 2023-10-05T19:50:32.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 20 add_watcher() i=3 2023-10-05T19:50:32.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 20 add_watcher() i=4 2023-10-05T19:50:32.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 20 add_watcher() i=5 2023-10-05T19:50:32.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 20 add_watcher() i=6 2023-10-05T19:50:32.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94264931120240] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 20 add_watcher() i=7 2023-10-05T19:50:32.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:32.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bc0cd0 con 0x55bbc3b7b100 2023-10-05T19:50:32.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.349+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94264931125216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bc0c30 con 0x55bbc3b7b100 2023-10-05T19:50:32.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94264931125216] v30'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb975feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:32.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a76fce40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:32.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a76fce40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:32.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a76fce40 1 Processor -- start 2023-10-05T19:50:32.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a76fce40 1 -- start start 2023-10-05T19:50:32.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a76fce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a76fce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc3bcf000 con 0x55bbc3bce6f0 2023-10-05T19:50:32.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a4a30700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a4a30700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46800/0 (socket says 172.21.15.167:46800) 2023-10-05T19:50:32.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a4a30700 1 -- 172.21.15.167:0/2990450348 learned_addr learned my addr 172.21.15.167:0/2990450348 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a4a30700 1 -- 172.21.15.167:0/2990450348 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbc3bcf140 con 0x55bbc3bce6f0 2023-10-05T19:50:32.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9a4a30700 1 --2- 172.21.15.167:0/2990450348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bceac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0000c00 tx=0x7fb990006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b186c852c97b2448 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9757ea700 1 -- 172.21.15.167:0/2990450348 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb99001a040 con 0x55bbc3bce6f0 2023-10-05T19:50:32.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9757ea700 1 -- 172.21.15.167:0/2990450348 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99002dae0 con 0x55bbc3bce6f0 2023-10-05T19:50:32.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.353+0000 7fb9757ea700 1 -- 172.21.15.167:0/2990450348 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9900049b0 con 0x55bbc3bce6f0 2023-10-05T19:50:32.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 -- 172.21.15.167:0/2990450348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 msgr2=0x55bbc3bceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/2990450348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bceac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0000c00 tx=0x7fb990006000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 -- 172.21.15.167:0/2990450348 shutdown_connections 2023-10-05T19:50:32.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/2990450348 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bceac0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 -- 172.21.15.167:0/2990450348 >> 172.21.15.167:0/2990450348 conn(0x55bbc3bc9ab0 msgr2=0x55bbc3bc7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 -- 172.21.15.167:0/2990450348 shutdown_connections 2023-10-05T19:50:32.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 -- 172.21.15.167:0/2990450348 wait complete. 2023-10-05T19:50:32.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 Processor -- start 2023-10-05T19:50:32.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 -- start start 2023-10-05T19:50:32.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bd4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc3bd5290 con 0x55bbc3bce6f0 2023-10-05T19:50:32.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a4a30700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bd4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a4a30700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bd4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46806/0 (socket says 172.21.15.167:46806) 2023-10-05T19:50:32.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a4a30700 1 -- 172.21.15.167:0/376147458 learned_addr learned my addr 172.21.15.167:0/376147458 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a4a30700 1 -- 172.21.15.167:0/376147458 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb988001e10 con 0x55bbc3bce6f0 2023-10-05T19:50:32.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a4a30700 1 --2- 172.21.15.167:0/376147458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bd4290 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb99003a040 tx=0x7fb990030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb8ef7fe700 1 -- 172.21.15.167:0/376147458 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb99001a040 con 0x55bbc3bce6f0 2023-10-05T19:50:32.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb8ef7fe700 1 -- 172.21.15.167:0/376147458 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb990004330 con 0x55bbc3bce6f0 2023-10-05T19:50:32.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb8ef7fe700 1 -- 172.21.15.167:0/376147458 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb990014950 con 0x55bbc3bce6f0 2023-10-05T19:50:32.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 -- 172.21.15.167:0/376147458 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bbc3bd4890 con 0x55bbc3bce6f0 2023-10-05T19:50:32.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.357+0000 7fb9a76fce40 1 -- 172.21.15.167:0/376147458 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbc3bd4cd0 con 0x55bbc3bce6f0 2023-10-05T19:50:32.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.361+0000 7fb8ef7fe700 1 -- 172.21.15.167:0/376147458 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fb990014ab0 con 0x55bbc3bce6f0 2023-10-05T19:50:32.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.361+0000 7fb8ef7fe700 1 --2- 172.21.15.167:0/376147458 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb8e4030c50 0x7fb8e4033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.361+0000 7fb8ef7fe700 1 -- 172.21.15.167:0/376147458 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fb990027040 con 0x55bbc3bce6f0 2023-10-05T19:50:32.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.361+0000 7fb9a5a32700 1 --2- 172.21.15.167:0/376147458 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb8e4030c50 0x7fb8e4033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.361+0000 7fb9a76fce40 5 note: GC not initialized 2023-10-05T19:50:32.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.361+0000 7fb9a5a32700 1 --2- 172.21.15.167:0/376147458 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb8e4030c50 0x7fb8e4033100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55bbc3bc1360 tx=0x7fb99800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.361+0000 7fb8ecff9700 20 reqs_thread_entry: start 2023-10-05T19:50:32.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a76fce40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:32.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb8e27fc700 20 reqs_thread_entry: start 2023-10-05T19:50:32.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a76fce40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:32.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb8e0ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:02 2023 2023-10-05T19:50:32.371 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:32.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb8c7fff700 20 reqs_thread_entry: start 2023-10-05T19:50:32.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(103 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(104 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(105 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.365+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(106 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(107 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3b7b100 2023-10-05T19:50:32.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(108 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3b7b100 2023-10-05T19:50:32.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(109 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(110 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(111 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.369+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(112 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb99001d040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3b7b100 2023-10-05T19:50:32.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(113 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x7fb9a0007030 2023-10-05T19:50:32.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(114 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(115 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb990051040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:116 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x7fb9a0007030 2023-10-05T19:50:32.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(116 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:117 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3b7b100 2023-10-05T19:50:32.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(117 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:118 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(118 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb990051040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:119 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3b7b100 2023-10-05T19:50:32.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(119 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.373+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:120 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(120 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(121 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:122 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(122 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb990051040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(123 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:124 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(124 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb990051040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:125 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3b7b100 2023-10-05T19:50:32.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(125 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.377+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:126 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(126 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:127 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(127 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:128 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(128 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:129 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3b7b100 2023-10-05T19:50:32.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(129 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:130 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(130 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb990051040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:131 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(131 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb990051040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.381+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:132 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3bafe80 2023-10-05T19:50:32.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.385+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(132 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.385+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:133 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3c3d3d0 con 0x55bbc3b7b100 2023-10-05T19:50:32.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.385+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(133 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.385+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94264931098320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bfaef0 con 0x55bbc3bafe80 2023-10-05T19:50:32.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.385+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 94264931098320] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.385+0000 7fb9a76fce40 20 remove_watcher() i=0 2023-10-05T19:50:32.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.385+0000 7fb9a76fce40 2 removed watcher, disabling cache 2023-10-05T19:50:32.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.385+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94264931106752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb9ed0 con 0x55bbc3b7b100 2023-10-05T19:50:32.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.389+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 94264931106752] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.389+0000 7fb9a76fce40 20 remove_watcher() i=1 2023-10-05T19:50:32.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.389+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94264931109040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bb9ed0 con 0x55bbc3bafe80 2023-10-05T19:50:32.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.389+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 94264931109040] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.389+0000 7fb9a76fce40 20 remove_watcher() i=2 2023-10-05T19:50:32.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.389+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94264931113040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbc8b0 con 0x7fb9a0007030 2023-10-05T19:50:32.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.393+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 94264931113040] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.393+0000 7fb9a76fce40 20 remove_watcher() i=3 2023-10-05T19:50:32.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.393+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94264931110144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbc8b0 con 0x55bbc3bafe80 2023-10-05T19:50:32.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.393+0000 7fb9a5231700 1 -- 172.21.15.167:0/557124081 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 94264931110144] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9a0035070 con 0x55bbc3bafe80 2023-10-05T19:50:32.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.393+0000 7fb9a76fce40 20 remove_watcher() i=4 2023-10-05T19:50:32.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.393+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94264931118032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbcda0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.397+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 94264931118032] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb990051040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.397+0000 7fb9a76fce40 20 remove_watcher() i=5 2023-10-05T19:50:32.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.397+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94264931115456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbcda0 con 0x55bbc3bb3c30 2023-10-05T19:50:32.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.397+0000 7fb9a4a30700 1 -- 172.21.15.167:0/557124081 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 94264931115456] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb990051040 con 0x55bbc3bb3c30 2023-10-05T19:50:32.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.397+0000 7fb9a76fce40 20 remove_watcher() i=6 2023-10-05T19:50:32.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.397+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94264931120240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbcda0 con 0x7fb9a0007030 2023-10-05T19:50:32.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.401+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 94264931120240] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb998033040 con 0x7fb9a0007030 2023-10-05T19:50:32.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.401+0000 7fb9a76fce40 20 remove_watcher() i=7 2023-10-05T19:50:32.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.401+0000 7fb975feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:32.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.401+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94264931125216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bbc3bbcda0 con 0x55bbc3b7b100 2023-10-05T19:50:32.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94264931125216] v30'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb998033040 con 0x55bbc3b7b100 2023-10-05T19:50:32.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bbc3bafe80 msgr2=0x55bbc3bb30c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bbc3bafe80 0x55bbc3bb30c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bbc3b7b100 msgr2=0x55bbc3baf0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bbc3b7b100 0x55bbc3baf0c0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb9a0007030 msgr2=0x7fb9a00126b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb9a0007030 0x7fb9a00126b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bbc3bb3c30 msgr2=0x55bbc3bb7e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bbc3bb3c30 0x55bbc3bb7e90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb98c030c50 msgr2=0x7fb98c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb98c030c50 0x7fb98c033100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb9900044f0 tx=0x7fb990006690 comp rx=0 tx=0).stop 2023-10-05T19:50:32.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 msgr2=0x55bbc3ba3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a5a32700 1 -- 172.21.15.167:0/557124081 reap_dead start 2023-10-05T19:50:32.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3ba3630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000afd0 tx=0x7fb9a001c000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 shutdown_connections 2023-10-05T19:50:32.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/557124081 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3b7a7f0 0x55bbc3ba3630 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 >> 172.21.15.167:0/557124081 conn(0x55bbc3b76210 msgr2=0x55bbc3b93cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 shutdown_connections 2023-10-05T19:50:32.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/557124081 wait complete. 2023-10-05T19:50:32.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/376147458 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb8e4030c50 msgr2=0x7fb8e4033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/376147458 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb8e4030c50 0x7fb8e4033100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55bbc3bc1360 tx=0x7fb99800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:32.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/376147458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 msgr2=0x55bbc3bd4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/376147458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bd4290 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb99003a040 tx=0x7fb990030000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/376147458 shutdown_connections 2023-10-05T19:50:32.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/376147458 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb8e4030c50 0x7fb8e4033100 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 --2- 172.21.15.167:0/376147458 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bbc3bce6f0 0x55bbc3bd4290 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/376147458 >> 172.21.15.167:0/376147458 conn(0x55bbc3bc9ab0 msgr2=0x55bbc3bc7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/376147458 shutdown_connections 2023-10-05T19:50:32.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.405+0000 7fb9a76fce40 1 -- 172.21.15.167:0/376147458 wait complete. 2023-10-05T19:50:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:32.416 INFO:teuthology.orchestra.run.smithi167.stdout: "entries": [], 2023-10-05T19:50:32.416 INFO:teuthology.orchestra.run.smithi167.stdout: "summary": [] 2023-10-05T19:50:32.416 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:32.418 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2023-10-05T19:50:32.418 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T19:50:32.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T19:50:32.419 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T19:50:32.457 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:32.457 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:32.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.449+0000 7f678e70be40 1 Processor -- start 2023-10-05T19:50:32.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.449+0000 7f678e70be40 1 -- start start 2023-10-05T19:50:32.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.449+0000 7f678e70be40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x561b52708b50 0x561b52708f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.449+0000 7f678e70be40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561b52653bd0 con 0x561b52709460 2023-10-05T19:50:32.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.449+0000 7f678e70be40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x561b52610ee0 con 0x561b52708b50 2023-10-05T19:50:32.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678c240700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x561b52708b50 0x561b52708f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678c240700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x561b52708b50 0x561b52708f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46822/0 (socket says 172.21.15.167:46822) 2023-10-05T19:50:32.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678ba3f700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x561b52709460 0x561b52709ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39840/0 (socket says 172.21.15.167:39840) 2023-10-05T19:50:32.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678c240700 1 -- 172.21.15.167:0/1600944260 learned_addr learned my addr 172.21.15.167:0/1600944260 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678c240700 1 -- 172.21.15.167:0/1600944260 >> v1:172.21.15.118:6789/0 conn(0x561b52709460 legacy=0x561b52709ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678c240700 1 -- 172.21.15.167:0/1600944260 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b5270a600 con 0x561b52708b50 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678c240700 1 --2- 172.21.15.167:0/1600944260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b52708f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f677c00a650 tx=0x7f677c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b02311c0dc53c1a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678b23e700 1 -- 172.21.15.167:0/1600944260 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f677c008760 con 0x561b52708b50 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678b23e700 1 -- 172.21.15.167:0/1600944260 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0088c0 con 0x561b52708b50 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678b23e700 1 -- 172.21.15.167:0/1600944260 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f677c008bb0 con 0x561b52708b50 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 -- 172.21.15.167:0/1600944260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 msgr2=0x561b52708f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 --2- 172.21.15.167:0/1600944260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b52708f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f677c00a650 tx=0x7f677c005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 -- 172.21.15.167:0/1600944260 shutdown_connections 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 --2- 172.21.15.167:0/1600944260 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b52708f20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 -- 172.21.15.167:0/1600944260 >> 172.21.15.167:0/1600944260 conn(0x561b5267c5c0 msgr2=0x561b5267c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 -- 172.21.15.167:0/1600944260 shutdown_connections 2023-10-05T19:50:32.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 -- 172.21.15.167:0/1600944260 wait complete. 2023-10-05T19:50:32.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 Processor -- start 2023-10-05T19:50:32.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 -- start start 2023-10-05T19:50:32.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b52727b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.453+0000 7f678e70be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b525d4e30 con 0x561b52708b50 2023-10-05T19:50:32.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678c240700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b52727b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678c240700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b52727b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46834/0 (socket says 172.21.15.167:46834) 2023-10-05T19:50:32.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678c240700 1 -- 172.21.15.167:0/1798594495 learned_addr learned my addr 172.21.15.167:0/1798594495 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678c240700 1 -- 172.21.15.167:0/1798594495 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c005db0 con 0x561b52708b50 2023-10-05T19:50:32.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678c240700 1 --2- 172.21.15.167:0/1798594495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b52727b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f677c00a5a0 tx=0x7f677c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8baf8e8fb6b4fece server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678a23c700 1 -- 172.21.15.167:0/1798594495 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f677c005460 con 0x561b52708b50 2023-10-05T19:50:32.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678a23c700 1 -- 172.21.15.167:0/1798594495 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c008a30 con 0x561b52708b50 2023-10-05T19:50:32.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678a23c700 1 -- 172.21.15.167:0/1798594495 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f677c008d00 con 0x561b52708b50 2023-10-05T19:50:32.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 -- 172.21.15.167:0/1798594495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 msgr2=0x561b52727b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 --2- 172.21.15.167:0/1798594495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b52727b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f677c00a5a0 tx=0x7f677c015000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 -- 172.21.15.167:0/1798594495 shutdown_connections 2023-10-05T19:50:32.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 --2- 172.21.15.167:0/1798594495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b52727b10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 -- 172.21.15.167:0/1798594495 >> 172.21.15.167:0/1798594495 conn(0x561b5267c5c0 msgr2=0x561b527236d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 -- 172.21.15.167:0/1798594495 shutdown_connections 2023-10-05T19:50:32.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 -- 172.21.15.167:0/1798594495 wait complete. 2023-10-05T19:50:32.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 Processor -- start 2023-10-05T19:50:32.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 -- start start 2023-10-05T19:50:32.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b5272e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678e70be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b525a7ed0 con 0x561b52708b50 2023-10-05T19:50:32.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678c240700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b5272e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678c240700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b5272e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46846/0 (socket says 172.21.15.167:46846) 2023-10-05T19:50:32.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.457+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 learned_addr learned my addr 172.21.15.167:0/722917857 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b5270a600 con 0x561b52708b50 2023-10-05T19:50:32.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f678c240700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b5272e770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f677c00a650 tx=0x7f677c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f6788a39700 1 -- 172.21.15.167:0/722917857 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f677c00a050 con 0x561b52708b50 2023-10-05T19:50:32.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f6788a39700 1 -- 172.21.15.167:0/722917857 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c00a1b0 con 0x561b52708b50 2023-10-05T19:50:32.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b5272ecb0 con 0x561b52708b50 2023-10-05T19:50:32.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f6788a39700 1 -- 172.21.15.167:0/722917857 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f677c012450 con 0x561b52708b50 2023-10-05T19:50:32.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b5272f150 con 0x561b52708b50 2023-10-05T19:50:32.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f6788a39700 1 -- 172.21.15.167:0/722917857 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f677c019070 con 0x561b52708b50 2023-10-05T19:50:32.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f6788a39700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f676c030c00 0x7f676c0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f6788a39700 1 -- 172.21.15.167:0/722917857 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f677c046670 con 0x561b52708b50 2023-10-05T19:50:32.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f678ba3f700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f676c030c00 0x7f676c0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b52709460 0x561b5273a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.461+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5273a8c0 con 0x561b52709460 2023-10-05T19:50:32.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678ca41700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b52709460 0x561b5273a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678ba3f700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f676c030c00 0x7f676c0330b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f677400b300 tx=0x7f6774001470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678ca41700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b52709460 0x561b5273a1c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 20 realm 2023-10-05T19:50:32.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52737820 con 0x561b52709460 2023-10-05T19:50:32.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:32.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5273b3f0 con 0x561b52709460 2023-10-05T19:50:32.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b5273b020 0x561b5273e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5273e990 con 0x561b5273b020 2023-10-05T19:50:32.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678c240700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b5273b020 0x561b5273e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.465+0000 7f678c240700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b5273b020 0x561b5273e260 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f677c041040 con 0x561b5273b020 2023-10-05T19:50:32.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678e70be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5273f260 con 0x561b52709460 2023-10-05T19:50:32.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678e70be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:32.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678e70be40 20 searching for the correct realm 2023-10-05T19:50:32.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b5273edd0 0x561b52743030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273edd0 2023-10-05T19:50:32.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678ba3f700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b5273edd0 0x561b52743030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678ba3f700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b5273edd0 0x561b52743030 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273b020 2023-10-05T19:50:32.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c041040 con 0x561b5273b020 2023-10-05T19:50:32.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678c240700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f677c039070 0x7f677c01b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x7f677c039070 2023-10-05T19:50:32.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.469+0000 7f678ca41700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f677c039070 0x7f677c01b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ca41700 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f677c039070 0x7f677c01b580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273edd0 2023-10-05T19:50:32.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273b020 2023-10-05T19:50:32.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c041040 con 0x561b5273b020 2023-10-05T19:50:32.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.473+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273b020 2023-10-05T19:50:32.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c041040 con 0x561b5273b020 2023-10-05T19:50:32.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x7f677c039070 2023-10-05T19:50:32.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x7f677c039070 2023-10-05T19:50:32.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273b020 2023-10-05T19:50:32.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c041040 con 0x561b5273b020 2023-10-05T19:50:32.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273edd0 2023-10-05T19:50:32.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.477+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273b020 2023-10-05T19:50:32.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c041040 con 0x561b5273b020 2023-10-05T19:50:32.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273edd0 2023-10-05T19:50:32.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.481+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273edd0 2023-10-05T19:50:32.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x7f677c039070 2023-10-05T19:50:32.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b52709460 2023-10-05T19:50:32.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x7f677c039070 2023-10-05T19:50:32.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273edd0 2023-10-05T19:50:32.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x7f677c039070 2023-10-05T19:50:32.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273b020 2023-10-05T19:50:32.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c041040 con 0x561b5273b020 2023-10-05T19:50:32.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.485+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273b020 2023-10-05T19:50:32.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c041040 con 0x561b5273b020 2023-10-05T19:50:32.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273edd0 2023-10-05T19:50:32.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273b020 2023-10-05T19:50:32.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f677c041040 con 0x561b5273b020 2023-10-05T19:50:32.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743610 con 0x561b5273b020 2023-10-05T19:50:32.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678e70be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:32.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678e70be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:32.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678e70be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:32.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678e70be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:32.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5273fdd0 con 0x561b52709460 2023-10-05T19:50:32.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.489+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52740750 con 0x561b5273b020 2023-10-05T19:50:32.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5273f9c0 con 0x561b5273b020 2023-10-05T19:50:32.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:32.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743fc0 con 0x561b5273edd0 2023-10-05T19:50:32.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52744370 con 0x561b52709460 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52744720 con 0x561b5273b020 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.493+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273edd0 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273b020 2023-10-05T19:50:32.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x7f677c039070 2023-10-05T19:50:32.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273edd0 2023-10-05T19:50:32.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.497+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273b020 2023-10-05T19:50:32.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273b020 2023-10-05T19:50:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x7f677c039070 2023-10-05T19:50:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.501+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x7f677c039070 2023-10-05T19:50:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273b020 2023-10-05T19:50:32.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273edd0 2023-10-05T19:50:32.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273b020 2023-10-05T19:50:32.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.505+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273edd0 2023-10-05T19:50:32.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273edd0 2023-10-05T19:50:32.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x7f677c039070 2023-10-05T19:50:32.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b52709460 2023-10-05T19:50:32.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.509+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x7f677c039070 2023-10-05T19:50:32.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273edd0 2023-10-05T19:50:32.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x7f677c039070 2023-10-05T19:50:32.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273b020 2023-10-05T19:50:32.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273b020 2023-10-05T19:50:32.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273edd0 2023-10-05T19:50:32.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.513+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273b020 2023-10-05T19:50:32.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745ae0 con 0x561b5273b020 2023-10-05T19:50:32.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:32.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:32.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:32.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:32.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52744ad0 con 0x561b5273b020 2023-10-05T19:50:32.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52744ad0 con 0x561b52709460 2023-10-05T19:50:32.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:32.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.517+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52743b90 con 0x561b5273b020 2023-10-05T19:50:32.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745400 con 0x561b5273b020 2023-10-05T19:50:32.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:32.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745400 con 0x7f677c039070 2023-10-05T19:50:32.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 zone default found 2023-10-05T19:50:32.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 4 Realm: () 2023-10-05T19:50:32.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:32.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:32.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:32.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 zonegroup default 2023-10-05T19:50:32.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745400 con 0x7f677c039070 2023-10-05T19:50:32.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52745400 con 0x561b5273edd0 2023-10-05T19:50:32.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.521+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52747810 con 0x561b5273edd0 2023-10-05T19:50:32.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.525+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.525+0000 7f678e70be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.525+0000 7f678e70be40 20 started sync module instance, tier type = 2023-10-05T19:50:32.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.525+0000 7f678e70be40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:32.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.525+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52746ed0 con 0x561b5273b020 2023-10-05T19:50:32.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.525+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.525+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94675347459856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52746ed0 con 0x561b5273b020 2023-10-05T19:50:32.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.525+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527480b0 con 0x561b52709460 2023-10-05T19:50:32.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.529+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94675347459856] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.529+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.529+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94675347469008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527480b0 con 0x561b52709460 2023-10-05T19:50:32.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.529+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52748950 con 0x561b5273b020 2023-10-05T19:50:32.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.529+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94675347469008] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.529+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.529+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94675347471296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52748500 con 0x561b5273b020 2023-10-05T19:50:32.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.529+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52749090 con 0x7f677c039070 2023-10-05T19:50:32.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.533+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.533+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94675347475296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52748fb0 con 0x7f677c039070 2023-10-05T19:50:32.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.533+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52749fe0 con 0x561b5273b020 2023-10-05T19:50:32.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.533+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94675347471296] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.533+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94675347475296] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.533+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.533+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94675347477648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b52749af0 con 0x561b5273b020 2023-10-05T19:50:32.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.533+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5274a500 con 0x561b5273edd0 2023-10-05T19:50:32.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.537+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.537+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94675347480592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5274ada0 con 0x561b5273edd0 2023-10-05T19:50:32.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.537+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5274b7b0 con 0x561b5273edd0 2023-10-05T19:50:32.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.537+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94675347477648] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.537+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.537+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94675347480592] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.537+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94675347472400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5274c050 con 0x561b5273edd0 2023-10-05T19:50:32.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.537+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5274c400 con 0x7f677c039070 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94675347472400] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94675347487584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5274c4a0 con 0x7f677c039070 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 20 add_watcher() i=0 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 20 add_watcher() i=1 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 20 add_watcher() i=2 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 20 add_watcher() i=3 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 20 add_watcher() i=4 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 20 add_watcher() i=5 2023-10-05T19:50:32.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 20 add_watcher() i=6 2023-10-05T19:50:32.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94675347487584] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 20 add_watcher() i=7 2023-10-05T19:50:32.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:32.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5274f5b0 con 0x561b52709460 2023-10-05T19:50:32.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.541+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94675347488688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5274c8f0 con 0x561b52709460 2023-10-05T19:50:32.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94675347488688] v30'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f675dfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:32.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:32.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:32.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 Processor -- start 2023-10-05T19:50:32.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 -- start start 2023-10-05T19:50:32.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b52759e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b5275a370 con 0x561b52759a60 2023-10-05T19:50:32.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678ba3f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b52759e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678ba3f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b52759e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46860/0 (socket says 172.21.15.167:46860) 2023-10-05T19:50:32.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678ba3f700 1 -- 172.21.15.167:0/2082609679 learned_addr learned my addr 172.21.15.167:0/2082609679 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678ba3f700 1 -- 172.21.15.167:0/2082609679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b5275a4b0 con 0x561b52759a60 2023-10-05T19:50:32.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678ba3f700 1 --2- 172.21.15.167:0/2082609679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b52759e30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x561b527404d0 tx=0x7f6774006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782353eace294668 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f675d7e2700 1 -- 172.21.15.167:0/2082609679 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f677402e740 con 0x561b52759a60 2023-10-05T19:50:32.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f675d7e2700 1 -- 172.21.15.167:0/2082609679 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774024040 con 0x561b52759a60 2023-10-05T19:50:32.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f675d7e2700 1 -- 172.21.15.167:0/2082609679 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f677402e8c0 con 0x561b52759a60 2023-10-05T19:50:32.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 -- 172.21.15.167:0/2082609679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 msgr2=0x561b52759e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 --2- 172.21.15.167:0/2082609679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b52759e30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x561b527404d0 tx=0x7f6774006000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 -- 172.21.15.167:0/2082609679 shutdown_connections 2023-10-05T19:50:32.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 --2- 172.21.15.167:0/2082609679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b52759e30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 -- 172.21.15.167:0/2082609679 >> 172.21.15.167:0/2082609679 conn(0x561b52754e20 msgr2=0x561b52752fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 -- 172.21.15.167:0/2082609679 shutdown_connections 2023-10-05T19:50:32.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.545+0000 7f678e70be40 1 -- 172.21.15.167:0/2082609679 wait complete. 2023-10-05T19:50:32.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678e70be40 1 Processor -- start 2023-10-05T19:50:32.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678e70be40 1 -- start start 2023-10-05T19:50:32.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678e70be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b5275f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678e70be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b527605c0 con 0x561b52759a60 2023-10-05T19:50:32.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678ba3f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b5275f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678ba3f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b5275f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46876/0 (socket says 172.21.15.167:46876) 2023-10-05T19:50:32.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678ba3f700 1 -- 172.21.15.167:0/468264122 learned_addr learned my addr 172.21.15.167:0/468264122 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678ba3f700 1 -- 172.21.15.167:0/468264122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774006070 con 0x561b52759a60 2023-10-05T19:50:32.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678ba3f700 1 --2- 172.21.15.167:0/468264122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b5275f5c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x561b5273f910 tx=0x7f6774037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f66d77fe700 1 -- 172.21.15.167:0/468264122 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6774039500 con 0x561b52759a60 2023-10-05T19:50:32.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f66d77fe700 1 -- 172.21.15.167:0/468264122 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774039660 con 0x561b52759a60 2023-10-05T19:50:32.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678e70be40 1 -- 172.21.15.167:0/468264122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b5275fbc0 con 0x561b52759a60 2023-10-05T19:50:32.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f66d77fe700 1 -- 172.21.15.167:0/468264122 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67740397f0 con 0x561b52759a60 2023-10-05T19:50:32.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f678e70be40 1 -- 172.21.15.167:0/468264122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b52760000 con 0x561b52759a60 2023-10-05T19:50:32.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.549+0000 7f66d77fe700 1 -- 172.21.15.167:0/468264122 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f6774040040 con 0x561b52759a60 2023-10-05T19:50:32.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f66d77fe700 1 --2- 172.21.15.167:0/468264122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f66cc030c50 0x7f66cc033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f66d77fe700 1 -- 172.21.15.167:0/468264122 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f6774043c20 con 0x561b52759a60 2023-10-05T19:50:32.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f678ca41700 1 --2- 172.21.15.167:0/468264122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f66cc030c50 0x7f66cc033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f678e70be40 5 note: GC not initialized 2023-10-05T19:50:32.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f678ca41700 1 --2- 172.21.15.167:0/468264122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f66cc030c50 0x7f66cc033100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x561b5274f630 tx=0x7f678400ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f66d4ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:32.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f678e70be40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:32.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f66ca7fc700 20 reqs_thread_entry: start 2023-10-05T19:50:32.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f678e70be40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:32.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f66c8ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:02 2023 2023-10-05T19:50:32.562 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:32.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f66affff700 20 reqs_thread_entry: start 2023-10-05T19:50:32.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f678e70be40 20 get_system_obj_state: rctx=0x7ffffc94e938 obj=default.rgw.meta:users.uid:foo state=0x561b525e00b0 s->prefetch_data=0 2023-10-05T19:50:32.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.553+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527c7cb0 con 0x561b52709460 2023-10-05T19:50:32.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.557+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.563 INFO:teuthology.orchestra.run.smithi167.stderr:could not fetch user info: no user info saved 2023-10-05T19:50:32.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.557+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94675347459856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527c7cb0 con 0x561b5273b020 2023-10-05T19:50:32.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.557+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94675347459856] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.557+0000 7f678e70be40 20 remove_watcher() i=0 2023-10-05T19:50:32.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.557+0000 7f678e70be40 2 removed watcher, disabling cache 2023-10-05T19:50:32.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.557+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94675347469008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527c7cb0 con 0x561b52709460 2023-10-05T19:50:32.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.561+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94675347469008] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.561+0000 7f678e70be40 20 remove_watcher() i=1 2023-10-05T19:50:32.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.561+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94675347471296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527c7cb0 con 0x561b5273b020 2023-10-05T19:50:32.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.561+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94675347471296] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.561+0000 7f678e70be40 20 remove_watcher() i=2 2023-10-05T19:50:32.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.561+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94675347475296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527c7cb0 con 0x7f677c039070 2023-10-05T19:50:32.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.565+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94675347475296] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.565+0000 7f678e70be40 20 remove_watcher() i=3 2023-10-05T19:50:32.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.565+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94675347477648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527c7cb0 con 0x561b5273b020 2023-10-05T19:50:32.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.565+0000 7f678c240700 1 -- 172.21.15.167:0/722917857 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94675347477648] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677c04e040 con 0x561b5273b020 2023-10-05T19:50:32.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.565+0000 7f678e70be40 20 remove_watcher() i=4 2023-10-05T19:50:32.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.565+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94675347480592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527c7cb0 con 0x561b5273edd0 2023-10-05T19:50:32.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.569+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94675347480592] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.569+0000 7f678e70be40 20 remove_watcher() i=5 2023-10-05T19:50:32.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.569+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94675347472400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b527c7cb0 con 0x561b5273edd0 2023-10-05T19:50:32.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.569+0000 7f678ba3f700 1 -- 172.21.15.167:0/722917857 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94675347472400] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f677400f560 con 0x561b5273edd0 2023-10-05T19:50:32.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.569+0000 7f678e70be40 20 remove_watcher() i=6 2023-10-05T19:50:32.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.569+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94675347487584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5271e3f0 con 0x7f677c039070 2023-10-05T19:50:32.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.569+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94675347487584] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x7f677c039070 2023-10-05T19:50:32.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.569+0000 7f678e70be40 20 remove_watcher() i=7 2023-10-05T19:50:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f675dfe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94675347488688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b5271e3f0 con 0x561b52709460 2023-10-05T19:50:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 94675347488688] v30'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f678400a5a0 con 0x561b52709460 2023-10-05T19:50:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b5273b020 msgr2=0x561b5273e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b5273b020 0x561b5273e260 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b52709460 msgr2=0x561b5273a1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b52709460 0x561b5273a1c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f677c039070 msgr2=0x7f677c01b580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f677c039070 0x7f677c01b580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b5273edd0 msgr2=0x561b52743030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b5273edd0 0x561b52743030 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f676c030c00 msgr2=0x7f676c0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f676c030c00 0x7f676c0330b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f677400b300 tx=0x7f6774001470 comp rx=0 tx=0).stop 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 msgr2=0x561b5272e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678ca41700 1 -- 172.21.15.167:0/722917857 reap_dead start 2023-10-05T19:50:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.573+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b5272e770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f677c00a650 tx=0x7f677c01c000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 shutdown_connections 2023-10-05T19:50:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 --2- 172.21.15.167:0/722917857 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52708b50 0x561b5272e770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 >> 172.21.15.167:0/722917857 conn(0x561b5267c5c0 msgr2=0x561b52722150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 shutdown_connections 2023-10-05T19:50:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/722917857 wait complete. 2023-10-05T19:50:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/468264122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f66cc030c50 msgr2=0x7f66cc033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 --2- 172.21.15.167:0/468264122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f66cc030c50 0x7f66cc033100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x561b5274f630 tx=0x7f678400ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/468264122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 msgr2=0x561b5275f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 --2- 172.21.15.167:0/468264122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b5275f5c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x561b5273f910 tx=0x7f6774037000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/468264122 shutdown_connections 2023-10-05T19:50:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 --2- 172.21.15.167:0/468264122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f66cc030c50 0x7f66cc033100 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 --2- 172.21.15.167:0/468264122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b52759a60 0x561b5275f5c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/468264122 >> 172.21.15.167:0/468264122 conn(0x561b52754e20 msgr2=0x561b52752f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/468264122 shutdown_connections 2023-10-05T19:50:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.577+0000 7f678e70be40 1 -- 172.21.15.167:0/468264122 wait complete. 2023-10-05T19:50:32.589 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-05T19:50:32.589 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2023-10-05T19:50:32.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2023-10-05T19:50:32.590 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2023-10-05T19:50:32.680 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:32.681 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:32.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.673+0000 7f1768be5e40 1 Processor -- start 2023-10-05T19:50:32.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.673+0000 7f1768be5e40 1 -- start start 2023-10-05T19:50:32.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.673+0000 7f1768be5e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x563a9231f0c0 0x563a923214a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.673+0000 7f1768be5e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563a92265bd0 con 0x563a9231aaf0 2023-10-05T19:50:32.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.673+0000 7f1768be5e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x563a92222ee0 con 0x563a9231f0c0 2023-10-05T19:50:32.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.673+0000 7f1765f19700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x563a9231f0c0 0x563a923214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.673+0000 7f1765f19700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x563a9231f0c0 0x563a923214a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46878/0 (socket says 172.21.15.167:46878) 2023-10-05T19:50:32.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.673+0000 7f1765f19700 1 -- 172.21.15.167:0/1468655635 learned_addr learned my addr 172.21.15.167:0/1468655635 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1765f19700 1 -- 172.21.15.167:0/1468655635 >> v1:172.21.15.118:6789/0 conn(0x563a9231aaf0 legacy=0x563a9231aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1765f19700 1 -- 172.21.15.167:0/1468655635 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9231b700 con 0x563a9231f0c0 2023-10-05T19:50:32.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1765f19700 1 --2- 172.21.15.167:0/1468655635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231f0c0 0x563a923214a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f176000a5c0 tx=0x7f1760005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea8c639fa3ac4ee server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1765718700 1 -- 172.21.15.167:0/1468655635 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f176000e510 con 0x563a9231f0c0 2023-10-05T19:50:32.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1765718700 1 -- 172.21.15.167:0/1468655635 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176000e670 con 0x563a9231f0c0 2023-10-05T19:50:32.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1765718700 1 -- 172.21.15.167:0/1468655635 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f176000e920 con 0x563a9231f0c0 2023-10-05T19:50:32.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 -- 172.21.15.167:0/1468655635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231f0c0 msgr2=0x563a923214a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 --2- 172.21.15.167:0/1468655635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231f0c0 0x563a923214a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f176000a5c0 tx=0x7f1760005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:32.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 -- 172.21.15.167:0/1468655635 shutdown_connections 2023-10-05T19:50:32.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 --2- 172.21.15.167:0/1468655635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231f0c0 0x563a923214a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 -- 172.21.15.167:0/1468655635 >> 172.21.15.167:0/1468655635 conn(0x563a9228e560 msgr2=0x563a9228e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 -- 172.21.15.167:0/1468655635 shutdown_connections 2023-10-05T19:50:32.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 -- 172.21.15.167:0/1468655635 wait complete. 2023-10-05T19:50:32.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 Processor -- start 2023-10-05T19:50:32.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 -- start start 2023-10-05T19:50:32.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92339c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f1768be5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a921e6e30 con 0x563a9231aaf0 2023-10-05T19:50:32.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f176671a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92339c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f176671a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92339c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46894/0 (socket says 172.21.15.167:46894) 2023-10-05T19:50:32.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f176671a700 1 -- 172.21.15.167:0/3661307064 learned_addr learned my addr 172.21.15.167:0/3661307064 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.677+0000 7f176671a700 1 -- 172.21.15.167:0/3661307064 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176000a180 con 0x563a9231aaf0 2023-10-05T19:50:32.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f176671a700 1 --2- 172.21.15.167:0/3661307064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92339c40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1758001d30 tx=0x7f1758001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe89a479832e2e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f175ffff700 1 -- 172.21.15.167:0/3661307064 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1758014070 con 0x563a9231aaf0 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f175ffff700 1 -- 172.21.15.167:0/3661307064 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758008070 con 0x563a9231aaf0 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f175ffff700 1 -- 172.21.15.167:0/3661307064 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f175800bd30 con 0x563a9231aaf0 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 -- 172.21.15.167:0/3661307064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 msgr2=0x563a92339c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3661307064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92339c40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1758001d30 tx=0x7f1758001900 comp rx=0 tx=0).stop 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 -- 172.21.15.167:0/3661307064 shutdown_connections 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3661307064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92339c40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 -- 172.21.15.167:0/3661307064 >> 172.21.15.167:0/3661307064 conn(0x563a9228e560 msgr2=0x563a92335800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 -- 172.21.15.167:0/3661307064 shutdown_connections 2023-10-05T19:50:32.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 -- 172.21.15.167:0/3661307064 wait complete. 2023-10-05T19:50:32.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 Processor -- start 2023-10-05T19:50:32.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 -- start start 2023-10-05T19:50:32.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92340a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f1768be5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a921b9ed0 con 0x563a9231aaf0 2023-10-05T19:50:32.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f176671a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92340a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f176671a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92340a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46900/0 (socket says 172.21.15.167:46900) 2023-10-05T19:50:32.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 learned_addr learned my addr 172.21.15.167:0/3085961062 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.681+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175800a040 con 0x563a9231aaf0 2023-10-05T19:50:32.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f176671a700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92340a10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x563a92336320 tx=0x7f1758016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f175e7fc700 1 -- 172.21.15.167:0/3085961062 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f175800bee0 con 0x563a9231aaf0 2023-10-05T19:50:32.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f175e7fc700 1 -- 172.21.15.167:0/3085961062 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758021070 con 0x563a9231aaf0 2023-10-05T19:50:32.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a92340f50 con 0x563a9231aaf0 2023-10-05T19:50:32.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f175e7fc700 1 -- 172.21.15.167:0/3085961062 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f175801a600 con 0x563a9231aaf0 2023-10-05T19:50:32.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a923413f0 con 0x563a9231aaf0 2023-10-05T19:50:32.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f175e7fc700 1 -- 172.21.15.167:0/3085961062 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f175801a7b0 con 0x563a9231aaf0 2023-10-05T19:50:32.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f175e7fc700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f174c030c50 0x7f174c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.685+0000 7f175e7fc700 1 -- 172.21.15.167:0/3085961062 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f1758044d00 con 0x563a9231aaf0 2023-10-05T19:50:32.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1765f19700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f174c030c50 0x7f174c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563a9231f0c0 0x563a9234c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9234cbe0 con 0x563a9231f0c0 2023-10-05T19:50:32.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1766f1b700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563a9231f0c0 0x563a9234c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1765f19700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f174c030c50 0x7f174c033100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1760000f80 tx=0x7f1760013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1766f1b700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563a9231f0c0 0x563a9234c530 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f175000a500 con 0x563a9231f0c0 2023-10-05T19:50:32.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 20 realm 2023-10-05T19:50:32.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92349b90 con 0x563a9231f0c0 2023-10-05T19:50:32.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f175000a500 con 0x563a9231f0c0 2023-10-05T19:50:32.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:32.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9234d6c0 con 0x563a9231f0c0 2023-10-05T19:50:32.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f175000a500 con 0x563a9231f0c0 2023-10-05T19:50:32.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563a9234e4f0 0x563a923508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92350e10 con 0x563a9234e4f0 2023-10-05T19:50:32.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f176671a700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563a9234e4f0 0x563a923508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.689+0000 7f176671a700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563a9234e4f0 0x563a923508d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1758016070 con 0x563a9234e4f0 2023-10-05T19:50:32.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1768be5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923516b0 con 0x563a9231f0c0 2023-10-05T19:50:32.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f175000a500 con 0x563a9231f0c0 2023-10-05T19:50:32.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1768be5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:32.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1768be5e40 20 searching for the correct realm 2023-10-05T19:50:32.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563a92353470 0x563a92355850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a92353470 2023-10-05T19:50:32.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1765f19700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563a92353470 0x563a92355850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1765f19700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563a92353470 0x563a92355850 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9234e4f0 2023-10-05T19:50:32.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1758016070 con 0x563a9234e4f0 2023-10-05T19:50:32.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f176671a700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f17580176e0 0x7f175801aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x7f17580176e0 2023-10-05T19:50:32.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.693+0000 7f1766f1b700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f17580176e0 0x7f175801aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1766f1b700 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f17580176e0 0x7f175801aa60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x7f17580176e0 2023-10-05T19:50:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a92353470 2023-10-05T19:50:32.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9234e4f0 2023-10-05T19:50:32.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1758016070 con 0x563a9234e4f0 2023-10-05T19:50:32.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.697+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9234e4f0 2023-10-05T19:50:32.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1758016070 con 0x563a9234e4f0 2023-10-05T19:50:32.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x7f17580176e0 2023-10-05T19:50:32.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x7f17580176e0 2023-10-05T19:50:32.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x7f17580176e0 2023-10-05T19:50:32.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x7f17580176e0 2023-10-05T19:50:32.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9234e4f0 2023-10-05T19:50:32.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1758016070 con 0x563a9234e4f0 2023-10-05T19:50:32.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a92353470 2023-10-05T19:50:32.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.701+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9234e4f0 2023-10-05T19:50:32.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1758016070 con 0x563a9234e4f0 2023-10-05T19:50:32.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a92353470 2023-10-05T19:50:32.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a92353470 2023-10-05T19:50:32.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.705+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x7f17580176e0 2023-10-05T19:50:32.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x7f17580176e0 2023-10-05T19:50:32.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9231f0c0 2023-10-05T19:50:32.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x7f17580176e0 2023-10-05T19:50:32.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x7f17580176e0 2023-10-05T19:50:32.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a92353470 2023-10-05T19:50:32.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x7f17580176e0 2023-10-05T19:50:32.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x7f17580176e0 2023-10-05T19:50:32.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9234e4f0 2023-10-05T19:50:32.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1758016070 con 0x563a9234e4f0 2023-10-05T19:50:32.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9234e4f0 2023-10-05T19:50:32.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1758016070 con 0x563a9234e4f0 2023-10-05T19:50:32.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.709+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a92353470 2023-10-05T19:50:32.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9234e4f0 2023-10-05T19:50:32.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f1758016070 con 0x563a9234e4f0 2023-10-05T19:50:32.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92355d90 con 0x563a9234e4f0 2023-10-05T19:50:32.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:32.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:32.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:32.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:32.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92352220 con 0x563a9231f0c0 2023-10-05T19:50:32.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92352b70 con 0x563a9234e4f0 2023-10-05T19:50:32.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.713+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923561d0 con 0x563a9234e4f0 2023-10-05T19:50:32.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:32.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356580 con 0x563a92353470 2023-10-05T19:50:32.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923526e0 con 0x563a9234e4f0 2023-10-05T19:50:32.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923581e0 con 0x563a92353470 2023-10-05T19:50:32.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.717+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923581e0 con 0x563a9234e4f0 2023-10-05T19:50:32.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923581e0 con 0x7f17580176e0 2023-10-05T19:50:32.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x7f17580176e0 2023-10-05T19:50:32.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a92353470 2023-10-05T19:50:32.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.721+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9234e4f0 2023-10-05T19:50:32.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9234e4f0 2023-10-05T19:50:32.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x7f17580176e0 2023-10-05T19:50:32.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x7f17580176e0 2023-10-05T19:50:32.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x7f17580176e0 2023-10-05T19:50:32.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x7f17580176e0 2023-10-05T19:50:32.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.725+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9234e4f0 2023-10-05T19:50:32.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a92353470 2023-10-05T19:50:32.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9234e4f0 2023-10-05T19:50:32.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a92353470 2023-10-05T19:50:32.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750014040 con 0x563a9231f0c0 2023-10-05T19:50:32.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.729+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a92353470 2023-10-05T19:50:32.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x7f17580176e0 2023-10-05T19:50:32.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9231f0c0 2023-10-05T19:50:32.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x7f17580176e0 2023-10-05T19:50:32.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a92353470 2023-10-05T19:50:32.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.733+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x7f17580176e0 2023-10-05T19:50:32.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9234e4f0 2023-10-05T19:50:32.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9234e4f0 2023-10-05T19:50:32.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a92353470 2023-10-05T19:50:32.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9234e4f0 2023-10-05T19:50:32.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.737+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92356930 con 0x563a9234e4f0 2023-10-05T19:50:32.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:32.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:32.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:32.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:32.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923571d0 con 0x563a9234e4f0 2023-10-05T19:50:32.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923571d0 con 0x563a9231f0c0 2023-10-05T19:50:32.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:32.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92357ac0 con 0x563a9234e4f0 2023-10-05T19:50:32.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:32.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.741+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92357ac0 con 0x563a9234e4f0 2023-10-05T19:50:32.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:32.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923575d0 con 0x7f17580176e0 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 zone default found 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 4 Realm: () 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 zonegroup default 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923575d0 con 0x7f17580176e0 2023-10-05T19:50:32.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923575d0 con 0x563a92353470 2023-10-05T19:50:32.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923579d0 con 0x563a92353470 2023-10-05T19:50:32.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:32.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 started sync module instance, tier type = 2023-10-05T19:50:32.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.745+0000 7f1768be5e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:32.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.749+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92359430 con 0x563a9234e4f0 2023-10-05T19:50:32.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.749+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.749+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94809561075808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923599a0 con 0x563a9234e4f0 2023-10-05T19:50:32.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.749+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235a240 con 0x563a9231f0c0 2023-10-05T19:50:32.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.753+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94809561075808] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.753+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.753+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94809561077200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92359f10 con 0x563a9231f0c0 2023-10-05T19:50:32.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.753+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235aa60 con 0x563a9234e4f0 2023-10-05T19:50:32.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.753+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94809561077200] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.753+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.753+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94809561081488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92359f10 con 0x563a9234e4f0 2023-10-05T19:50:32.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.753+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235b350 con 0x7f17580176e0 2023-10-05T19:50:32.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.757+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94809561081488] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.757+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.757+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94809561078592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235b350 con 0x7f17580176e0 2023-10-05T19:50:32.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.757+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235bbf0 con 0x563a9234e4f0 2023-10-05T19:50:32.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.757+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94809561078592] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.757+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.757+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94809561084048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235b9d0 con 0x563a9234e4f0 2023-10-05T19:50:32.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.757+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235c650 con 0x563a92353470 2023-10-05T19:50:32.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.761+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.761+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94809561088352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235cef0 con 0x563a92353470 2023-10-05T19:50:32.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.761+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235d900 con 0x563a92353470 2023-10-05T19:50:32.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.761+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94809561084048] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.761+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94809561088352] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.761+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.761+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94809561093136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235dcb0 con 0x563a92353470 2023-10-05T19:50:32.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.761+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235e550 con 0x7f17580176e0 2023-10-05T19:50:32.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94809561096848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235ec50 con 0x7f17580176e0 2023-10-05T19:50:32.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 20 add_watcher() i=0 2023-10-05T19:50:32.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 20 add_watcher() i=1 2023-10-05T19:50:32.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 20 add_watcher() i=2 2023-10-05T19:50:32.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 20 add_watcher() i=3 2023-10-05T19:50:32.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 20 add_watcher() i=4 2023-10-05T19:50:32.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 20 add_watcher() i=5 2023-10-05T19:50:32.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94809561093136] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1760017050 con 0x563a92353470 2023-10-05T19:50:32.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 20 add_watcher() i=6 2023-10-05T19:50:32.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94809561096848] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 20 add_watcher() i=7 2023-10-05T19:50:32.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:32.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235b4e0 con 0x563a9231f0c0 2023-10-05T19:50:32.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.765+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94809561098016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a9235f110 con 0x563a9231f0c0 2023-10-05T19:50:32.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94809561098016] v30'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1736fed700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:32.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1768be5e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:32.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1768be5e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:32.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1768be5e40 1 Processor -- start 2023-10-05T19:50:32.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1768be5e40 1 -- start start 2023-10-05T19:50:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1768be5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a9236c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1768be5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9236cbd0 con 0x563a9236c2c0 2023-10-05T19:50:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1765f19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a9236c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1765f19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a9236c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46914/0 (socket says 172.21.15.167:46914) 2023-10-05T19:50:32.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1765f19700 1 -- 172.21.15.167:0/2624608054 learned_addr learned my addr 172.21.15.167:0/2624608054 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1765f19700 1 -- 172.21.15.167:0/2624608054 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9236cd10 con 0x563a9236c2c0 2023-10-05T19:50:32.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1765f19700 1 --2- 172.21.15.167:0/2624608054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a9236c690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x563a9231bb20 tx=0x7f1760010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1787598d8ff3a530 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f17367ec700 1 -- 172.21.15.167:0/2624608054 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f176002d040 con 0x563a9236c2c0 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f17367ec700 1 -- 172.21.15.167:0/2624608054 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1760010a60 con 0x563a9236c2c0 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f17367ec700 1 -- 172.21.15.167:0/2624608054 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1760010c30 con 0x563a9236c2c0 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1768be5e40 1 -- 172.21.15.167:0/2624608054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 msgr2=0x563a9236c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.769+0000 7f1768be5e40 1 --2- 172.21.15.167:0/2624608054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a9236c690 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x563a9231bb20 tx=0x7f1760010000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 -- 172.21.15.167:0/2624608054 shutdown_connections 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 --2- 172.21.15.167:0/2624608054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a9236c690 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 -- 172.21.15.167:0/2624608054 >> 172.21.15.167:0/2624608054 conn(0x563a92367680 msgr2=0x563a923657d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 -- 172.21.15.167:0/2624608054 shutdown_connections 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 -- 172.21.15.167:0/2624608054 wait complete. 2023-10-05T19:50:32.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 Processor -- start 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 -- start start 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a92371c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a92372c90 con 0x563a9236c2c0 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1765f19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a92371c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1765f19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a92371c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46930/0 (socket says 172.21.15.167:46930) 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1765f19700 1 -- 172.21.15.167:0/1647417438 learned_addr learned my addr 172.21.15.167:0/1647417438 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1765f19700 1 -- 172.21.15.167:0/1647417438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9231b700 con 0x563a9236c2c0 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1765f19700 1 --2- 172.21.15.167:0/1647417438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a92371c90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f176000ea70 tx=0x7f176002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1734fe9700 1 -- 172.21.15.167:0/1647417438 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1760033430 con 0x563a9236c2c0 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1734fe9700 1 -- 172.21.15.167:0/1647417438 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17600335b0 con 0x563a9236c2c0 2023-10-05T19:50:32.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1734fe9700 1 -- 172.21.15.167:0/1647417438 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1760033760 con 0x563a9236c2c0 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 -- 172.21.15.167:0/1647417438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563a92372290 con 0x563a9236c2c0 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.773+0000 7f1768be5e40 1 -- 172.21.15.167:0/1647417438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a923726d0 con 0x563a9236c2c0 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1734fe9700 1 -- 172.21.15.167:0/1647417438 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f1760033990 con 0x563a9236c2c0 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1734fe9700 1 --2- 172.21.15.167:0/1647417438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f16ac030c50 0x7f16ac033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1734fe9700 1 -- 172.21.15.167:0/1647417438 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f1760046c20 con 0x563a9236c2c0 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1766f1b700 1 --2- 172.21.15.167:0/1647417438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f16ac030c50 0x7f16ac033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1768be5e40 5 note: GC not initialized 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1766f1b700 1 --2- 172.21.15.167:0/1647417438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f16ac030c50 0x7f16ac033100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x563a9235ee80 tx=0x7f175000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f16a5ffb700 20 reqs_thread_entry: start 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1768be5e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1768be5e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:32.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f16957fa700 20 reqs_thread_entry: start 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1768be5e40 20 get_system_obj_state: rctx=0x7fff3fef9ab8 obj=default.rgw.meta:users.uid:foo state=0x563a921f20b0 s->prefetch_data=0 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1768be5e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923da4c0 con 0x563a9231f0c0 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.777+0000 7f16977fe700 20 reqs_thread_entry: start 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1695ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:03 2023 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 20 get_system_obj_state: rctx=0x7fff3fef97a8 obj=default.rgw.meta:users.email:foo@foo.com state=0x563a921f20b0 s->prefetch_data=0 2023-10-05T19:50:32.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.3 8:c162d5d1:users.email::foo@foo.com:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923da4c0 con 0x563a9231f0c0 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo@foo.com [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 20 get_system_obj_state: rctx=0x7fff3fef97a8 obj=default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1 state=0x563a921f20b0 s->prefetch_data=0 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923da4c0 con 0x563a9231f0c0 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 9te6NH5mcdcq0Tc5i8i1 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 20 get_system_obj_state: rctx=0x7fff3fef9048 obj=default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1 state=0x563a921f20b0 s->prefetch_data=0 2023-10-05T19:50:32.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 20 get_system_obj_state: rctx=0x7fff3fef96e8 obj=default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1 state=0x563a921f20b0 s->prefetch_data=0 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923d9360 con 0x563a9231f0c0 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~357] v30'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.781+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94809561599600 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923d92c0 con 0x563a9234e4f0 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94809561084048 notify 128849018880 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f175805b040 con 0x563a9234e4f0 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f175ffff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94809561084048 notifier 4283 bl.length()=533 2023-10-05T19:50:32.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.4 [notify cookie 94809561599600 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f175ffff700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f175ffff700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f175ffff700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1740003d90 con 0x563a9234e4f0 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94809561599600 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563a923413f0 con 0x563a9234e4f0 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923dba50 con 0x563a9231f0c0 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(108 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f1768be5e40 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f1768be5e40 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f1768be5e40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.785+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [notify cookie 94809561599552 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923d9290 con 0x7f17580176e0 2023-10-05T19:50:32.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== watch-notify(notify (1) cookie 94809561078592 notify 128849018880 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x7f1750002b80 con 0x7f17580176e0 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f175ffff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94809561078592 notifier 4283 bl.length()=169 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f175ffff700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f175ffff700 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.3 [notify cookie 94809561599552 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f175ffff700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1740003d90 con 0x7f17580176e0 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== watch-notify(notify_complete (2) cookie 94809561599552 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1750002db0 con 0x7f17580176e0 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(110 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923dba50 con 0x563a9231f0c0 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(111 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1768be5e40 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1768be5e40 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2023-10-05T19:50:32.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1768be5e40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2023-10-05T19:50:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.e 7:7759931f:::notify.3:head [notify cookie 94809561600016 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a923ddf60 con 0x7f17580176e0 2023-10-05T19:50:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== watch-notify(notify (1) cookie 94809561078592 notify 128849018881 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f1750002db0 con 0x7f17580176e0 2023-10-05T19:50:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f175f7fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94809561078592 notifier 4283 bl.length()=177 2023-10-05T19:50:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(112 notify.3 [notify cookie 94809561600016 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f175f7fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2023-10-05T19:50:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.789+0000 7f175f7fe700 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2023-10-05T19:50:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.793+0000 7f175f7fe700 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f16b40033f0 con 0x7f17580176e0 2023-10-05T19:50:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.793+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== watch-notify(notify_complete (2) cookie 94809561600016 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f175003a4c0 con 0x7f17580176e0 2023-10-05T19:50:32.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.793+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(113 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:32.930 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:32.931 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:32.932 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:32.933 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:32.933 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:32.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.793+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94809561075808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92330560 con 0x563a9234e4f0 2023-10-05T19:50:32.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.793+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94809561075808] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.793+0000 7f1768be5e40 20 remove_watcher() i=0 2023-10-05T19:50:32.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.793+0000 7f1768be5e40 2 removed watcher, disabling cache 2023-10-05T19:50:32.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.793+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94809561077200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92330560 con 0x563a9231f0c0 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.797+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94809561077200] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.797+0000 7f1768be5e40 20 remove_watcher() i=1 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.797+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94809561081488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92330560 con 0x563a9234e4f0 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.797+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94809561081488] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.797+0000 7f1768be5e40 20 remove_watcher() i=2 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.797+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94809561078592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92330560 con 0x7f17580176e0 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.801+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94809561078592] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.801+0000 7f1768be5e40 20 remove_watcher() i=3 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.801+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94809561084048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92330560 con 0x563a9234e4f0 2023-10-05T19:50:32.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.801+0000 7f176671a700 1 -- 172.21.15.167:0/3085961062 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94809561084048] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f175804c040 con 0x563a9234e4f0 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.801+0000 7f1768be5e40 20 remove_watcher() i=4 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.801+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94809561088352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92330560 con 0x563a92353470 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.805+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94809561088352] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1760042070 con 0x563a92353470 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.805+0000 7f1768be5e40 20 remove_watcher() i=5 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.805+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94809561093136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92330560 con 0x563a92353470 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.805+0000 7f1765f19700 1 -- 172.21.15.167:0/3085961062 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94809561093136] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1760042070 con 0x563a92353470 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.805+0000 7f1768be5e40 20 remove_watcher() i=6 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.805+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94809561096848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92330560 con 0x7f17580176e0 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.809+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.2 v2:172.21.15.167:6816/26774 28 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94809561096848] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1750033040 con 0x7f17580176e0 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.809+0000 7f1768be5e40 20 remove_watcher() i=7 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.809+0000 7f1736fed700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:32.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.809+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94809561098016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563a92330560 con 0x563a9231f0c0 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94809561098016] v30'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1750033040 con 0x563a9231f0c0 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563a9234e4f0 msgr2=0x563a923508d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563a9234e4f0 0x563a923508d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563a9231f0c0 msgr2=0x563a9234c530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563a9231f0c0 0x563a9234c530 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f17580176e0 msgr2=0x7f175801aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f17580176e0 0x7f175801aa60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563a92353470 msgr2=0x563a92355850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563a92353470 0x563a92355850 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f174c030c50 msgr2=0x7f174c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f174c030c50 0x7f174c033100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1760000f80 tx=0x7f1760013000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1766f1b700 1 -- 172.21.15.167:0/3085961062 reap_dead start 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 msgr2=0x563a92340a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92340a10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x563a92336320 tx=0x7f1758016000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 shutdown_connections 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/3085961062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9231aaf0 0x563a92340a10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 >> 172.21.15.167:0/3085961062 conn(0x563a9228e560 msgr2=0x563a92334280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 shutdown_connections 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/3085961062 wait complete. 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/1647417438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f16ac030c50 msgr2=0x7f16ac033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/1647417438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f16ac030c50 0x7f16ac033100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x563a9235ee80 tx=0x7f175000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/1647417438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 msgr2=0x563a92371c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/1647417438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a92371c90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f176000ea70 tx=0x7f176002c000 comp rx=0 tx=0).stop 2023-10-05T19:50:32.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/1647417438 shutdown_connections 2023-10-05T19:50:32.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/1647417438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f16ac030c50 0x7f16ac033100 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 --2- 172.21.15.167:0/1647417438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563a9236c2c0 0x563a92371c90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/1647417438 >> 172.21.15.167:0/1647417438 conn(0x563a92367680 msgr2=0x563a92365720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/1647417438 shutdown_connections 2023-10-05T19:50:32.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.813+0000 7f1768be5e40 1 -- 172.21.15.167:0/1647417438 wait complete. 2023-10-05T19:50:32.942 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:32.942 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2023-10-05T19:50:32.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2023-10-05T19:50:32.943 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2023-10-05T19:50:32.987 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:32.987 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:32.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6dd6be40 1 Processor -- start 2023-10-05T19:50:32.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6dd6be40 1 -- start start 2023-10-05T19:50:32.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6dd6be40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559fd9e4d0d0 0x559fd9e4f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6dd6be40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559fd9d93bd0 con 0x559fd9e48af0 2023-10-05T19:50:32.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6dd6be40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x559fd9d50ee0 con 0x559fd9e4d0d0 2023-10-05T19:50:32.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6b09f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559fd9e4d0d0 0x559fd9e4f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6b09f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559fd9e4d0d0 0x559fd9e4f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46932/0 (socket says 172.21.15.167:46932) 2023-10-05T19:50:32.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6b09f700 1 -- 172.21.15.167:0/3742805054 learned_addr learned my addr 172.21.15.167:0/3742805054 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6b09f700 1 -- 172.21.15.167:0/3742805054 >> v1:172.21.15.118:6789/0 conn(0x559fd9e48af0 legacy=0x559fd9e48ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6b09f700 1 -- 172.21.15.167:0/3742805054 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fd9e49700 con 0x559fd9e4d0d0 2023-10-05T19:50:32.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6b09f700 1 --2- 172.21.15.167:0/3742805054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e4d0d0 0x559fd9e4f4b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400a650 tx=0x7f6c64005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21913769038abc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.981+0000 7f6c6a89e700 1 -- 172.21.15.167:0/3742805054 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c64008760 con 0x559fd9e4d0d0 2023-10-05T19:50:32.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6a89e700 1 -- 172.21.15.167:0/3742805054 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c640088c0 con 0x559fd9e4d0d0 2023-10-05T19:50:32.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6a89e700 1 -- 172.21.15.167:0/3742805054 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c64008bb0 con 0x559fd9e4d0d0 2023-10-05T19:50:32.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3742805054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e4d0d0 msgr2=0x559fd9e4f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/3742805054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e4d0d0 0x559fd9e4f4b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400a650 tx=0x7f6c64005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:32.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3742805054 shutdown_connections 2023-10-05T19:50:32.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/3742805054 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e4d0d0 0x559fd9e4f4b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3742805054 >> 172.21.15.167:0/3742805054 conn(0x559fd9dbc450 msgr2=0x559fd9dbc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3742805054 shutdown_connections 2023-10-05T19:50:32.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3742805054 wait complete. 2023-10-05T19:50:32.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 Processor -- start 2023-10-05T19:50:32.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 -- start start 2023-10-05T19:50:32.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e67c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6dd6be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fd9d14e30 con 0x559fd9e48af0 2023-10-05T19:50:32.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6b8a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e67c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6b8a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e67c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46948/0 (socket says 172.21.15.167:46948) 2023-10-05T19:50:32.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/3866278624 learned_addr learned my addr 172.21.15.167:0/3866278624 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/3866278624 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64005db0 con 0x559fd9e48af0 2023-10-05T19:50:32.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6b8a0700 1 --2- 172.21.15.167:0/3866278624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e67c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c001d30 tx=0x7f6c5c001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c019820e14f01795 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6989c700 1 -- 172.21.15.167:0/3866278624 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c014070 con 0x559fd9e48af0 2023-10-05T19:50:32.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6989c700 1 -- 172.21.15.167:0/3866278624 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c008070 con 0x559fd9e48af0 2023-10-05T19:50:32.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.985+0000 7f6c6989c700 1 -- 172.21.15.167:0/3866278624 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c00bd30 con 0x559fd9e48af0 2023-10-05T19:50:32.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3866278624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 msgr2=0x559fd9e67c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/3866278624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e67c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c001d30 tx=0x7f6c5c001900 comp rx=0 tx=0).stop 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3866278624 shutdown_connections 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/3866278624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e67c40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3866278624 >> 172.21.15.167:0/3866278624 conn(0x559fd9dbc450 msgr2=0x559fd9e63780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3866278624 shutdown_connections 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3866278624 wait complete. 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 Processor -- start 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 -- start start 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e6e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fd9ce7ed0 con 0x559fd9e48af0 2023-10-05T19:50:32.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6b8a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e6e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:32.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6b8a0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e6e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46964/0 (socket says 172.21.15.167:46964) 2023-10-05T19:50:32.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 learned_addr learned my addr 172.21.15.167:0/2349459799 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:32.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c00a040 con 0x559fd9e48af0 2023-10-05T19:50:32.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6b8a0700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e6e9a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x559fd9e642a0 tx=0x7f6c5c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:32.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c63fff700 1 -- 172.21.15.167:0/2349459799 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c00bee0 con 0x559fd9e48af0 2023-10-05T19:50:32.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c63fff700 1 -- 172.21.15.167:0/2349459799 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c021070 con 0x559fd9e48af0 2023-10-05T19:50:32.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559fd9e6eee0 con 0x559fd9e48af0 2023-10-05T19:50:32.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c63fff700 1 -- 172.21.15.167:0/2349459799 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c01a600 con 0x559fd9e48af0 2023-10-05T19:50:32.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.989+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fd9e6f380 con 0x559fd9e48af0 2023-10-05T19:50:32.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:32.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c63fff700 1 -- 172.21.15.167:0/2349459799 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f6c5c01a7b0 con 0x559fd9e48af0 2023-10-05T19:50:33.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c63fff700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6c4c030c50 0x7f6c4c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c63fff700 1 -- 172.21.15.167:0/2349459799 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f6c5c044d70 con 0x559fd9e48af0 2023-10-05T19:50:33.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6b09f700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6c4c030c50 0x7f6c4c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559fd9e4d0d0 0x559fd9e7a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e7abb0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6c0a1700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559fd9e4d0d0 0x559fd9e7a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6b09f700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6c4c030c50 0x7f6c4c033100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c640030a0 tx=0x7f6c64015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6c0a1700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559fd9e4d0d0 0x559fd9e7a590 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6dd6be40 20 realm 2023-10-05T19:50:33.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.993+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e77bb0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:33.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e7b690 con 0x559fd9e4d0d0 2023-10-05T19:50:33.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559fd9e7c440 0x559fd9e7e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e7ed60 con 0x559fd9e7c440 2023-10-05T19:50:33.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6b8a0700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559fd9e7c440 0x559fd9e7e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6b8a0700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559fd9e7c440 0x559fd9e7e820 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e7f600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 20 searching for the correct realm 2023-10-05T19:50:33.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559fd9e813c0 0x559fd9e837a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e813c0 2023-10-05T19:50:33.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:32.997+0000 7f6c6b09f700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559fd9e813c0 0x559fd9e837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6b09f700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559fd9e813c0 0x559fd9e837a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6b8a0700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6c5c0176e0 0x7f6c5c0129f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6c0a1700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6c5c0176e0 0x7f6c5c0129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6c0a1700 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6c5c0176e0 0x7f6c5c0129f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.001+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e813c0 2023-10-05T19:50:33.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.005+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e813c0 2023-10-05T19:50:33.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.009+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e813c0 2023-10-05T19:50:33.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e813c0 2023-10-05T19:50:33.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.013+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e813c0 2023-10-05T19:50:33.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e813c0 2023-10-05T19:50:33.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.017+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e83ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80140 con 0x559fd9e4d0d0 2023-10-05T19:50:33.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e7fd40 con 0x559fd9e7c440 2023-10-05T19:50:33.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e84090 con 0x559fd9e7c440 2023-10-05T19:50:33.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.021+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e84440 con 0x559fd9e813c0 2023-10-05T19:50:33.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e847f0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e7c440 2023-10-05T19:50:33.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e860a0 con 0x559fd9e813c0 2023-10-05T19:50:33.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e860a0 con 0x559fd9e7c440 2023-10-05T19:50:33.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x7f6c5c0176e0 2023-10-05T19:50:33.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.025+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e813c0 2023-10-05T19:50:33.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e7c440 2023-10-05T19:50:33.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e7c440 2023-10-05T19:50:33.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.029+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x7f6c5c0176e0 2023-10-05T19:50:33.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x7f6c5c0176e0 2023-10-05T19:50:33.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e7c440 2023-10-05T19:50:33.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.033+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e813c0 2023-10-05T19:50:33.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e7c440 2023-10-05T19:50:33.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e813c0 2023-10-05T19:50:33.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.037+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e813c0 2023-10-05T19:50:33.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x7f6c5c0176e0 2023-10-05T19:50:33.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e4d0d0 2023-10-05T19:50:33.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x7f6c5c0176e0 2023-10-05T19:50:33.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e813c0 2023-10-05T19:50:33.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x7f6c5c0176e0 2023-10-05T19:50:33.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.041+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e7c440 2023-10-05T19:50:33.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e7c440 2023-10-05T19:50:33.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e813c0 2023-10-05T19:50:33.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e7c440 2023-10-05T19:50:33.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e80600 con 0x559fd9e7c440 2023-10-05T19:50:33.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6dd6be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6dd6be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6dd6be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6dd6be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.045+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e85090 con 0x559fd9e7c440 2023-10-05T19:50:33.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e85090 con 0x559fd9e4d0d0 2023-10-05T19:50:33.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e85980 con 0x559fd9e7c440 2023-10-05T19:50:33.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e84ce0 con 0x559fd9e7c440 2023-10-05T19:50:33.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e85490 con 0x7f6c5c0176e0 2023-10-05T19:50:33.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 zone default found 2023-10-05T19:50:33.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 4 Realm: () 2023-10-05T19:50:33.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:33.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:33.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:33.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 zonegroup default 2023-10-05T19:50:33.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.049+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e85490 con 0x7f6c5c0176e0 2023-10-05T19:50:33.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e85490 con 0x559fd9e813c0 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e858f0 con 0x559fd9e813c0 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 20 started sync module instance, tier type = 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:33.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.053+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e874e0 con 0x559fd9e7c440 2023-10-05T19:50:33.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.057+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.057+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94145044045232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e879d0 con 0x559fd9e7c440 2023-10-05T19:50:33.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.057+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e88270 con 0x559fd9e4d0d0 2023-10-05T19:50:33.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.057+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94145044045232] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.057+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.057+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94145044051456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e87f80 con 0x559fd9e4d0d0 2023-10-05T19:50:33.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.057+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e88a60 con 0x559fd9e7c440 2023-10-05T19:50:33.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.061+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.061+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94145044055344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e88e70 con 0x559fd9e7c440 2023-10-05T19:50:33.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.061+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94145044051456] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.061+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e87a50 con 0x7f6c5c0176e0 2023-10-05T19:50:33.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.061+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.061+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94145044052560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e89880 con 0x7f6c5c0176e0 2023-10-05T19:50:33.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.061+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94145044055344] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.061+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e89c30 con 0x559fd9e7c440 2023-10-05T19:50:33.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.065+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94145044052560] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.065+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.065+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94145044059024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e89cd0 con 0x559fd9e7c440 2023-10-05T19:50:33.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.065+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e8a570 con 0x559fd9e813c0 2023-10-05T19:50:33.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.065+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.065+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94145044061952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e8ae10 con 0x559fd9e813c0 2023-10-05T19:50:33.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.065+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e8b820 con 0x559fd9e813c0 2023-10-05T19:50:33.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94145044059024] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94145044061952] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94145044067120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e8bc20 con 0x559fd9e813c0 2023-10-05T19:50:33.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e8c4c0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94145044070912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e8cbc0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 20 add_watcher() i=0 2023-10-05T19:50:33.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 20 add_watcher() i=1 2023-10-05T19:50:33.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 20 add_watcher() i=2 2023-10-05T19:50:33.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 20 add_watcher() i=3 2023-10-05T19:50:33.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 20 add_watcher() i=4 2023-10-05T19:50:33.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 20 add_watcher() i=5 2023-10-05T19:50:33.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94145044067120] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c64008ad0 con 0x559fd9e813c0 2023-10-05T19:50:33.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.069+0000 7f6c6dd6be40 20 add_watcher() i=6 2023-10-05T19:50:33.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94145044070912] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6dd6be40 20 add_watcher() i=7 2023-10-05T19:50:33.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6dd6be40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:33.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e897e0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94145044072080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e8d080 con 0x559fd9e4d0d0 2023-10-05T19:50:33.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94145044072080] v30'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6dd6be40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:33.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6dd6be40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:33.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6dd6be40 1 Processor -- start 2023-10-05T19:50:33.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c3d7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.073+0000 7f6c6dd6be40 1 -- start start 2023-10-05T19:50:33.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fd9e9ab30 con 0x559fd9e9a220 2023-10-05T19:50:33.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6b09f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6b09f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46980/0 (socket says 172.21.15.167:46980) 2023-10-05T19:50:33.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6b09f700 1 -- 172.21.15.167:0/1425372443 learned_addr learned my addr 172.21.15.167:0/1425372443 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6b09f700 1 -- 172.21.15.167:0/1425372443 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fd9e9ac70 con 0x559fd9e9a220 2023-10-05T19:50:33.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6b09f700 1 --2- 172.21.15.167:0/1425372443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9a5f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x559fd9e49b70 tx=0x7f6c64012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631420047034fb07 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c3cfe1700 1 -- 172.21.15.167:0/1425372443 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c6402d040 con 0x559fd9e9a220 2023-10-05T19:50:33.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c3cfe1700 1 -- 172.21.15.167:0/1425372443 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c64028890 con 0x559fd9e9a220 2023-10-05T19:50:33.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c3cfe1700 1 -- 172.21.15.167:0/1425372443 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c64012960 con 0x559fd9e9a220 2023-10-05T19:50:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/1425372443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 msgr2=0x559fd9e9a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/1425372443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9a5f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x559fd9e49b70 tx=0x7f6c64012000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/1425372443 shutdown_connections 2023-10-05T19:50:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/1425372443 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9a5f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/1425372443 >> 172.21.15.167:0/1425372443 conn(0x559fd9e955e0 msgr2=0x559fd9e93730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/1425372443 shutdown_connections 2023-10-05T19:50:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/1425372443 wait complete. 2023-10-05T19:50:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 Processor -- start 2023-10-05T19:50:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.077+0000 7f6c6dd6be40 1 -- start start 2023-10-05T19:50:33.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6dd6be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6dd6be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fd9ea0cc0 con 0x559fd9e9a220 2023-10-05T19:50:33.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6b09f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6b09f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46992/0 (socket says 172.21.15.167:46992) 2023-10-05T19:50:33.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6b09f700 1 -- 172.21.15.167:0/3809895135 learned_addr learned my addr 172.21.15.167:0/3809895135 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6b09f700 1 -- 172.21.15.167:0/3809895135 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fd9e49700 con 0x559fd9e9a220 2023-10-05T19:50:33.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6b09f700 1 --2- 172.21.15.167:0/3809895135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9fcc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c64035040 tx=0x7f6c6402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6bb6ffd700 1 -- 172.21.15.167:0/3809895135 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c64009640 con 0x559fd9e9a220 2023-10-05T19:50:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6bb6ffd700 1 -- 172.21.15.167:0/3809895135 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c640097c0 con 0x559fd9e9a220 2023-10-05T19:50:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3809895135 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559fd9ea02c0 con 0x559fd9e9a220 2023-10-05T19:50:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6bb6ffd700 1 -- 172.21.15.167:0/3809895135 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6c64009970 con 0x559fd9e9a220 2023-10-05T19:50:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3809895135 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fd9ea0760 con 0x559fd9e9a220 2023-10-05T19:50:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6bb6ffd700 1 -- 172.21.15.167:0/3809895135 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f6c64009ad0 con 0x559fd9e9a220 2023-10-05T19:50:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6bb6ffd700 1 --2- 172.21.15.167:0/3809895135 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6bac030c50 0x7f6bac033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6bb6ffd700 1 -- 172.21.15.167:0/3809895135 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f6c64046c20 con 0x559fd9e9a220 2023-10-05T19:50:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6c0a1700 1 --2- 172.21.15.167:0/3809895135 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6bac030c50 0x7f6bac033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.081+0000 7f6c6dd6be40 5 note: GC not initialized 2023-10-05T19:50:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6c0a1700 1 --2- 172.21.15.167:0/3809895135 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6bac030c50 0x7f6bac033100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x559fd9e8cb50 tx=0x7f6c5400ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6ba9ffb700 20 reqs_thread_entry: start 2023-10-05T19:50:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6babfff700 20 reqs_thread_entry: start 2023-10-05T19:50:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6b97fff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:03 2023 2023-10-05T19:50:33.093 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6b977fe700 20 reqs_thread_entry: start 2023-10-05T19:50:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 20 get_system_obj_state: rctx=0x7ffe04cba488 obj=default.rgw.meta:users.uid:fud state=0x559fd9d200b0 s->prefetch_data=0 2023-10-05T19:50:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T19:50:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9f08530 con 0x7f6c5c0176e0 2023-10-05T19:50:33.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 fud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-10-05T19:50:33.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:33.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 20 get_system_obj_state: rctx=0x7ffe04cba178 obj=default.rgw.meta:users.email:foo@foo.com state=0x559fd9d200b0 s->prefetch_data=0 2023-10-05T19:50:33.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2023-10-05T19:50:33.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.085+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.3 8:c162d5d1:users.email::foo@foo.com:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9f08530 con 0x559fd9e4d0d0 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 foo@foo.com [getxattrs out=4b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+20 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x6 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : type miss (requested=0x1, cached=0x6) 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.3 8:c162d5d1:users.email::foo@foo.com:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9f08530 con 0x559fd9e4d0d0 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(104 foo@foo.com [read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+7 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=7 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x1 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-10-05T19:50:33.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 20 get_system_obj_state: rctx=0x7ffe04cba178 obj=default.rgw.meta:users.uid:foo state=0x559fd9cf62b0 s->prefetch_data=0 2023-10-05T19:50:33.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:33.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9f09ac0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:50:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9f08350 con 0x559fd9e4d0d0 2023-10-05T19:50:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(106 foo [call,call out=48b,read 0~357 out=357b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+405 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2023-10-05T19:50:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2023-10-05T19:50:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2023-10-05T19:50:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.089+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94145044045232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9ec6920 con 0x559fd9e7c440 2023-10-05T19:50:33.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.093+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94145044045232] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.093+0000 7f6c6dd6be40 20 remove_watcher() i=0 2023-10-05T19:50:33.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.093+0000 7f6c6dd6be40 2 removed watcher, disabling cache 2023-10-05T19:50:33.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.093+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94145044051456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e5e4e0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.093+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94145044051456] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.093+0000 7f6c6dd6be40 20 remove_watcher() i=1 2023-10-05T19:50:33.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.093+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94145044055344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e5e4e0 con 0x559fd9e7c440 2023-10-05T19:50:33.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.097+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94145044055344] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.097+0000 7f6c6dd6be40 20 remove_watcher() i=2 2023-10-05T19:50:33.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.097+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94145044052560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e5e4e0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.097+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94145044052560] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.097+0000 7f6c6dd6be40 20 remove_watcher() i=3 2023-10-05T19:50:33.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.097+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94145044059024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e5e4e0 con 0x559fd9e7c440 2023-10-05T19:50:33.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.101+0000 7f6c6b8a0700 1 -- 172.21.15.167:0/2349459799 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94145044059024] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5c016070 con 0x559fd9e7c440 2023-10-05T19:50:33.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.101+0000 7f6c6dd6be40 20 remove_watcher() i=4 2023-10-05T19:50:33.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.101+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94145044061952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e5e4e0 con 0x559fd9e813c0 2023-10-05T19:50:33.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.101+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94145044061952] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c64039020 con 0x559fd9e813c0 2023-10-05T19:50:33.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.101+0000 7f6c6dd6be40 20 remove_watcher() i=5 2023-10-05T19:50:33.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.101+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94145044067120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e5e4e0 con 0x559fd9e813c0 2023-10-05T19:50:33.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.105+0000 7f6c6b09f700 1 -- 172.21.15.167:0/2349459799 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94145044067120] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c64039020 con 0x559fd9e813c0 2023-10-05T19:50:33.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.105+0000 7f6c6dd6be40 20 remove_watcher() i=6 2023-10-05T19:50:33.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.105+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94145044070912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e5e4e0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.105+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94145044070912] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x7f6c5c0176e0 2023-10-05T19:50:33.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.105+0000 7f6c6dd6be40 20 remove_watcher() i=7 2023-10-05T19:50:33.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c3d7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94145044072080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559fd9e5e4e0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94145044072080] v30'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6c5400a5a0 con 0x559fd9e4d0d0 2023-10-05T19:50:33.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559fd9e7c440 msgr2=0x559fd9e7e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559fd9e7c440 0x559fd9e7e820 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559fd9e4d0d0 msgr2=0x559fd9e7a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559fd9e4d0d0 0x559fd9e7a590 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6c5c0176e0 msgr2=0x7f6c5c0129f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6c5c0176e0 0x7f6c5c0129f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559fd9e813c0 msgr2=0x559fd9e837a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559fd9e813c0 0x559fd9e837a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6c4c030c50 msgr2=0x7f6c4c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6c4c030c50 0x7f6c4c033100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c640030a0 tx=0x7f6c64015000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6c0a1700 1 -- 172.21.15.167:0/2349459799 reap_dead start 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 msgr2=0x559fd9e6e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e6e9a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x559fd9e642a0 tx=0x7f6c5c016000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 shutdown_connections 2023-10-05T19:50:33.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/2349459799 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e48af0 0x559fd9e6e9a0 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x559fd9e642a0 tx=0x7f6c5c016000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.109+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 >> 172.21.15.167:0/2349459799 conn(0x559fd9dbc450 msgr2=0x559fd9e62200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 shutdown_connections 2023-10-05T19:50:33.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/2349459799 wait complete. 2023-10-05T19:50:33.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3809895135 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6bac030c50 msgr2=0x7f6bac033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/3809895135 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6bac030c50 0x7f6bac033100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x559fd9e8cb50 tx=0x7f6c5400ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:33.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3809895135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 msgr2=0x559fd9e9fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/3809895135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9fcc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c64035040 tx=0x7f6c6402c000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3809895135 shutdown_connections 2023-10-05T19:50:33.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/3809895135 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6bac030c50 0x7f6bac033100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 --2- 172.21.15.167:0/3809895135 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559fd9e9a220 0x559fd9e9fcc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3809895135 >> 172.21.15.167:0/3809895135 conn(0x559fd9e955e0 msgr2=0x559fd9e93680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3809895135 shutdown_connections 2023-10-05T19:50:33.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.113+0000 7f6c6dd6be40 1 -- 172.21.15.167:0/3809895135 wait complete. 2023-10-05T19:50:33.124 DEBUG:teuthology.orchestra.run:got remote process result: 240 2023-10-05T19:50:33.125 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T19:50:33.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T19:50:33.125 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T19:50:33.161 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:33.161 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:33.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 Processor -- start 2023-10-05T19:50:33.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 -- start start 2023-10-05T19:50:33.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x565238870ad0 0x565238904a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x565238848bd0 con 0x565238871de0 2023-10-05T19:50:33.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x565238805ee0 con 0x565238870ad0 2023-10-05T19:50:33.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f55a0e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x565238870ad0 0x565238904a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f55a0e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x565238870ad0 0x565238904a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47004/0 (socket says 172.21.15.167:47004) 2023-10-05T19:50:33.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f5620f700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x565238871de0 0x5652388703c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39868/0 (socket says 172.21.15.167:39868) 2023-10-05T19:50:33.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4206199871 learned_addr learned my addr 172.21.15.167:0/4206199871 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4206199871 >> v1:172.21.15.118:6789/0 conn(0x565238871de0 legacy=0x5652388703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4206199871 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565238872270 con 0x565238870ad0 2023-10-05T19:50:33.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f55a0e700 1 --2- 172.21.15.167:0/4206199871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x565238904a70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00a650 tx=0x7f5f4c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4c1c5d4c85d138 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f5520d700 1 -- 172.21.15.167:0/4206199871 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f4c008760 con 0x565238870ad0 2023-10-05T19:50:33.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f5520d700 1 -- 172.21.15.167:0/4206199871 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c0088c0 con 0x565238870ad0 2023-10-05T19:50:33.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f5520d700 1 -- 172.21.15.167:0/4206199871 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f4c008bb0 con 0x565238870ad0 2023-10-05T19:50:33.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 -- 172.21.15.167:0/4206199871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 msgr2=0x565238904a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4206199871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x565238904a70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00a650 tx=0x7f5f4c005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:33.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 -- 172.21.15.167:0/4206199871 shutdown_connections 2023-10-05T19:50:33.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4206199871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x565238904a70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 -- 172.21.15.167:0/4206199871 >> 172.21.15.167:0/4206199871 conn(0x5652388f7360 msgr2=0x5652388f9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 -- 172.21.15.167:0/4206199871 shutdown_connections 2023-10-05T19:50:33.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.157+0000 7f5f586dae40 1 -- 172.21.15.167:0/4206199871 wait complete. 2023-10-05T19:50:33.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 Processor -- start 2023-10-05T19:50:33.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 -- start start 2023-10-05T19:50:33.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x56523891cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652387c9e30 con 0x565238870ad0 2023-10-05T19:50:33.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f5620f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x56523891cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f5620f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x56523891cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47012/0 (socket says 172.21.15.167:47012) 2023-10-05T19:50:33.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f5620f700 1 -- 172.21.15.167:0/927720786 learned_addr learned my addr 172.21.15.167:0/927720786 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f5620f700 1 -- 172.21.15.167:0/927720786 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c005db0 con 0x565238870ad0 2023-10-05T19:50:33.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f5620f700 1 --2- 172.21.15.167:0/927720786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x56523891cbe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5f48001cf0 tx=0x7f5f480018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a01c6e64d72770 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f47fff700 1 -- 172.21.15.167:0/927720786 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f48014070 con 0x565238870ad0 2023-10-05T19:50:33.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f47fff700 1 -- 172.21.15.167:0/927720786 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4800be10 con 0x565238870ad0 2023-10-05T19:50:33.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f47fff700 1 -- 172.21.15.167:0/927720786 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f4800f590 con 0x565238870ad0 2023-10-05T19:50:33.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 -- 172.21.15.167:0/927720786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 msgr2=0x56523891cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 --2- 172.21.15.167:0/927720786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x56523891cbe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5f48001cf0 tx=0x7f5f480018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 -- 172.21.15.167:0/927720786 shutdown_connections 2023-10-05T19:50:33.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 --2- 172.21.15.167:0/927720786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x56523891cbe0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 -- 172.21.15.167:0/927720786 >> 172.21.15.167:0/927720786 conn(0x5652388f7360 msgr2=0x5652389187a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 -- 172.21.15.167:0/927720786 shutdown_connections 2023-10-05T19:50:33.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 -- 172.21.15.167:0/927720786 wait complete. 2023-10-05T19:50:33.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 Processor -- start 2023-10-05T19:50:33.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 -- start start 2023-10-05T19:50:33.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x5652389239b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.161+0000 7f5f586dae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56523879ced0 con 0x565238870ad0 2023-10-05T19:50:33.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f5620f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x5652389239b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f5620f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x5652389239b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47022/0 (socket says 172.21.15.167:47022) 2023-10-05T19:50:33.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 learned_addr learned my addr 172.21.15.167:0/4034966177 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565238848bd0 con 0x565238870ad0 2023-10-05T19:50:33.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f5620f700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x5652389239b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f480018e0 tx=0x7f5f48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f467fc700 1 -- 172.21.15.167:0/4034966177 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f4801c670 con 0x565238870ad0 2023-10-05T19:50:33.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565238923ef0 con 0x565238870ad0 2023-10-05T19:50:33.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f467fc700 1 -- 172.21.15.167:0/4034966177 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4801c7f0 con 0x565238870ad0 2023-10-05T19:50:33.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f467fc700 1 -- 172.21.15.167:0/4034966177 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f4801cae0 con 0x565238870ad0 2023-10-05T19:50:33.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565238924330 con 0x565238870ad0 2023-10-05T19:50:33.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f467fc700 1 -- 172.21.15.167:0/4034966177 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5f48023020 con 0x565238870ad0 2023-10-05T19:50:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f467fc700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5f38030c00 0x7f5f380330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f467fc700 1 -- 172.21.15.167:0/4034966177 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f5f48008030 con 0x565238870ad0 2023-10-05T19:50:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.165+0000 7f5f55a0e700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5f38030c00 0x7f5f380330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565238871de0 0x56523892f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523892fb30 con 0x565238871de0 2023-10-05T19:50:33.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f56a10700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565238871de0 0x56523892f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f55a0e700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5f38030c00 0x7f5f380330b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0030a0 tx=0x7f5f4c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f56a10700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565238871de0 0x56523892f400 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 20 realm 2023-10-05T19:50:33.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523892c9f0 con 0x565238871de0 2023-10-05T19:50:33.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:33.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238930660 con 0x565238871de0 2023-10-05T19:50:33.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x565238930260 0x565238933470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238933b70 con 0x565238930260 2023-10-05T19:50:33.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.169+0000 7f5f5620f700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x565238930260 0x565238933470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f5620f700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x565238930260 0x565238933470 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5f48016070 con 0x565238930260 2023-10-05T19:50:33.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238934440 con 0x565238871de0 2023-10-05T19:50:33.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f586dae40 20 searching for the correct realm 2023-10-05T19:50:33.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x565238933fb0 0x565238938210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238933fb0 2023-10-05T19:50:33.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f55a0e700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x565238933fb0 0x565238938210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f55a0e700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x565238933fb0 0x565238938210 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.173+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238930260 2023-10-05T19:50:33.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f48016070 con 0x565238930260 2023-10-05T19:50:33.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f5620f700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5f4801a070 0x7f5f4800e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x7f5f4801a070 2023-10-05T19:50:33.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5f4801a070 0x7f5f4800e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5f4801a070 0x7f5f4800e5d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238933fb0 2023-10-05T19:50:33.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.177+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238930260 2023-10-05T19:50:33.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f48016070 con 0x565238930260 2023-10-05T19:50:33.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238930260 2023-10-05T19:50:33.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f48016070 con 0x565238930260 2023-10-05T19:50:33.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x7f5f4801a070 2023-10-05T19:50:33.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x7f5f4801a070 2023-10-05T19:50:33.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.181+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238930260 2023-10-05T19:50:33.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f48039040 con 0x565238930260 2023-10-05T19:50:33.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238933fb0 2023-10-05T19:50:33.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238930260 2023-10-05T19:50:33.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f48039040 con 0x565238930260 2023-10-05T19:50:33.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238933fb0 2023-10-05T19:50:33.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.185+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238933fb0 2023-10-05T19:50:33.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x7f5f4801a070 2023-10-05T19:50:33.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238871de0 2023-10-05T19:50:33.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x7f5f4801a070 2023-10-05T19:50:33.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238933fb0 2023-10-05T19:50:33.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.189+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x7f5f4801a070 2023-10-05T19:50:33.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238930260 2023-10-05T19:50:33.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f48039040 con 0x565238930260 2023-10-05T19:50:33.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238930260 2023-10-05T19:50:33.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f48039040 con 0x565238930260 2023-10-05T19:50:33.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238933fb0 2023-10-05T19:50:33.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238930260 2023-10-05T19:50:33.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5f48039040 con 0x565238930260 2023-10-05T19:50:33.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389387f0 con 0x565238930260 2023-10-05T19:50:33.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f48039040 con 0x565238930260 2023-10-05T19:50:33.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f586dae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f586dae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f586dae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.193+0000 7f5f586dae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238934fb0 con 0x565238871de0 2023-10-05T19:50:33.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238935900 con 0x565238930260 2023-10-05T19:50:33.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5f48039040 con 0x565238930260 2023-10-05T19:50:33.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238934b40 con 0x565238930260 2023-10-05T19:50:33.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238939150 con 0x565238933fb0 2023-10-05T19:50:33.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.197+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238939500 con 0x565238871de0 2023-10-05T19:50:33.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389398b0 con 0x565238930260 2023-10-05T19:50:33.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238933fb0 2023-10-05T19:50:33.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238930260 2023-10-05T19:50:33.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x7f5f4801a070 2023-10-05T19:50:33.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.201+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238933fb0 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238930260 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238930260 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.205+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x7f5f4801a070 2023-10-05T19:50:33.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x7f5f4801a070 2023-10-05T19:50:33.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238930260 2023-10-05T19:50:33.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238933fb0 2023-10-05T19:50:33.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.209+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238930260 2023-10-05T19:50:33.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238933fb0 2023-10-05T19:50:33.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.213+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238933fb0 2023-10-05T19:50:33.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x7f5f4801a070 2023-10-05T19:50:33.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238871de0 2023-10-05T19:50:33.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x7f5f4801a070 2023-10-05T19:50:33.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238933fb0 2023-10-05T19:50:33.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x7f5f4801a070 2023-10-05T19:50:33.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.217+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238930260 2023-10-05T19:50:33.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238930260 2023-10-05T19:50:33.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238933fb0 2023-10-05T19:50:33.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238930260 2023-10-05T19:50:33.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ac70 con 0x565238930260 2023-10-05T19:50:33.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5f4804b040 con 0x565238930260 2023-10-05T19:50:33.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f586dae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f586dae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f586dae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f586dae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.221+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238939c60 con 0x565238930260 2023-10-05T19:50:33.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893a010 con 0x565238871de0 2023-10-05T19:50:33.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893a440 con 0x565238930260 2023-10-05T19:50:33.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893a8b0 con 0x565238930260 2023-10-05T19:50:33.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893b020 con 0x7f5f4801a070 2023-10-05T19:50:33.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 zone default found 2023-10-05T19:50:33.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 4 Realm: () 2023-10-05T19:50:33.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:33.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:33.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:33.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 zonegroup default 2023-10-05T19:50:33.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.225+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893b020 con 0x7f5f4801a070 2023-10-05T19:50:33.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893c9a0 con 0x565238933fb0 2023-10-05T19:50:33.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893cd50 con 0x565238933fb0 2023-10-05T19:50:33.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 20 started sync module instance, tier type = 2023-10-05T19:50:33.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:33.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.229+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893c060 con 0x565238930260 2023-10-05T19:50:33.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.233+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.233+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94911136500784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893d100 con 0x565238930260 2023-10-05T19:50:33.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.233+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893d9a0 con 0x565238871de0 2023-10-05T19:50:33.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.233+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.233+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94911136500784] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.233+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94911136515168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893d5f0 con 0x565238871de0 2023-10-05T19:50:33.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.233+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893e040 con 0x565238930260 2023-10-05T19:50:33.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.237+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94911136515168] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.237+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.237+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94911136520976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893d5f0 con 0x565238930260 2023-10-05T19:50:33.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.237+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893e930 con 0x7f5f4801a070 2023-10-05T19:50:33.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.237+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.237+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94911136523328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ed80 con 0x7f5f4801a070 2023-10-05T19:50:33.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.237+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893f790 con 0x565238930260 2023-10-05T19:50:33.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.237+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94911136520976] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.241+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94911136523328] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.241+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.241+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94911136524432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893ece0 con 0x565238930260 2023-10-05T19:50:33.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.241+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523893fc80 con 0x565238933fb0 2023-10-05T19:50:33.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.241+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.241+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94911136528272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238940520 con 0x565238933fb0 2023-10-05T19:50:33.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.241+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238940f30 con 0x565238933fb0 2023-10-05T19:50:33.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.241+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94911136524432] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94911136528272] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94911136533056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389412e0 con 0x565238933fb0 2023-10-05T19:50:33.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238941b80 con 0x7f5f4801a070 2023-10-05T19:50:33.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94911136533056] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f4c012450 con 0x565238933fb0 2023-10-05T19:50:33.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94911136536768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238942200 con 0x7f5f4801a070 2023-10-05T19:50:33.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 20 add_watcher() i=0 2023-10-05T19:50:33.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 20 add_watcher() i=1 2023-10-05T19:50:33.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 20 add_watcher() i=2 2023-10-05T19:50:33.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 20 add_watcher() i=3 2023-10-05T19:50:33.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 20 add_watcher() i=4 2023-10-05T19:50:33.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 20 add_watcher() i=5 2023-10-05T19:50:33.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.245+0000 7f5f586dae40 20 add_watcher() i=6 2023-10-05T19:50:33.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94911136536768] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x7f5f4801a070 2023-10-05T19:50:33.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 20 add_watcher() i=7 2023-10-05T19:50:33.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:33.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238942200 con 0x565238871de0 2023-10-05T19:50:33.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94911136537872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565238942160 con 0x565238871de0 2023-10-05T19:50:33.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94911136537872] v30'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5f5000a5a0 con 0x565238871de0 2023-10-05T19:50:33.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f27fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:33.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:33.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 1 Processor -- start 2023-10-05T19:50:33.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 1 -- start start 2023-10-05T19:50:33.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x56523894f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f586dae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56523894fea0 con 0x56523894f590 2023-10-05T19:50:33.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.249+0000 7f5f55a0e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x56523894f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f55a0e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x56523894f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47028/0 (socket says 172.21.15.167:47028) 2023-10-05T19:50:33.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f55a0e700 1 -- 172.21.15.167:0/3538099610 learned_addr learned my addr 172.21.15.167:0/3538099610 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f55a0e700 1 -- 172.21.15.167:0/3538099610 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56523894ffe0 con 0x56523894f590 2023-10-05T19:50:33.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f55a0e700 1 --2- 172.21.15.167:0/3538099610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x56523894f960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c002000 tx=0x7f5f4c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a71dc8748fac62 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f277de700 1 -- 172.21.15.167:0/3538099610 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f4c02d040 con 0x56523894f590 2023-10-05T19:50:33.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f277de700 1 -- 172.21.15.167:0/3538099610 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c028890 con 0x56523894f590 2023-10-05T19:50:33.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f277de700 1 -- 172.21.15.167:0/3538099610 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f4c028a40 con 0x56523894f590 2023-10-05T19:50:33.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 -- 172.21.15.167:0/3538099610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 msgr2=0x56523894f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 --2- 172.21.15.167:0/3538099610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x56523894f960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c002000 tx=0x7f5f4c012000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 -- 172.21.15.167:0/3538099610 shutdown_connections 2023-10-05T19:50:33.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 --2- 172.21.15.167:0/3538099610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x56523894f960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 -- 172.21.15.167:0/3538099610 >> 172.21.15.167:0/3538099610 conn(0x56523894a950 msgr2=0x565238948b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 -- 172.21.15.167:0/3538099610 shutdown_connections 2023-10-05T19:50:33.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 -- 172.21.15.167:0/3538099610 wait complete. 2023-10-05T19:50:33.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 Processor -- start 2023-10-05T19:50:33.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 -- start start 2023-10-05T19:50:33.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x565238955000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f586dae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x565238956000 con 0x56523894f590 2023-10-05T19:50:33.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f55a0e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x565238955000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f55a0e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x565238955000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47036/0 (socket says 172.21.15.167:47036) 2023-10-05T19:50:33.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.253+0000 7f5f55a0e700 1 -- 172.21.15.167:0/988943853 learned_addr learned my addr 172.21.15.167:0/988943853 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f55a0e700 1 -- 172.21.15.167:0/988943853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565238872270 con 0x56523894f590 2023-10-05T19:50:33.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f55a0e700 1 --2- 172.21.15.167:0/988943853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x565238955000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x565238949670 tx=0x7f5f4c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f25fdb700 1 -- 172.21.15.167:0/988943853 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f4c009640 con 0x56523894f590 2023-10-05T19:50:33.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f25fdb700 1 -- 172.21.15.167:0/988943853 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c0097c0 con 0x56523894f590 2023-10-05T19:50:33.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f586dae40 1 -- 172.21.15.167:0/988943853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565238955600 con 0x56523894f590 2023-10-05T19:50:33.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f25fdb700 1 -- 172.21.15.167:0/988943853 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f4c009970 con 0x56523894f590 2023-10-05T19:50:33.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f586dae40 1 -- 172.21.15.167:0/988943853 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565238955aa0 con 0x56523894f590 2023-10-05T19:50:33.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f25fdb700 1 -- 172.21.15.167:0/988943853 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5f4c009ad0 con 0x56523894f590 2023-10-05T19:50:33.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f25fdb700 1 --2- 172.21.15.167:0/988943853 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5e9c030c50 0x7f5e9c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f25fdb700 1 -- 172.21.15.167:0/988943853 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f5f4c046c20 con 0x56523894f590 2023-10-05T19:50:33.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f56a10700 1 --2- 172.21.15.167:0/988943853 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5e9c030c50 0x7f5e9c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f586dae40 5 note: GC not initialized 2023-10-05T19:50:33.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.257+0000 7f5f56a10700 1 --2- 172.21.15.167:0/988943853 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5e9c030c50 0x7f5e9c033100 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x56523893f640 tx=0x7f5f5000ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5e96ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:33.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5e94ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:33.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5f586dae40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:33.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5f586dae40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:33.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5e86ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:03 2023 2023-10-05T19:50:33.269 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:33.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5e867fc700 20 reqs_thread_entry: start 2023-10-05T19:50:33.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5f586dae40 20 get_system_obj_state: rctx=0x7ffe3d586788 obj=default.rgw.meta:users.uid:foo state=0x5652387d50b0 s->prefetch_data=0 2023-10-05T19:50:33.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389bd7d0 con 0x565238871de0 2023-10-05T19:50:33.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f5f5003d050 con 0x565238871de0 2023-10-05T19:50:33.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5f586dae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:33.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5f586dae40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:33.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5f586dae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.261+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389bd7c0 con 0x565238871de0 2023-10-05T19:50:33.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.265+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f5f5003d050 con 0x565238871de0 2023-10-05T19:50:33.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.265+0000 7f5f586dae40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:33.271 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:33.271 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:33.271 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:33.271 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:33.271 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:33.271 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:33.271 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:33.272 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:33.273 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:33.274 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:33.274 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:33.274 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:33.274 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:33.274 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:33.274 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:33.274 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:33.274 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:33.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.265+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94911136500784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389134c0 con 0x565238930260 2023-10-05T19:50:33.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.265+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94911136500784] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.265+0000 7f5f586dae40 20 remove_watcher() i=0 2023-10-05T19:50:33.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.265+0000 7f5f586dae40 2 removed watcher, disabling cache 2023-10-05T19:50:33.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.265+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94911136515168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389134c0 con 0x565238871de0 2023-10-05T19:50:33.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.269+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94911136515168] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f5003d050 con 0x565238871de0 2023-10-05T19:50:33.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.269+0000 7f5f586dae40 20 remove_watcher() i=1 2023-10-05T19:50:33.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.269+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94911136520976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389134c0 con 0x565238930260 2023-10-05T19:50:33.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.269+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94911136520976] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.269+0000 7f5f586dae40 20 remove_watcher() i=2 2023-10-05T19:50:33.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.269+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94911136523328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389134c0 con 0x7f5f4801a070 2023-10-05T19:50:33.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.273+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94911136523328] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f5003d050 con 0x7f5f4801a070 2023-10-05T19:50:33.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.273+0000 7f5f586dae40 20 remove_watcher() i=3 2023-10-05T19:50:33.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.273+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94911136524432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389134c0 con 0x565238930260 2023-10-05T19:50:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.273+0000 7f5f5620f700 1 -- 172.21.15.167:0/4034966177 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94911136524432] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f48054040 con 0x565238930260 2023-10-05T19:50:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.273+0000 7f5f586dae40 20 remove_watcher() i=4 2023-10-05T19:50:33.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.273+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94911136528272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389134c0 con 0x565238933fb0 2023-10-05T19:50:33.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.277+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94911136528272] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f4c039020 con 0x565238933fb0 2023-10-05T19:50:33.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.277+0000 7f5f586dae40 20 remove_watcher() i=5 2023-10-05T19:50:33.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.277+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94911136533056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389134c0 con 0x565238933fb0 2023-10-05T19:50:33.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.277+0000 7f5f55a0e700 1 -- 172.21.15.167:0/4034966177 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94911136533056] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f4c039020 con 0x565238933fb0 2023-10-05T19:50:33.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.277+0000 7f5f586dae40 20 remove_watcher() i=6 2023-10-05T19:50:33.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.277+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94911136536768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652389134c0 con 0x7f5f4801a070 2023-10-05T19:50:33.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.281+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94911136536768] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5f5003d050 con 0x7f5f4801a070 2023-10-05T19:50:33.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.281+0000 7f5f586dae40 20 remove_watcher() i=7 2023-10-05T19:50:33.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.281+0000 7f5f27fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.281+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94911136537872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56523897cb70 con 0x565238871de0 2023-10-05T19:50:33.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94911136537872] v30'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5f5003d050 con 0x565238871de0 2023-10-05T19:50:33.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x565238930260 msgr2=0x565238933470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x565238930260 0x565238933470 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565238871de0 msgr2=0x56523892f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565238871de0 0x56523892f400 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5f4801a070 msgr2=0x7f5f4800e5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5f4801a070 0x7f5f4800e5d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x565238933fb0 msgr2=0x565238938210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x565238933fb0 0x565238938210 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5f38030c00 msgr2=0x7f5f380330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5f38030c00 0x7f5f380330b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0030a0 tx=0x7f5f4c015000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f56a10700 1 -- 172.21.15.167:0/4034966177 reap_dead start 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 msgr2=0x5652389239b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x5652389239b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f480018e0 tx=0x7f5f48016000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 shutdown_connections 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/4034966177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565238870ad0 0x5652389239b0 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5f480018e0 tx=0x7f5f48016000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 >> 172.21.15.167:0/4034966177 conn(0x5652388f7360 msgr2=0x565238917220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 shutdown_connections 2023-10-05T19:50:33.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/4034966177 wait complete. 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/988943853 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5e9c030c50 msgr2=0x7f5e9c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/988943853 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5e9c030c50 0x7f5e9c033100 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x56523893f640 tx=0x7f5f5000ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/988943853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 msgr2=0x565238955000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/988943853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x565238955000 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x565238949670 tx=0x7f5f4c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/988943853 shutdown_connections 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/988943853 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5e9c030c50 0x7f5e9c033100 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 --2- 172.21.15.167:0/988943853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56523894f590 0x565238955000 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/988943853 >> 172.21.15.167:0/988943853 conn(0x56523894a950 msgr2=0x565238948a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/988943853 shutdown_connections 2023-10-05T19:50:33.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.285+0000 7f5f586dae40 1 -- 172.21.15.167:0/988943853 wait complete. 2023-10-05T19:50:33.297 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:33.297 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2023-10-05T19:50:33.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2023-10-05T19:50:33.298 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2023-10-05T19:50:33.333 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:33.334 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 Processor -- start 2023-10-05T19:50:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 -- start start 2023-10-05T19:50:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5649bf8c8570 0x5649bf8c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5649bf89fbd0 con 0x5649bf8c7090 2023-10-05T19:50:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5649bf85cee0 con 0x5649bf8c8570 2023-10-05T19:50:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9764c29700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5649bf8c8570 0x5649bf8c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9764428700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x5649bf8c7090 0x5649bf95aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39870/0 (socket says 172.21.15.167:39870) 2023-10-05T19:50:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9764428700 1 -- 172.21.15.167:0/731394965 learned_addr learned my addr 172.21.15.167:0/731394965 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:33.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9763c27700 1 -- 172.21.15.167:0/731394965 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532143634 0 0) 0x5649bf89fbd0 con 0x5649bf8c7090 2023-10-05T19:50:33.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9763c27700 1 -- 172.21.15.167:0/731394965 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9750001e10 con 0x5649bf8c7090 2023-10-05T19:50:33.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9764c29700 1 -- 172.21.15.167:0/731394965 >> v1:172.21.15.118:6789/0 conn(0x5649bf8c7090 legacy=0x5649bf95aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9764c29700 1 -- 172.21.15.167:0/731394965 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649bf8c8a00 con 0x5649bf8c8570 2023-10-05T19:50:33.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9764c29700 1 --2- 172.21.15.167:0/731394965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c8570 0x5649bf8c6b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f975400a5d0 tx=0x7f9754005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60afad4bd8b4f16 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9763c27700 1 -- 172.21.15.167:0/731394965 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9754007610 con 0x5649bf8c8570 2023-10-05T19:50:33.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9763c27700 1 -- 172.21.15.167:0/731394965 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754007770 con 0x5649bf8c8570 2023-10-05T19:50:33.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f9763c27700 1 -- 172.21.15.167:0/731394965 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9754007a40 con 0x5649bf8c8570 2023-10-05T19:50:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 -- 172.21.15.167:0/731394965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c8570 msgr2=0x5649bf8c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 --2- 172.21.15.167:0/731394965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c8570 0x5649bf8c6b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f975400a5d0 tx=0x7f9754005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 -- 172.21.15.167:0/731394965 shutdown_connections 2023-10-05T19:50:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 --2- 172.21.15.167:0/731394965 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c8570 0x5649bf8c6b50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 -- 172.21.15.167:0/731394965 >> 172.21.15.167:0/731394965 conn(0x5649bf94e340 msgr2=0x5649bf950750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 -- 172.21.15.167:0/731394965 shutdown_connections 2023-10-05T19:50:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.329+0000 7f97670f4e40 1 -- 172.21.15.167:0/731394965 wait complete. 2023-10-05T19:50:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 Processor -- start 2023-10-05T19:50:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 -- start start 2023-10-05T19:50:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf9739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649bf820e30 con 0x5649bf8c7090 2023-10-05T19:50:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f9764c29700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf9739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f9764c29700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf9739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47060/0 (socket says 172.21.15.167:47060) 2023-10-05T19:50:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f9764c29700 1 -- 172.21.15.167:0/2963961562 learned_addr learned my addr 172.21.15.167:0/2963961562 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f9764c29700 1 -- 172.21.15.167:0/2963961562 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9754005cf0 con 0x5649bf8c7090 2023-10-05T19:50:33.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f9764c29700 1 --2- 172.21.15.167:0/2963961562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf9739d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f975400a520 tx=0x7f9754014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f309f9e45be9dbd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f9762c25700 1 -- 172.21.15.167:0/2963961562 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9754007960 con 0x5649bf8c7090 2023-10-05T19:50:33.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f9762c25700 1 -- 172.21.15.167:0/2963961562 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754007ae0 con 0x5649bf8c7090 2023-10-05T19:50:33.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f9762c25700 1 -- 172.21.15.167:0/2963961562 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9754007c90 con 0x5649bf8c7090 2023-10-05T19:50:33.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 -- 172.21.15.167:0/2963961562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 msgr2=0x5649bf9739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 --2- 172.21.15.167:0/2963961562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf9739d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f975400a520 tx=0x7f9754014000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 -- 172.21.15.167:0/2963961562 shutdown_connections 2023-10-05T19:50:33.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 --2- 172.21.15.167:0/2963961562 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf9739d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 -- 172.21.15.167:0/2963961562 >> 172.21.15.167:0/2963961562 conn(0x5649bf94e340 msgr2=0x5649bf96f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 -- 172.21.15.167:0/2963961562 shutdown_connections 2023-10-05T19:50:33.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 -- 172.21.15.167:0/2963961562 wait complete. 2023-10-05T19:50:33.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.333+0000 7f97670f4e40 1 Processor -- start 2023-10-05T19:50:33.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f97670f4e40 1 -- start start 2023-10-05T19:50:33.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f97670f4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf97a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f97670f4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649bf7f3ed0 con 0x5649bf8c7090 2023-10-05T19:50:33.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f9764c29700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf97a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f9764c29700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf97a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47072/0 (socket says 172.21.15.167:47072) 2023-10-05T19:50:33.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 learned_addr learned my addr 172.21.15.167:0/1554470219 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649bf8c8a00 con 0x5649bf8c7090 2023-10-05T19:50:33.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f9764c29700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf97a630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f975401f040 tx=0x7f975401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f9761422700 1 -- 172.21.15.167:0/1554470219 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9754007e40 con 0x5649bf8c7090 2023-10-05T19:50:33.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f9761422700 1 -- 172.21.15.167:0/1554470219 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97540078e0 con 0x5649bf8c7090 2023-10-05T19:50:33.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5649bf97ab70 con 0x5649bf8c7090 2023-10-05T19:50:33.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f9761422700 1 -- 172.21.15.167:0/1554470219 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9754012610 con 0x5649bf8c7090 2023-10-05T19:50:33.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649bf97afb0 con 0x5649bf8c7090 2023-10-05T19:50:33.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.337+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f9761422700 1 -- 172.21.15.167:0/1554470219 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f975402b070 con 0x5649bf8c7090 2023-10-05T19:50:33.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f9761422700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9744030c50 0x7f9744033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f9761422700 1 -- 172.21.15.167:0/1554470219 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f9754045a00 con 0x5649bf8c7090 2023-10-05T19:50:33.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f9764428700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9744030c50 0x7f9744033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5649bf8c8570 0x5649bf986090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf986790 con 0x5649bf8c8570 2023-10-05T19:50:33.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f976542a700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5649bf8c8570 0x5649bf986090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f9764428700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9744030c50 0x7f9744033100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f975c0044f0 tx=0x7f975c006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f976542a700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5649bf8c8570 0x5649bf986090 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f974c00a500 con 0x5649bf8c8570 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 20 realm 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9836f0 con 0x5649bf8c8570 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f974c00a500 con 0x5649bf8c8570 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf987270 con 0x5649bf8c8570 2023-10-05T19:50:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f974c00a500 con 0x5649bf8c8570 2023-10-05T19:50:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5649bf9880a0 0x5649bf98a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98a9c0 con 0x5649bf9880a0 2023-10-05T19:50:33.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.341+0000 7f9764c29700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5649bf9880a0 0x5649bf98a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f9764c29700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5649bf9880a0 0x5649bf98a480 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98ae70 con 0x5649bf8c8570 2023-10-05T19:50:33.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f974c00a500 con 0x5649bf8c8570 2023-10-05T19:50:33.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f97670f4e40 20 searching for the correct realm 2023-10-05T19:50:33.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5649bf98cdb0 0x5649bf98f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf98cdb0 2023-10-05T19:50:33.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f9764428700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5649bf98cdb0 0x5649bf98f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f9764428700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5649bf98cdb0 0x5649bf98f1c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c004520 con 0x5649bf98cdb0 2023-10-05T19:50:33.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf9880a0 2023-10-05T19:50:33.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f9764c29700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9754007030 0x7f97540117f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x7f9754007030 2023-10-05T19:50:33.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.345+0000 7f976542a700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9754007030 0x7f97540117f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f976542a700 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9754007030 0x7f97540117f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x7f9754007030 2023-10-05T19:50:33.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf98cdb0 2023-10-05T19:50:33.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c004520 con 0x5649bf98cdb0 2023-10-05T19:50:33.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf9880a0 2023-10-05T19:50:33.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf9880a0 2023-10-05T19:50:33.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.349+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x7f9754007030 2023-10-05T19:50:33.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x7f9754007030 2023-10-05T19:50:33.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x7f9754007030 2023-10-05T19:50:33.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x7f9754007030 2023-10-05T19:50:33.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf9880a0 2023-10-05T19:50:33.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf98cdb0 2023-10-05T19:50:33.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c004520 con 0x5649bf98cdb0 2023-10-05T19:50:33.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.353+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf9880a0 2023-10-05T19:50:33.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf98cdb0 2023-10-05T19:50:33.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf98cdb0 2023-10-05T19:50:33.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x7f9754007030 2023-10-05T19:50:33.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x7f9754007030 2023-10-05T19:50:33.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf8c8570 2023-10-05T19:50:33.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.357+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x7f9754007030 2023-10-05T19:50:33.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x7f9754007030 2023-10-05T19:50:33.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf98cdb0 2023-10-05T19:50:33.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x7f9754007030 2023-10-05T19:50:33.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x7f9754007030 2023-10-05T19:50:33.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf9880a0 2023-10-05T19:50:33.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf9880a0 2023-10-05T19:50:33.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf98cdb0 2023-10-05T19:50:33.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.361+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf9880a0 2023-10-05T19:50:33.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98f7d0 con 0x5649bf9880a0 2023-10-05T19:50:33.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98bb60 con 0x5649bf8c8570 2023-10-05T19:50:33.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98c4b0 con 0x5649bf9880a0 2023-10-05T19:50:33.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98fc40 con 0x5649bf9880a0 2023-10-05T19:50:33.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.365+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98fff0 con 0x5649bf98cdb0 2023-10-05T19:50:33.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf98c080 con 0x5649bf9880a0 2023-10-05T19:50:33.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf991cd0 con 0x5649bf98cdb0 2023-10-05T19:50:33.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf991cd0 con 0x5649bf9880a0 2023-10-05T19:50:33.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf991cd0 con 0x7f9754007030 2023-10-05T19:50:33.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x7f9754007030 2023-10-05T19:50:33.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.369+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf98cdb0 2023-10-05T19:50:33.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf9880a0 2023-10-05T19:50:33.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf9880a0 2023-10-05T19:50:33.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.373+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x7f9754007030 2023-10-05T19:50:33.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x7f9754007030 2023-10-05T19:50:33.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x7f9754007030 2023-10-05T19:50:33.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x7f9754007030 2023-10-05T19:50:33.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf9880a0 2023-10-05T19:50:33.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf98cdb0 2023-10-05T19:50:33.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.377+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf9880a0 2023-10-05T19:50:33.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf98cdb0 2023-10-05T19:50:33.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c014040 con 0x5649bf8c8570 2023-10-05T19:50:33.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf98cdb0 2023-10-05T19:50:33.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.381+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x7f9754007030 2023-10-05T19:50:33.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf8c8570 2023-10-05T19:50:33.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x7f9754007030 2023-10-05T19:50:33.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf98cdb0 2023-10-05T19:50:33.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x7f9754007030 2023-10-05T19:50:33.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf9880a0 2023-10-05T19:50:33.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.385+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf9880a0 2023-10-05T19:50:33.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf98cdb0 2023-10-05T19:50:33.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf9880a0 2023-10-05T19:50:33.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9903a0 con 0x5649bf9880a0 2023-10-05T19:50:33.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f97670f4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f97670f4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f97670f4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f97670f4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf990cc0 con 0x5649bf9880a0 2023-10-05T19:50:33.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.389+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf991070 con 0x5649bf8c8570 2023-10-05T19:50:33.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf991910 con 0x5649bf9880a0 2023-10-05T19:50:33.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf991910 con 0x5649bf9880a0 2023-10-05T19:50:33.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf991910 con 0x7f9754007030 2023-10-05T19:50:33.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 zone default found 2023-10-05T19:50:33.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 4 Realm: () 2023-10-05T19:50:33.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:33.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:33.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 zonegroup default 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf991910 con 0x7f9754007030 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.393+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf993290 con 0x5649bf98cdb0 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf993640 con 0x5649bf98cdb0 2023-10-05T19:50:33.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 20 started sync module instance, tier type = 2023-10-05T19:50:33.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:33.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf992950 con 0x5649bf9880a0 2023-10-05T19:50:33.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94874747085920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf992e70 con 0x5649bf9880a0 2023-10-05T19:50:33.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.397+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9943d0 con 0x5649bf8c8570 2023-10-05T19:50:33.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.401+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94874747085920] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.401+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.401+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94874747091440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf992e70 con 0x5649bf8c8570 2023-10-05T19:50:33.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.401+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf994990 con 0x5649bf9880a0 2023-10-05T19:50:33.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.405+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94874747091440] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.405+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.405+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94874747092544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf994990 con 0x5649bf9880a0 2023-10-05T19:50:33.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.405+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf995280 con 0x7f9754007030 2023-10-05T19:50:33.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.405+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.405+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94874747096464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9956d0 con 0x7f9754007030 2023-10-05T19:50:33.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.405+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9960e0 con 0x5649bf9880a0 2023-10-05T19:50:33.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.405+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94874747092544] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.405+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94874747096464] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.409+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.409+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94874747097568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf995630 con 0x5649bf9880a0 2023-10-05T19:50:33.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.409+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9965d0 con 0x5649bf98cdb0 2023-10-05T19:50:33.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.409+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.409+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94874747101408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf996e70 con 0x5649bf98cdb0 2023-10-05T19:50:33.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.409+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf997710 con 0x5649bf98cdb0 2023-10-05T19:50:33.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.409+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94874747097568] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.409+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94874747101408] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94874747105824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf997b10 con 0x5649bf98cdb0 2023-10-05T19:50:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9983b0 con 0x7f9754007030 2023-10-05T19:50:33.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94874747105824] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94874747109328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf998a60 con 0x7f9754007030 2023-10-05T19:50:33.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 20 add_watcher() i=0 2023-10-05T19:50:33.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 20 add_watcher() i=1 2023-10-05T19:50:33.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 20 add_watcher() i=2 2023-10-05T19:50:33.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 20 add_watcher() i=3 2023-10-05T19:50:33.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 20 add_watcher() i=4 2023-10-05T19:50:33.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 20 add_watcher() i=5 2023-10-05T19:50:33.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 20 add_watcher() i=6 2023-10-05T19:50:33.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94874747109328] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 20 add_watcher() i=7 2023-10-05T19:50:33.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:33.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf995cb0 con 0x5649bf8c8570 2023-10-05T19:50:33.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.413+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94874747110704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf995cb0 con 0x5649bf8c8570 2023-10-05T19:50:33.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94874747110704] v30'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f97367e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f97670f4e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:33.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f97670f4e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:33.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f97670f4e40 1 Processor -- start 2023-10-05T19:50:33.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f97670f4e40 1 -- start start 2023-10-05T19:50:33.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f97670f4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9a6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f97670f4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649bf9a6960 con 0x5649bf9a6050 2023-10-05T19:50:33.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f9764428700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f9764428700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9a6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47074/0 (socket says 172.21.15.167:47074) 2023-10-05T19:50:33.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f9764428700 1 -- 172.21.15.167:0/2344202499 learned_addr learned my addr 172.21.15.167:0/2344202499 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f9764428700 1 -- 172.21.15.167:0/2344202499 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649bf9a6aa0 con 0x5649bf9a6050 2023-10-05T19:50:33.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.417+0000 7f9764428700 1 --2- 172.21.15.167:0/2344202499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9a6420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5649bf986e10 tx=0x7f975c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3a8b92145a167f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f9735fe3700 1 -- 172.21.15.167:0/2344202499 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f975c01a040 con 0x5649bf9a6050 2023-10-05T19:50:33.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f9735fe3700 1 -- 172.21.15.167:0/2344202499 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c01b040 con 0x5649bf9a6050 2023-10-05T19:50:33.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f9735fe3700 1 -- 172.21.15.167:0/2344202499 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f975c0049f0 con 0x5649bf9a6050 2023-10-05T19:50:33.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 -- 172.21.15.167:0/2344202499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 msgr2=0x5649bf9a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 --2- 172.21.15.167:0/2344202499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9a6420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5649bf986e10 tx=0x7f975c006000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 -- 172.21.15.167:0/2344202499 shutdown_connections 2023-10-05T19:50:33.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 --2- 172.21.15.167:0/2344202499 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9a6420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 -- 172.21.15.167:0/2344202499 >> 172.21.15.167:0/2344202499 conn(0x5649bf9a1410 msgr2=0x5649bf99f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 -- 172.21.15.167:0/2344202499 shutdown_connections 2023-10-05T19:50:33.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 -- 172.21.15.167:0/2344202499 wait complete. 2023-10-05T19:50:33.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 Processor -- start 2023-10-05T19:50:33.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 -- start start 2023-10-05T19:50:33.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f97670f4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649bf9acba0 con 0x5649bf9a6050 2023-10-05T19:50:33.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f9764428700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f9764428700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9abba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47078/0 (socket says 172.21.15.167:47078) 2023-10-05T19:50:33.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f9764428700 1 -- 172.21.15.167:0/2701662861 learned_addr learned my addr 172.21.15.167:0/2701662861 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f9764428700 1 -- 172.21.15.167:0/2701662861 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750001e10 con 0x5649bf9a6050 2023-10-05T19:50:33.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.421+0000 7f9764428700 1 --2- 172.21.15.167:0/2701662861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9abba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f975c03a040 tx=0x7f975c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f96a7fff700 1 -- 172.21.15.167:0/2701662861 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f975c01a070 con 0x5649bf9a6050 2023-10-05T19:50:33.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f96a7fff700 1 -- 172.21.15.167:0/2701662861 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c004260 con 0x5649bf9a6050 2023-10-05T19:50:33.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f97670f4e40 1 -- 172.21.15.167:0/2701662861 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5649bf9ac1a0 con 0x5649bf9a6050 2023-10-05T19:50:33.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f96a7fff700 1 -- 172.21.15.167:0/2701662861 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f975c02c980 con 0x5649bf9a6050 2023-10-05T19:50:33.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f97670f4e40 1 -- 172.21.15.167:0/2701662861 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649bf9ac5e0 con 0x5649bf9a6050 2023-10-05T19:50:33.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f96a7fff700 1 -- 172.21.15.167:0/2701662861 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f975c02cae0 con 0x5649bf9a6050 2023-10-05T19:50:33.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f96a7fff700 1 --2- 172.21.15.167:0/2701662861 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96ac030c50 0x7f96ac033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f96a7fff700 1 -- 172.21.15.167:0/2701662861 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f975c027040 con 0x5649bf9a6050 2023-10-05T19:50:33.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f976542a700 1 --2- 172.21.15.167:0/2701662861 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96ac030c50 0x7f96ac033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f97670f4e40 5 note: GC not initialized 2023-10-05T19:50:33.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.425+0000 7f976542a700 1 --2- 172.21.15.167:0/2701662861 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96ac030c50 0x7f96ac033100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5649bf9989b0 tx=0x7f974c00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f96a57fa700 20 reqs_thread_entry: start 2023-10-05T19:50:33.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f969effd700 20 reqs_thread_entry: start 2023-10-05T19:50:33.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:33.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:33.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f969d7fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:03 2023 2023-10-05T19:50:33.436 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:33.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f969cff9700 20 reqs_thread_entry: start 2023-10-05T19:50:33.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 20 get_system_obj_state: rctx=0x7ffdf13bf9d8 obj=default.rgw.meta:users.uid:foo state=0x5649bf82c0b0 s->prefetch_data=0 2023-10-05T19:50:33.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:33.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bfa14510 con 0x5649bf8c8570 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bfa16fa0 con 0x5649bf8c8570 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:33.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:33.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:33.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bfa16fa0 con 0x7f9754007030 2023-10-05T19:50:33.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.429+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bfa18220 con 0x5649bf8c8570 2023-10-05T19:50:33.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~357] v30'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f97670f4e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:33.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f97670f4e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f97670f4e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:33.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94874747632944 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bfa16fa0 con 0x5649bf9880a0 2023-10-05T19:50:33.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94874747097568 notify 128849018881 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x5649bf97afb0 con 0x5649bf9880a0 2023-10-05T19:50:33.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f9762c25700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94874747097568 notifier 4301 bl.length()=533 2023-10-05T19:50:33.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.4 [notify cookie 94874747632944 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f9762c25700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:33.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f9762c25700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f9762c25700 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9748003d90 con 0x5649bf9880a0 2023-10-05T19:50:33.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== watch-notify(notify_complete (2) cookie 94874747632944 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5649bf97ab70 con 0x5649bf9880a0 2023-10-05T19:50:33.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.433+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.442 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:33.442 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:33.442 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:33.442 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:33.442 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 1, 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:33.443 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:33.444 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:33.445 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:33.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.437+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94874747085920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf96a2b0 con 0x5649bf9880a0 2023-10-05T19:50:33.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.437+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(108 notify.0 [watch unwatch cookie 94874747085920] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.437+0000 7f97670f4e40 20 remove_watcher() i=0 2023-10-05T19:50:33.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.437+0000 7f97670f4e40 2 removed watcher, disabling cache 2023-10-05T19:50:33.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.437+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94874747091440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf992460 con 0x5649bf8c8570 2023-10-05T19:50:33.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.441+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(109 notify.1 [watch unwatch cookie 94874747091440] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.441+0000 7f97670f4e40 20 remove_watcher() i=1 2023-10-05T19:50:33.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.441+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94874747092544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf9939f0 con 0x5649bf9880a0 2023-10-05T19:50:33.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.441+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(110 notify.2 [watch unwatch cookie 94874747092544] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.441+0000 7f97670f4e40 20 remove_watcher() i=2 2023-10-05T19:50:33.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.441+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94874747096464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf993ee0 con 0x7f9754007030 2023-10-05T19:50:33.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.445+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.3 [watch unwatch cookie 94874747096464] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.445+0000 7f97670f4e40 20 remove_watcher() i=3 2023-10-05T19:50:33.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.445+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94874747097568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf993ee0 con 0x5649bf9880a0 2023-10-05T19:50:33.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.445+0000 7f9764c29700 1 -- 172.21.15.167:0/1554470219 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(112 notify.4 [watch unwatch cookie 94874747097568] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975402a030 con 0x5649bf9880a0 2023-10-05T19:50:33.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.445+0000 7f97670f4e40 20 remove_watcher() i=4 2023-10-05T19:50:33.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.445+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94874747101408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf993ee0 con 0x5649bf98cdb0 2023-10-05T19:50:33.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.449+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(113 notify.5 [watch unwatch cookie 94874747101408] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.449+0000 7f97670f4e40 20 remove_watcher() i=5 2023-10-05T19:50:33.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.449+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:114 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94874747105824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf993ee0 con 0x5649bf98cdb0 2023-10-05T19:50:33.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.449+0000 7f9764428700 1 -- 172.21.15.167:0/1554470219 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(114 notify.6 [watch unwatch cookie 94874747105824] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f975c01d040 con 0x5649bf98cdb0 2023-10-05T19:50:33.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.449+0000 7f97670f4e40 20 remove_watcher() i=6 2023-10-05T19:50:33.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.449+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:115 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94874747109328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf993ee0 con 0x7f9754007030 2023-10-05T19:50:33.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.449+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(115 notify.7 [watch unwatch cookie 94874747109328] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f974c033040 con 0x7f9754007030 2023-10-05T19:50:33.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.449+0000 7f97670f4e40 20 remove_watcher() i=7 2023-10-05T19:50:33.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.453+0000 7f97367e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.453+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:116 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94874747110704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5649bf993ee0 con 0x5649bf8c8570 2023-10-05T19:50:33.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.453+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(116 data_loggenerations_metadata [watch unwatch cookie 94874747110704] v30'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f974c033040 con 0x5649bf8c8570 2023-10-05T19:50:33.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.453+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5649bf9880a0 msgr2=0x5649bf98a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.453+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5649bf9880a0 0x5649bf98a480 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.453+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5649bf8c8570 msgr2=0x5649bf986090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.453+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5649bf8c8570 0x5649bf986090 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.453+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9754007030 msgr2=0x7f97540117f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.453+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9754007030 0x7f97540117f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5649bf98cdb0 msgr2=0x5649bf98f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5649bf98cdb0 0x5649bf98f1c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9744030c50 msgr2=0x7f9744033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9744030c50 0x7f9744033100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f975c0044f0 tx=0x7f975c006690 comp rx=0 tx=0).stop 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f976542a700 1 -- 172.21.15.167:0/1554470219 reap_dead start 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 msgr2=0x5649bf97a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf97a630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f975401f040 tx=0x7f975401c000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 shutdown_connections 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 --2- 172.21.15.167:0/1554470219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf8c7090 0x5649bf97a630 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 >> 172.21.15.167:0/1554470219 conn(0x5649bf94e340 msgr2=0x5649bf96e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 shutdown_connections 2023-10-05T19:50:33.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/1554470219 wait complete. 2023-10-05T19:50:33.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/2701662861 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96ac030c50 msgr2=0x7f96ac033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 --2- 172.21.15.167:0/2701662861 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96ac030c50 0x7f96ac033100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5649bf9989b0 tx=0x7f974c00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:33.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/2701662861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 msgr2=0x5649bf9abba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 --2- 172.21.15.167:0/2701662861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9abba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f975c03a040 tx=0x7f975c030000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/2701662861 shutdown_connections 2023-10-05T19:50:33.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 --2- 172.21.15.167:0/2701662861 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f96ac030c50 0x7f96ac033100 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 --2- 172.21.15.167:0/2701662861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5649bf9a6050 0x5649bf9abba0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/2701662861 >> 172.21.15.167:0/2701662861 conn(0x5649bf9a1410 msgr2=0x5649bf99f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/2701662861 shutdown_connections 2023-10-05T19:50:33.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.457+0000 7f97670f4e40 1 -- 172.21.15.167:0/2701662861 wait complete. 2023-10-05T19:50:33.469 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:33.469 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T19:50:33.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T19:50:33.469 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T19:50:33.548 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:33.548 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:33.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.541+0000 7f834a94ae40 1 Processor -- start 2023-10-05T19:50:33.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.541+0000 7f834a94ae40 1 -- start start 2023-10-05T19:50:33.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.541+0000 7f834a94ae40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e2c69d2b50 0x55e2c69d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.541+0000 7f834a94ae40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e2c691dbd0 con 0x55e2c69d3460 2023-10-05T19:50:33.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.541+0000 7f834a94ae40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e2c68daee0 con 0x55e2c69d2b50 2023-10-05T19:50:33.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.541+0000 7f834847f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e2c69d2b50 0x55e2c69d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.541+0000 7f8347c7e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55e2c69d3460 0x55e2c69d3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39882/0 (socket says 172.21.15.167:39882) 2023-10-05T19:50:33.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.541+0000 7f8347c7e700 1 -- 172.21.15.167:0/2150493147 learned_addr learned my addr 172.21.15.167:0/2150493147 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:33.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834747d700 1 -- 172.21.15.167:0/2150493147 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842922253 0 0) 0x55e2c691dbd0 con 0x55e2c69d3460 2023-10-05T19:50:33.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834747d700 1 -- 172.21.15.167:0/2150493147 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8328001e10 con 0x55e2c69d3460 2023-10-05T19:50:33.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834847f700 1 -- 172.21.15.167:0/2150493147 >> v1:172.21.15.118:6789/0 conn(0x55e2c69d3460 legacy=0x55e2c69d3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834847f700 1 -- 172.21.15.167:0/2150493147 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2c69d4600 con 0x55e2c69d2b50 2023-10-05T19:50:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834847f700 1 --2- 172.21.15.167:0/2150493147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69d2f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f833800a5d0 tx=0x7f8338005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83f8d52a7b2cb1e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834747d700 1 -- 172.21.15.167:0/2150493147 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8338007610 con 0x55e2c69d2b50 2023-10-05T19:50:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834747d700 1 -- 172.21.15.167:0/2150493147 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338007770 con 0x55e2c69d2b50 2023-10-05T19:50:33.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834747d700 1 -- 172.21.15.167:0/2150493147 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8338007a40 con 0x55e2c69d2b50 2023-10-05T19:50:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834a94ae40 1 -- 172.21.15.167:0/2150493147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 msgr2=0x55e2c69d2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834a94ae40 1 --2- 172.21.15.167:0/2150493147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69d2f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f833800a5d0 tx=0x7f8338005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834a94ae40 1 -- 172.21.15.167:0/2150493147 shutdown_connections 2023-10-05T19:50:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834a94ae40 1 --2- 172.21.15.167:0/2150493147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69d2f20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834a94ae40 1 -- 172.21.15.167:0/2150493147 >> 172.21.15.167:0/2150493147 conn(0x55e2c69465c0 msgr2=0x55e2c69469c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834a94ae40 1 -- 172.21.15.167:0/2150493147 shutdown_connections 2023-10-05T19:50:33.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.545+0000 7f834a94ae40 1 -- 172.21.15.167:0/2150493147 wait complete. 2023-10-05T19:50:33.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834a94ae40 1 Processor -- start 2023-10-05T19:50:33.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834a94ae40 1 -- start start 2023-10-05T19:50:33.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834a94ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834a94ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c689ee30 con 0x55e2c69d2b50 2023-10-05T19:50:33.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834847f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834847f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47092/0 (socket says 172.21.15.167:47092) 2023-10-05T19:50:33.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834847f700 1 -- 172.21.15.167:0/3663468191 learned_addr learned my addr 172.21.15.167:0/3663468191 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834847f700 1 -- 172.21.15.167:0/3663468191 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338005cf0 con 0x55e2c69d2b50 2023-10-05T19:50:33.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834847f700 1 --2- 172.21.15.167:0/3663468191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f19d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8338000c00 tx=0x7f8338014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9e881e517b5146 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834647b700 1 -- 172.21.15.167:0/3663468191 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83380078e0 con 0x55e2c69d2b50 2023-10-05T19:50:33.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834647b700 1 -- 172.21.15.167:0/3663468191 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338007a40 con 0x55e2c69d2b50 2023-10-05T19:50:33.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.549+0000 7f834647b700 1 -- 172.21.15.167:0/3663468191 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8338007bd0 con 0x55e2c69d2b50 2023-10-05T19:50:33.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 -- 172.21.15.167:0/3663468191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 msgr2=0x55e2c69f19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 --2- 172.21.15.167:0/3663468191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f19d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8338000c00 tx=0x7f8338014000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 -- 172.21.15.167:0/3663468191 shutdown_connections 2023-10-05T19:50:33.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 --2- 172.21.15.167:0/3663468191 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f19d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 -- 172.21.15.167:0/3663468191 >> 172.21.15.167:0/3663468191 conn(0x55e2c69465c0 msgr2=0x55e2c69ed590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 -- 172.21.15.167:0/3663468191 shutdown_connections 2023-10-05T19:50:33.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 -- 172.21.15.167:0/3663468191 wait complete. 2023-10-05T19:50:33.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 Processor -- start 2023-10-05T19:50:33.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 -- start start 2023-10-05T19:50:33.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834a94ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c6871ed0 con 0x55e2c69d2b50 2023-10-05T19:50:33.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834847f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834847f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47098/0 (socket says 172.21.15.167:47098) 2023-10-05T19:50:33.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 learned_addr learned my addr 172.21.15.167:0/501085283 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2c69d4600 con 0x55e2c69d2b50 2023-10-05T19:50:33.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.553+0000 7f834847f700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f8690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f833801f040 tx=0x7f833801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8344c78700 1 -- 172.21.15.167:0/501085283 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8338007bb0 con 0x55e2c69d2b50 2023-10-05T19:50:33.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8344c78700 1 -- 172.21.15.167:0/501085283 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338029070 con 0x55e2c69d2b50 2023-10-05T19:50:33.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e2c69f8bd0 con 0x55e2c69d2b50 2023-10-05T19:50:33.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8344c78700 1 -- 172.21.15.167:0/501085283 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8338012610 con 0x55e2c69d2b50 2023-10-05T19:50:33.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e2c69f9010 con 0x55e2c69d2b50 2023-10-05T19:50:33.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8344c78700 1 -- 172.21.15.167:0/501085283 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f8338012770 con 0x55e2c69d2b50 2023-10-05T19:50:33.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8344c78700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f832c030ca0 0x7f832c033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8344c78700 1 -- 172.21.15.167:0/501085283 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f833802b070 con 0x55e2c69d2b50 2023-10-05T19:50:33.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8347c7e700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f832c030ca0 0x7f832c033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e2c69d3460 0x55e2c6a04120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a04790 con 0x55e2c69d3460 2023-10-05T19:50:33.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8348c80700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e2c69d3460 0x55e2c6a04120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8347c7e700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f832c030ca0 0x7f832c033150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83400044f0 tx=0x7f8340006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.557+0000 7f8348c80700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e2c69d3460 0x55e2c6a04120 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f833000a500 con 0x55e2c69d3460 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 realm 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a01780 con 0x55e2c69d3460 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f833000a500 con 0x55e2c69d3460 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a05270 con 0x55e2c69d3460 2023-10-05T19:50:33.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f833000a500 con 0x55e2c69d3460 2023-10-05T19:50:33.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e2c6a04ea0 0x55e2c6a080e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a08810 con 0x55e2c6a04ea0 2023-10-05T19:50:33.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834847f700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e2c6a04ea0 0x55e2c6a080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834847f700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e2c6a04ea0 0x55e2c6a080e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a090e0 con 0x55e2c69d3460 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f833000a500 con 0x55e2c69d3460 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 20 searching for the correct realm 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e2c6a08c50 0x55e2c6a0ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a08c50 2023-10-05T19:50:33.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.561+0000 7f8347c7e700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e2c6a08c50 0x55e2c6a0ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8347c7e700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e2c6a08c50 0x55e2c6a0ceb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340004520 con 0x55e2c6a08c50 2023-10-05T19:50:33.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a04ea0 2023-10-05T19:50:33.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f834847f700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8338007030 0x7f8338045eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x7f8338007030 2023-10-05T19:50:33.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8348c80700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8338007030 0x7f8338045eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8348c80700 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8338007030 0x7f8338045eb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x7f8338007030 2023-10-05T19:50:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a08c50 2023-10-05T19:50:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340004520 con 0x55e2c6a08c50 2023-10-05T19:50:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.565+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a04ea0 2023-10-05T19:50:33.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a04ea0 2023-10-05T19:50:33.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x7f8338007030 2023-10-05T19:50:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x7f8338007030 2023-10-05T19:50:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x7f8338007030 2023-10-05T19:50:33.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x7f8338007030 2023-10-05T19:50:33.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.569+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a04ea0 2023-10-05T19:50:33.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a08c50 2023-10-05T19:50:33.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8340004520 con 0x55e2c6a08c50 2023-10-05T19:50:33.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a04ea0 2023-10-05T19:50:33.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a08c50 2023-10-05T19:50:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.573+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a08c50 2023-10-05T19:50:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x7f8338007030 2023-10-05T19:50:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x7f8338007030 2023-10-05T19:50:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c69d3460 2023-10-05T19:50:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x7f8338007030 2023-10-05T19:50:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x7f8338007030 2023-10-05T19:50:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a08c50 2023-10-05T19:50:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x7f8338007030 2023-10-05T19:50:33.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x7f8338007030 2023-10-05T19:50:33.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.577+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a04ea0 2023-10-05T19:50:33.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a04ea0 2023-10-05T19:50:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0d490 con 0x55e2c6a08c50 2023-10-05T19:50:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8340021040 con 0x55e2c6a04ea0 2023-10-05T19:50:33.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8340021040 con 0x55e2c6a04ea0 2023-10-05T19:50:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834a94ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834a94ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834a94ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834a94ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.581+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a09c50 con 0x55e2c69d3460 2023-10-05T19:50:33.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0a5d0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a09840 con 0x55e2c6a04ea0 2023-10-05T19:50:33.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0de40 con 0x55e2c6a08c50 2023-10-05T19:50:33.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.585+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e5a0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0f960 con 0x55e2c6a08c50 2023-10-05T19:50:33.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0f960 con 0x55e2c6a04ea0 2023-10-05T19:50:33.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0f960 con 0x7f8338007030 2023-10-05T19:50:33.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x7f8338007030 2023-10-05T19:50:33.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.589+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a08c50 2023-10-05T19:50:33.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.593+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.593+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.593+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.593+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.593+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.593+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.593+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.593+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x7f8338007030 2023-10-05T19:50:33.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x7f8338007030 2023-10-05T19:50:33.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x7f8338007030 2023-10-05T19:50:33.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x7f8338007030 2023-10-05T19:50:33.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a08c50 2023-10-05T19:50:33.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.597+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a08c50 2023-10-05T19:50:33.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330014040 con 0x55e2c69d3460 2023-10-05T19:50:33.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a08c50 2023-10-05T19:50:33.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x7f8338007030 2023-10-05T19:50:33.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c69d3460 2023-10-05T19:50:33.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.601+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x7f8338007030 2023-10-05T19:50:33.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a08c50 2023-10-05T19:50:33.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x7f8338007030 2023-10-05T19:50:33.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a08c50 2023-10-05T19:50:33.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.605+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e1f0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0e950 con 0x55e2c6a04ea0 2023-10-05T19:50:33.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0ed00 con 0x55e2c69d3460 2023-10-05T19:50:33.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0f5a0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0f5a0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.609+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0f6a0 con 0x7f8338007030 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 zone default found 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 4 Realm: () 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 zonegroup default 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a0f6a0 con 0x7f8338007030 2023-10-05T19:50:33.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a11020 con 0x55e2c6a08c50 2023-10-05T19:50:33.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a113d0 con 0x55e2c6a08c50 2023-10-05T19:50:33.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 started sync module instance, tier type = 2023-10-05T19:50:33.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:33.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.613+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a10730 con 0x55e2c6a04ea0 2023-10-05T19:50:33.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94432483410496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a10c50 con 0x55e2c6a04ea0 2023-10-05T19:50:33.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a121b0 con 0x55e2c69d3460 2023-10-05T19:50:33.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94432483417280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a10c50 con 0x55e2c69d3460 2023-10-05T19:50:33.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a12ca0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94432483410496] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94432483417280] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94432483418384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a12770 con 0x55e2c6a04ea0 2023-10-05T19:50:33.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.617+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a13010 con 0x7f8338007030 2023-10-05T19:50:33.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.621+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.621+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94432483418384] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.621+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94432483420304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a12ce0 con 0x7f8338007030 2023-10-05T19:50:33.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.621+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a13850 con 0x55e2c6a04ea0 2023-10-05T19:50:33.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.621+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94432483420304] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.621+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.621+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94432483416016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a13810 con 0x55e2c6a04ea0 2023-10-05T19:50:33.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.621+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a14220 con 0x55e2c6a08c50 2023-10-05T19:50:33.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.625+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.625+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94432483425584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a14ac0 con 0x55e2c6a08c50 2023-10-05T19:50:33.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.625+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94432483416016] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.625+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a15360 con 0x55e2c6a08c50 2023-10-05T19:50:33.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.625+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94432483425584] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.625+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.625+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94432483430000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a15710 con 0x55e2c6a08c50 2023-10-05T19:50:33.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.625+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a16160 con 0x7f8338007030 2023-10-05T19:50:33.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94432483430000] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94432483427792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a16120 con 0x7f8338007030 2023-10-05T19:50:33.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 20 add_watcher() i=0 2023-10-05T19:50:33.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 20 add_watcher() i=1 2023-10-05T19:50:33.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 20 add_watcher() i=2 2023-10-05T19:50:33.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 20 add_watcher() i=3 2023-10-05T19:50:33.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 20 add_watcher() i=4 2023-10-05T19:50:33.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 20 add_watcher() i=5 2023-10-05T19:50:33.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 20 add_watcher() i=6 2023-10-05T19:50:33.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94432483427792] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 20 add_watcher() i=7 2023-10-05T19:50:33.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:33.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a19530 con 0x55e2c69d3460 2023-10-05T19:50:33.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.629+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94432483433984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a169f0 con 0x55e2c69d3460 2023-10-05T19:50:33.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94432483433984] v30'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8318ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f834a94ae40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:33.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f834a94ae40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:33.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f834a94ae40 1 Processor -- start 2023-10-05T19:50:33.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f834a94ae40 1 -- start start 2023-10-05T19:50:33.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f834a94ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a23d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f834a94ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c6a24270 con 0x55e2c6a23960 2023-10-05T19:50:33.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8347c7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a23d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8347c7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a23d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47104/0 (socket says 172.21.15.167:47104) 2023-10-05T19:50:33.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8347c7e700 1 -- 172.21.15.167:0/2522804676 learned_addr learned my addr 172.21.15.167:0/2522804676 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8347c7e700 1 -- 172.21.15.167:0/2522804676 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2c6a243b0 con 0x55e2c6a23960 2023-10-05T19:50:33.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8347c7e700 1 --2- 172.21.15.167:0/2522804676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a23d30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55e2c6a01bb0 tx=0x7f8340006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8f3be1ab0fcd9b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8293fff700 1 -- 172.21.15.167:0/2522804676 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f834001a040 con 0x55e2c6a23960 2023-10-05T19:50:33.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8293fff700 1 -- 172.21.15.167:0/2522804676 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834002dae0 con 0x55e2c6a23960 2023-10-05T19:50:33.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.633+0000 7f8293fff700 1 -- 172.21.15.167:0/2522804676 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83400049b0 con 0x55e2c6a23960 2023-10-05T19:50:33.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 -- 172.21.15.167:0/2522804676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 msgr2=0x55e2c6a23d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 --2- 172.21.15.167:0/2522804676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a23d30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55e2c6a01bb0 tx=0x7f8340006000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 -- 172.21.15.167:0/2522804676 shutdown_connections 2023-10-05T19:50:33.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 --2- 172.21.15.167:0/2522804676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a23d30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 -- 172.21.15.167:0/2522804676 >> 172.21.15.167:0/2522804676 conn(0x55e2c6a1ed20 msgr2=0x55e2c6a1ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 -- 172.21.15.167:0/2522804676 shutdown_connections 2023-10-05T19:50:33.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 -- 172.21.15.167:0/2522804676 wait complete. 2023-10-05T19:50:33.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 Processor -- start 2023-10-05T19:50:33.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 -- start start 2023-10-05T19:50:33.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a29370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2c6a2a370 con 0x55e2c6a23960 2023-10-05T19:50:33.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f8347c7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a29370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f8347c7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a29370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47120/0 (socket says 172.21.15.167:47120) 2023-10-05T19:50:33.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f8347c7e700 1 -- 172.21.15.167:0/3291890070 learned_addr learned my addr 172.21.15.167:0/3291890070 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f8347c7e700 1 -- 172.21.15.167:0/3291890070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8328001e10 con 0x55e2c6a23960 2023-10-05T19:50:33.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f8347c7e700 1 --2- 172.21.15.167:0/3291890070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a29370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f834003a040 tx=0x7f8340030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f82927fc700 1 -- 172.21.15.167:0/3291890070 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f834001a040 con 0x55e2c6a23960 2023-10-05T19:50:33.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f82927fc700 1 -- 172.21.15.167:0/3291890070 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340004330 con 0x55e2c6a23960 2023-10-05T19:50:33.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 -- 172.21.15.167:0/3291890070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e2c6a29970 con 0x55e2c6a23960 2023-10-05T19:50:33.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f82927fc700 1 -- 172.21.15.167:0/3291890070 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8340014950 con 0x55e2c6a23960 2023-10-05T19:50:33.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.637+0000 7f834a94ae40 1 -- 172.21.15.167:0/3291890070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e2c6a29e10 con 0x55e2c6a23960 2023-10-05T19:50:33.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f82927fc700 1 -- 172.21.15.167:0/3291890070 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f8340014ab0 con 0x55e2c6a23960 2023-10-05T19:50:33.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f82927fc700 1 --2- 172.21.15.167:0/3291890070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8288030bb0 0x7f8288033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f82927fc700 1 -- 172.21.15.167:0/3291890070 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f8340027040 con 0x55e2c6a23960 2023-10-05T19:50:33.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f8348c80700 1 --2- 172.21.15.167:0/3291890070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8288030bb0 0x7f8288033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f834a94ae40 5 note: GC not initialized 2023-10-05T19:50:33.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f8348c80700 1 --2- 172.21.15.167:0/3291890070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8288030bb0 0x7f8288033060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55e2c6a163a0 tx=0x7f833000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f82877fe700 20 reqs_thread_entry: start 2023-10-05T19:50:33.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f82857fa700 20 reqs_thread_entry: start 2023-10-05T19:50:33.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f834a94ae40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:33.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f834a94ae40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:33.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f82737fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:03 2023 2023-10-05T19:50:33.650 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:33.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f8272ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:33.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f834a94ae40 20 get_system_obj_state: rctx=0x7ffd270c27d8 obj=default.rgw.meta:users.uid:foo state=0x55e2c68aa0b0 s->prefetch_data=0 2023-10-05T19:50:33.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.641+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a91b80 con 0x55e2c69d3460 2023-10-05T19:50:33.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.645+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.645+0000 7f834a94ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:33.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.645+0000 7f834a94ae40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:33.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.645+0000 7f834a94ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.645+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a94610 con 0x55e2c69d3460 2023-10-05T19:50:33.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.645+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.645+0000 7f834a94ae40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:33.652 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:33.652 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:33.652 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 1, 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:33.653 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:33.654 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:33.655 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:33.656 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:33.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.645+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94432483410496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c69e82b0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.649+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94432483410496] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.649+0000 7f834a94ae40 20 remove_watcher() i=0 2023-10-05T19:50:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.649+0000 7f834a94ae40 2 removed watcher, disabling cache 2023-10-05T19:50:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.649+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94432483417280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c69e82b0 con 0x55e2c69d3460 2023-10-05T19:50:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.649+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94432483417280] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.649+0000 7f834a94ae40 20 remove_watcher() i=1 2023-10-05T19:50:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.649+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94432483418384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c69e82b0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.653+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94432483418384] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.653+0000 7f834a94ae40 20 remove_watcher() i=2 2023-10-05T19:50:33.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.653+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94432483420304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a121b0 con 0x7f8338007030 2023-10-05T19:50:33.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.653+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94432483420304] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.653+0000 7f834a94ae40 20 remove_watcher() i=3 2023-10-05T19:50:33.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.653+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94432483416016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a121b0 con 0x55e2c6a04ea0 2023-10-05T19:50:33.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.657+0000 7f834847f700 1 -- 172.21.15.167:0/501085283 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94432483416016] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f833801cc00 con 0x55e2c6a04ea0 2023-10-05T19:50:33.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.657+0000 7f834a94ae40 20 remove_watcher() i=4 2023-10-05T19:50:33.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.657+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94432483425584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c69e82b0 con 0x55e2c6a08c50 2023-10-05T19:50:33.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.657+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94432483425584] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.657+0000 7f834a94ae40 20 remove_watcher() i=5 2023-10-05T19:50:33.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.657+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94432483430000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c69e82b0 con 0x55e2c6a08c50 2023-10-05T19:50:33.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.657+0000 7f8347c7e700 1 -- 172.21.15.167:0/501085283 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94432483430000] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f834001d040 con 0x55e2c6a08c50 2023-10-05T19:50:33.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.657+0000 7f834a94ae40 20 remove_watcher() i=6 2023-10-05T19:50:33.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.657+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94432483427792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c69e82b0 con 0x7f8338007030 2023-10-05T19:50:33.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.661+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94432483427792] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8330033040 con 0x7f8338007030 2023-10-05T19:50:33.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.661+0000 7f834a94ae40 20 remove_watcher() i=7 2023-10-05T19:50:33.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.661+0000 7f8318ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.661+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94432483433984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e2c6a50f00 con 0x55e2c69d3460 2023-10-05T19:50:33.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94432483433984] v30'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8330033040 con 0x55e2c69d3460 2023-10-05T19:50:33.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e2c6a04ea0 msgr2=0x55e2c6a080e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e2c6a04ea0 0x55e2c6a080e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e2c69d3460 msgr2=0x55e2c6a04120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e2c69d3460 0x55e2c6a04120 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8338007030 msgr2=0x7f8338045eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8338007030 0x7f8338045eb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e2c6a08c50 msgr2=0x55e2c6a0ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e2c6a08c50 0x55e2c6a0ceb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f832c030ca0 msgr2=0x7f832c033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f832c030ca0 0x7f832c033150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f83400044f0 tx=0x7f8340006690 comp rx=0 tx=0).stop 2023-10-05T19:50:33.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f8348c80700 1 -- 172.21.15.167:0/501085283 reap_dead start 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 msgr2=0x55e2c69f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f8690 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f833801f040 tx=0x7f833801c000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 shutdown_connections 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/501085283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c69d2b50 0x55e2c69f8690 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 >> 172.21.15.167:0/501085283 conn(0x55e2c69465c0 msgr2=0x55e2c69ec010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 shutdown_connections 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/501085283 wait complete. 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/3291890070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8288030bb0 msgr2=0x7f8288033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/3291890070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8288030bb0 0x7f8288033060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55e2c6a163a0 tx=0x7f833000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/3291890070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 msgr2=0x55e2c6a29370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/3291890070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a29370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f834003a040 tx=0x7f8340030000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/3291890070 shutdown_connections 2023-10-05T19:50:33.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/3291890070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8288030bb0 0x7f8288033060 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 --2- 172.21.15.167:0/3291890070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e2c6a23960 0x55e2c6a29370 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.665+0000 7f834a94ae40 1 -- 172.21.15.167:0/3291890070 >> 172.21.15.167:0/3291890070 conn(0x55e2c6a1ed20 msgr2=0x55e2c6a1ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.669+0000 7f834a94ae40 1 -- 172.21.15.167:0/3291890070 shutdown_connections 2023-10-05T19:50:33.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.669+0000 7f834a94ae40 1 -- 172.21.15.167:0/3291890070 wait complete. 2023-10-05T19:50:33.679 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:33.679 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2023-10-05T19:50:33.679 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2023-10-05T19:50:33.679 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2023-10-05T19:50:33.719 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:33.719 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:33.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e139dde40 1 Processor -- start 2023-10-05T19:50:33.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e139dde40 1 -- start start 2023-10-05T19:50:33.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e139dde40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55b87eadc120 0x55b87eade500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e139dde40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b87ea22bd0 con 0x55b87ead7b50 2023-10-05T19:50:33.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e139dde40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b87e9dfee0 con 0x55b87eadc120 2023-10-05T19:50:33.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e10d11700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55b87eadc120 0x55b87eade500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e10d11700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55b87eadc120 0x55b87eade500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47130/0 (socket says 172.21.15.167:47130) 2023-10-05T19:50:33.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e10d11700 1 -- 172.21.15.167:0/1541963794 learned_addr learned my addr 172.21.15.167:0/1541963794 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e10d11700 1 -- 172.21.15.167:0/1541963794 >> v1:172.21.15.118:6789/0 conn(0x55b87ead7b50 legacy=0x55b87ead7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e10d11700 1 -- 172.21.15.167:0/1541963794 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b87ead8760 con 0x55b87eadc120 2023-10-05T19:50:33.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e10d11700 1 --2- 172.21.15.167:0/1541963794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 0x55b87eade500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00a5c0 tx=0x7f3e0c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd8d7ba57159b56 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.713+0000 7f3e0bfff700 1 -- 172.21.15.167:0/1541963794 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c00e510 con 0x55b87eadc120 2023-10-05T19:50:33.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e0bfff700 1 -- 172.21.15.167:0/1541963794 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00e670 con 0x55b87eadc120 2023-10-05T19:50:33.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e0bfff700 1 -- 172.21.15.167:0/1541963794 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c00e920 con 0x55b87eadc120 2023-10-05T19:50:33.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 -- 172.21.15.167:0/1541963794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 msgr2=0x55b87eade500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 --2- 172.21.15.167:0/1541963794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 0x55b87eade500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00a5c0 tx=0x7f3e0c005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:33.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 -- 172.21.15.167:0/1541963794 shutdown_connections 2023-10-05T19:50:33.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 --2- 172.21.15.167:0/1541963794 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 0x55b87eade500 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 -- 172.21.15.167:0/1541963794 >> 172.21.15.167:0/1541963794 conn(0x55b87ea4b5c0 msgr2=0x55b87ea4b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 -- 172.21.15.167:0/1541963794 shutdown_connections 2023-10-05T19:50:33.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 -- 172.21.15.167:0/1541963794 wait complete. 2023-10-05T19:50:33.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 Processor -- start 2023-10-05T19:50:33.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 -- start start 2023-10-05T19:50:33.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87ead7b50 0x55b87eaf6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87e9a3e30 con 0x55b87ead7b50 2023-10-05T19:50:33.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e11512700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87ead7b50 0x55b87eaf6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e11512700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87ead7b50 0x55b87eaf6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47134/0 (socket says 172.21.15.167:47134) 2023-10-05T19:50:33.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e11512700 1 -- 172.21.15.167:0/3961707714 learned_addr learned my addr 172.21.15.167:0/3961707714 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e11512700 1 -- 172.21.15.167:0/3961707714 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c00a180 con 0x55b87ead7b50 2023-10-05T19:50:33.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e11512700 1 --2- 172.21.15.167:0/3961707714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87ead7b50 0x55b87eaf6bd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e04001d30 tx=0x7f3e04001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b01b2da2d0de05 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e0affd700 1 -- 172.21.15.167:0/3961707714 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e04014070 con 0x55b87ead7b50 2023-10-05T19:50:33.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e0affd700 1 -- 172.21.15.167:0/3961707714 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04008070 con 0x55b87ead7b50 2023-10-05T19:50:33.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e0affd700 1 -- 172.21.15.167:0/3961707714 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e0400bd30 con 0x55b87ead7b50 2023-10-05T19:50:33.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 -- 172.21.15.167:0/3961707714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87ead7b50 msgr2=0x55b87eaf6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.717+0000 7f3e139dde40 1 --2- 172.21.15.167:0/3961707714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87ead7b50 0x55b87eaf6bd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e04001d30 tx=0x7f3e04001900 comp rx=0 tx=0).stop 2023-10-05T19:50:33.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 -- 172.21.15.167:0/3961707714 shutdown_connections 2023-10-05T19:50:33.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 --2- 172.21.15.167:0/3961707714 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87ead7b50 0x55b87eaf6bd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 -- 172.21.15.167:0/3961707714 >> 172.21.15.167:0/3961707714 conn(0x55b87ea4b5c0 msgr2=0x55b87eaf2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 -- 172.21.15.167:0/3961707714 shutdown_connections 2023-10-05T19:50:33.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 -- 172.21.15.167:0/3961707714 wait complete. 2023-10-05T19:50:33.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 Processor -- start 2023-10-05T19:50:33.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 -- start start 2023-10-05T19:50:33.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 0x55b87eafdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87e976ed0 con 0x55b87eadc120 2023-10-05T19:50:33.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e11512700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 0x55b87eafdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e11512700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 0x55b87eafdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47136/0 (socket says 172.21.15.167:47136) 2023-10-05T19:50:33.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 learned_addr learned my addr 172.21.15.167:0/2937456997 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0400a040 con 0x55b87eadc120 2023-10-05T19:50:33.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e11512700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 0x55b87eafdb30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3e04003000 tx=0x7f3e04016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e097fa700 1 -- 172.21.15.167:0/2937456997 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e0400bee0 con 0x55b87eadc120 2023-10-05T19:50:33.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e097fa700 1 -- 172.21.15.167:0/2937456997 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04021070 con 0x55b87eadc120 2023-10-05T19:50:33.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b87eafe070 con 0x55b87eadc120 2023-10-05T19:50:33.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e097fa700 1 -- 172.21.15.167:0/2937456997 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e0401a600 con 0x55b87eadc120 2023-10-05T19:50:33.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.721+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b87eafe510 con 0x55b87eadc120 2023-10-05T19:50:33.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e097fa700 1 -- 172.21.15.167:0/2937456997 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3e0401a760 con 0x55b87eadc120 2023-10-05T19:50:33.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e097fa700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3df8030c50 0x7f3df8033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e097fa700 1 -- 172.21.15.167:0/2937456997 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f3e04044c10 con 0x55b87eadc120 2023-10-05T19:50:33.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e10d11700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3df8030c50 0x7f3df8033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b87eb07640 0x55b87eb09a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb0a090 con 0x55b87eb07640 2023-10-05T19:50:33.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e11d13700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b87eb07640 0x55b87eb09a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e10d11700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3df8030c50 0x7f3df8033100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c000f80 tx=0x7f3e0c013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e11d13700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b87eb07640 0x55b87eb09a20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.725+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3dfc00a500 con 0x55b87eb07640 2023-10-05T19:50:33.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 realm 2023-10-05T19:50:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb06cb0 con 0x55b87eb07640 2023-10-05T19:50:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3dfc00a500 con 0x55b87eb07640 2023-10-05T19:50:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb0ab70 con 0x55b87eb07640 2023-10-05T19:50:33.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3dfc00a500 con 0x55b87eb07640 2023-10-05T19:50:33.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b87eb0b9a0 0x55b87eb0dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb0e2c0 con 0x55b87eb0b9a0 2023-10-05T19:50:33.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e11512700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b87eb0b9a0 0x55b87eb0dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e11512700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b87eb0b9a0 0x55b87eb0dd80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3e04016070 con 0x55b87eb0b9a0 2023-10-05T19:50:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb0eb60 con 0x55b87eb07640 2023-10-05T19:50:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3dfc00a500 con 0x55b87eb07640 2023-10-05T19:50:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 20 searching for the correct realm 2023-10-05T19:50:33.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b87eb10920 0x55b87eb12d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb10920 2023-10-05T19:50:33.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.729+0000 7f3e10d11700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b87eb10920 0x55b87eb12d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e10d11700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b87eb10920 0x55b87eb12d00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb0b9a0 2023-10-05T19:50:33.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e04016070 con 0x55b87eb0b9a0 2023-10-05T19:50:33.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11512700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55b87ead7b50 0x7f3e0401b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87ead7b50 2023-10-05T19:50:33.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11d13700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55b87ead7b50 0x7f3e0401b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11d13700 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55b87ead7b50 0x7f3e0401b3d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87ead7b50 2023-10-05T19:50:33.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.733+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb10920 2023-10-05T19:50:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb0b9a0 2023-10-05T19:50:33.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb0b9a0 2023-10-05T19:50:33.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87ead7b50 2023-10-05T19:50:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87ead7b50 2023-10-05T19:50:33.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.737+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87ead7b50 2023-10-05T19:50:33.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87ead7b50 2023-10-05T19:50:33.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb0b9a0 2023-10-05T19:50:33.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb10920 2023-10-05T19:50:33.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb0b9a0 2023-10-05T19:50:33.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb10920 2023-10-05T19:50:33.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.741+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb10920 2023-10-05T19:50:33.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87ead7b50 2023-10-05T19:50:33.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87ead7b50 2023-10-05T19:50:33.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb07640 2023-10-05T19:50:33.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87ead7b50 2023-10-05T19:50:33.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87ead7b50 2023-10-05T19:50:33.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb10920 2023-10-05T19:50:33.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.745+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87ead7b50 2023-10-05T19:50:33.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87ead7b50 2023-10-05T19:50:33.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb0b9a0 2023-10-05T19:50:33.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb0b9a0 2023-10-05T19:50:33.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb10920 2023-10-05T19:50:33.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb0b9a0 2023-10-05T19:50:33.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.749+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13240 con 0x55b87eb0b9a0 2023-10-05T19:50:33.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb0f6d0 con 0x55b87eb07640 2023-10-05T19:50:33.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb10020 con 0x55b87eb0b9a0 2023-10-05T19:50:33.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb135f0 con 0x55b87eb0b9a0 2023-10-05T19:50:33.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb139a0 con 0x55b87eb10920 2023-10-05T19:50:33.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.753+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb0fbc0 con 0x55b87eb0b9a0 2023-10-05T19:50:33.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb15650 con 0x55b87eb10920 2023-10-05T19:50:33.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb15650 con 0x55b87eb0b9a0 2023-10-05T19:50:33.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb0fbc0 con 0x55b87ead7b50 2023-10-05T19:50:33.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87ead7b50 2023-10-05T19:50:33.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.757+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb10920 2023-10-05T19:50:33.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb0b9a0 2023-10-05T19:50:33.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb0b9a0 2023-10-05T19:50:33.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.761+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87ead7b50 2023-10-05T19:50:33.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87ead7b50 2023-10-05T19:50:33.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87ead7b50 2023-10-05T19:50:33.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87ead7b50 2023-10-05T19:50:33.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb0b9a0 2023-10-05T19:50:33.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb10920 2023-10-05T19:50:33.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.765+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb0b9a0 2023-10-05T19:50:33.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb10920 2023-10-05T19:50:33.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc014040 con 0x55b87eb07640 2023-10-05T19:50:33.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.769+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb10920 2023-10-05T19:50:33.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87ead7b50 2023-10-05T19:50:33.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb07640 2023-10-05T19:50:33.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87ead7b50 2023-10-05T19:50:33.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb10920 2023-10-05T19:50:33.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87ead7b50 2023-10-05T19:50:33.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.773+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb0b9a0 2023-10-05T19:50:33.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb0b9a0 2023-10-05T19:50:33.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb10920 2023-10-05T19:50:33.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb0b9a0 2023-10-05T19:50:33.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb13d50 con 0x55b87eb0b9a0 2023-10-05T19:50:33.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e139dde40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e139dde40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e139dde40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e139dde40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.777+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb0fb90 con 0x55b87eb0b9a0 2023-10-05T19:50:33.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb0fb90 con 0x55b87eb07640 2023-10-05T19:50:33.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb14b30 con 0x55b87eb0b9a0 2023-10-05T19:50:33.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb14b30 con 0x55b87eb0b9a0 2023-10-05T19:50:33.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.781+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb14c30 con 0x55b87ead7b50 2023-10-05T19:50:33.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 zone default found 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 4 Realm: () 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 zonegroup default 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb14c30 con 0x55b87ead7b50 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb165b0 con 0x55b87eb10920 2023-10-05T19:50:33.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb16960 con 0x55b87eb10920 2023-10-05T19:50:33.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 started sync module instance, tier type = 2023-10-05T19:50:33.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:33.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.785+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb15c70 con 0x55b87eb0b9a0 2023-10-05T19:50:33.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.789+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.789+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250887894912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb16190 con 0x55b87eb0b9a0 2023-10-05T19:50:33.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.789+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb15c30 con 0x55b87eb07640 2023-10-05T19:50:33.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.793+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.793+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94250887894912] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.793+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250887901696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb15c30 con 0x55b87eb07640 2023-10-05T19:50:33.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.793+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb17cb0 con 0x55b87eb0b9a0 2023-10-05T19:50:33.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.793+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94250887901696] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.793+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.793+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250887900432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb17cb0 con 0x55b87eb0b9a0 2023-10-05T19:50:33.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.793+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb18550 con 0x55b87ead7b50 2023-10-05T19:50:33.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.797+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.797+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250887904720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb18710 con 0x55b87ead7b50 2023-10-05T19:50:33.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.797+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94250887900432] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.797+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb19010 con 0x55b87eb0b9a0 2023-10-05T19:50:33.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.797+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94250887904720] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.797+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.797+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250887905824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb18b60 con 0x55b87eb0b9a0 2023-10-05T19:50:33.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.797+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb19640 con 0x55b87eb10920 2023-10-05T19:50:33.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94250887905824] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250887909648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb19f30 con 0x55b87eb10920 2023-10-05T19:50:33.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb1a450 con 0x55b87eb10920 2023-10-05T19:50:33.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94250887909648] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250887915520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb1b140 con 0x55b87eb10920 2023-10-05T19:50:33.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb1b9e0 con 0x55b87ead7b50 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94250887915520] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0c017050 con 0x55b87eb10920 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250887916624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb1b9e0 con 0x55b87ead7b50 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 20 add_watcher() i=0 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 20 add_watcher() i=1 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 20 add_watcher() i=2 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 20 add_watcher() i=3 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 20 add_watcher() i=4 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 20 add_watcher() i=5 2023-10-05T19:50:33.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.801+0000 7f3e139dde40 20 add_watcher() i=6 2023-10-05T19:50:33.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94250887916624] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3e139dde40 20 add_watcher() i=7 2023-10-05T19:50:33.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3e139dde40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:33.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb1eb80 con 0x55b87eb07640 2023-10-05T19:50:33.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250887919200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb1c140 con 0x55b87eb07640 2023-10-05T19:50:33.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94250887919200] v30'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3de1feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3e139dde40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:33.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.805+0000 7f3e139dde40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:33.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 Processor -- start 2023-10-05T19:50:33.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 -- start start 2023-10-05T19:50:33.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb29770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87eb29cb0 con 0x55b87eb293a0 2023-10-05T19:50:33.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e10d11700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb29770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e10d11700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb29770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47150/0 (socket says 172.21.15.167:47150) 2023-10-05T19:50:33.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e10d11700 1 -- 172.21.15.167:0/254708356 learned_addr learned my addr 172.21.15.167:0/254708356 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e10d11700 1 -- 172.21.15.167:0/254708356 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b87eb29df0 con 0x55b87eb293a0 2023-10-05T19:50:33.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e10d11700 1 --2- 172.21.15.167:0/254708356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb29770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b87ead8b80 tx=0x7f3e0c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa05a7342a360546 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3de17ea700 1 -- 172.21.15.167:0/254708356 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c02d040 con 0x55b87eb293a0 2023-10-05T19:50:33.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3de17ea700 1 -- 172.21.15.167:0/254708356 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c010a60 con 0x55b87eb293a0 2023-10-05T19:50:33.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3de17ea700 1 -- 172.21.15.167:0/254708356 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c010c30 con 0x55b87eb293a0 2023-10-05T19:50:33.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 -- 172.21.15.167:0/254708356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 msgr2=0x55b87eb29770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 --2- 172.21.15.167:0/254708356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb29770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b87ead8b80 tx=0x7f3e0c010000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 -- 172.21.15.167:0/254708356 shutdown_connections 2023-10-05T19:50:33.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 --2- 172.21.15.167:0/254708356 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb29770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 -- 172.21.15.167:0/254708356 >> 172.21.15.167:0/254708356 conn(0x55b87eb24760 msgr2=0x55b87eb228b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 -- 172.21.15.167:0/254708356 shutdown_connections 2023-10-05T19:50:33.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 -- 172.21.15.167:0/254708356 wait complete. 2023-10-05T19:50:33.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 Processor -- start 2023-10-05T19:50:33.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.809+0000 7f3e139dde40 1 -- start start 2023-10-05T19:50:33.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e139dde40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb2ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e139dde40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87eb2fe00 con 0x55b87eb293a0 2023-10-05T19:50:33.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e10d11700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb2ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e10d11700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb2ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47154/0 (socket says 172.21.15.167:47154) 2023-10-05T19:50:33.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e10d11700 1 -- 172.21.15.167:0/1338141330 learned_addr learned my addr 172.21.15.167:0/1338141330 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e10d11700 1 -- 172.21.15.167:0/1338141330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b87ead8760 con 0x55b87eb293a0 2023-10-05T19:50:33.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e10d11700 1 --2- 172.21.15.167:0/1338141330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb2ee00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00ea70 tx=0x7f3e0c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3d5b7fe700 1 -- 172.21.15.167:0/1338141330 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c033430 con 0x55b87eb293a0 2023-10-05T19:50:33.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3d5b7fe700 1 -- 172.21.15.167:0/1338141330 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c0335b0 con 0x55b87eb293a0 2023-10-05T19:50:33.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3d5b7fe700 1 -- 172.21.15.167:0/1338141330 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e0c033760 con 0x55b87eb293a0 2023-10-05T19:50:33.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e139dde40 1 -- 172.21.15.167:0/1338141330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b87eb2f400 con 0x55b87eb293a0 2023-10-05T19:50:33.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e139dde40 1 -- 172.21.15.167:0/1338141330 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b87eb2f840 con 0x55b87eb293a0 2023-10-05T19:50:33.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3d5b7fe700 1 -- 172.21.15.167:0/1338141330 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3e0c0338c0 con 0x55b87eb293a0 2023-10-05T19:50:33.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3d5b7fe700 1 --2- 172.21.15.167:0/1338141330 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3d50030c50 0x7f3d50033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3d5b7fe700 1 -- 172.21.15.167:0/1338141330 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f3e0c046c80 con 0x55b87eb293a0 2023-10-05T19:50:33.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e139dde40 5 note: GC not initialized 2023-10-05T19:50:33.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.813+0000 7f3e11d13700 1 --2- 172.21.15.167:0/1338141330 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3d50030c50 0x7f3d50033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e11d13700 1 --2- 172.21.15.167:0/1338141330 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3d50030c50 0x7f3d50033100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55b87eb1c0a0 tx=0x7f3dfc00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3d58ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:33.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:33.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:33.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3d4cff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:04 2023 2023-10-05T19:50:33.825 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:33.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3d3bfff700 20 reqs_thread_entry: start 2023-10-05T19:50:33.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 20 get_system_obj_state: rctx=0x7ffc55459768 obj=default.rgw.meta:users.uid:foo state=0x55b87e9af0b0 s->prefetch_data=0 2023-10-05T19:50:33.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:33.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb97670 con 0x55b87eb07640 2023-10-05T19:50:33.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3d4e7fc700 20 reqs_thread_entry: start 2023-10-05T19:50:33.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:33.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:33.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:33.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.817+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb9a100 con 0x55b87eb07640 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb9a100 con 0x55b87ead7b50 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb9b380 con 0x55b87eb07640 2023-10-05T19:50:33.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~357] v30'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:33.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:33.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94250888441488 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb9a100 con 0x55b87eb0b9a0 2023-10-05T19:50:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94250887905824 notify 128849018882 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55b87eafe510 con 0x55b87eb0b9a0 2023-10-05T19:50:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e0a7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94250887905824 notifier 4313 bl.length()=533 2023-10-05T19:50:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e0a7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.821+0000 7f3e0a7fc700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:33.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.825+0000 7f3e0a7fc700 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3dec003d90 con 0x55b87eb0b9a0 2023-10-05T19:50:33.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.825+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.4 [notify cookie 94250888441488 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.825+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.825+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94250888441488 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b87eafe070 con 0x55b87eb0b9a0 2023-10-05T19:50:33.831 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:33.832 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:33.833 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:33.834 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:33.835 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:33.835 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:33.835 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:33.835 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:33.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.825+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250887894912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eaed530 con 0x55b87eb0b9a0 2023-10-05T19:50:33.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.825+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(108 notify.0 [watch unwatch cookie 94250887894912] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.829+0000 7f3e139dde40 20 remove_watcher() i=0 2023-10-05T19:50:33.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.829+0000 7f3e139dde40 2 removed watcher, disabling cache 2023-10-05T19:50:33.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.829+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250887901696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eaed530 con 0x55b87eb07640 2023-10-05T19:50:33.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.829+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(109 notify.1 [watch unwatch cookie 94250887901696] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.829+0000 7f3e139dde40 20 remove_watcher() i=1 2023-10-05T19:50:33.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.829+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250887900432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eaed530 con 0x55b87eb0b9a0 2023-10-05T19:50:33.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.829+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(110 notify.2 [watch unwatch cookie 94250887900432] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.829+0000 7f3e139dde40 20 remove_watcher() i=2 2023-10-05T19:50:33.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.829+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250887904720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eaed530 con 0x55b87ead7b50 2023-10-05T19:50:33.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.833+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.3 [watch unwatch cookie 94250887904720] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.833+0000 7f3e139dde40 20 remove_watcher() i=3 2023-10-05T19:50:33.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.833+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250887905824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eaed530 con 0x55b87eb0b9a0 2023-10-05T19:50:33.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.833+0000 7f3e11512700 1 -- 172.21.15.167:0/2937456997 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(112 notify.4 [watch unwatch cookie 94250887905824] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0403a040 con 0x55b87eb0b9a0 2023-10-05T19:50:33.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.833+0000 7f3e139dde40 20 remove_watcher() i=4 2023-10-05T19:50:33.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.833+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250887909648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb182c0 con 0x55b87eb10920 2023-10-05T19:50:33.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.837+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(113 notify.5 [watch unwatch cookie 94250887909648] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0c042070 con 0x55b87eb10920 2023-10-05T19:50:33.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.837+0000 7f3e139dde40 20 remove_watcher() i=5 2023-10-05T19:50:33.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.837+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:114 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250887915520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb182c0 con 0x55b87eb10920 2023-10-05T19:50:33.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.837+0000 7f3e10d11700 1 -- 172.21.15.167:0/2937456997 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(114 notify.6 [watch unwatch cookie 94250887915520] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3e0c042070 con 0x55b87eb10920 2023-10-05T19:50:33.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.837+0000 7f3e139dde40 20 remove_watcher() i=6 2023-10-05T19:50:33.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.837+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:115 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250887916624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb182c0 con 0x55b87ead7b50 2023-10-05T19:50:33.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.841+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(115 notify.7 [watch unwatch cookie 94250887916624] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87ead7b50 2023-10-05T19:50:33.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.841+0000 7f3e139dde40 20 remove_watcher() i=7 2023-10-05T19:50:33.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.841+0000 7f3de1feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.841+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:116 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250887919200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b87eb182c0 con 0x55b87eb07640 2023-10-05T19:50:33.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(116 data_loggenerations_metadata [watch unwatch cookie 94250887919200] v30'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3dfc033040 con 0x55b87eb07640 2023-10-05T19:50:33.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b87eb0b9a0 msgr2=0x55b87eb0dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b87eb0b9a0 0x55b87eb0dd80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b87eb07640 msgr2=0x55b87eb09a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b87eb07640 0x55b87eb09a20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55b87ead7b50 msgr2=0x7f3e0401b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55b87ead7b50 0x7f3e0401b3d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b87eb10920 msgr2=0x55b87eb12d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b87eb10920 0x55b87eb12d00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3df8030c50 msgr2=0x7f3df8033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3df8030c50 0x7f3df8033100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c000f80 tx=0x7f3e0c013000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 msgr2=0x55b87eafdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 0x55b87eafdb30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3e04003000 tx=0x7f3e04016000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e11d13700 1 -- 172.21.15.167:0/2937456997 reap_dead start 2023-10-05T19:50:33.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 shutdown_connections 2023-10-05T19:50:33.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/2937456997 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eadc120 0x55b87eafdb30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 >> 172.21.15.167:0/2937456997 conn(0x55b87ea4b5c0 msgr2=0x55b87eaf1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 shutdown_connections 2023-10-05T19:50:33.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/2937456997 wait complete. 2023-10-05T19:50:33.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/1338141330 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3d50030c50 msgr2=0x7f3d50033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/1338141330 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3d50030c50 0x7f3d50033100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55b87eb1c0a0 tx=0x7f3dfc00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:33.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/1338141330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 msgr2=0x55b87eb2ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/1338141330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb2ee00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00ea70 tx=0x7f3e0c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/1338141330 shutdown_connections 2023-10-05T19:50:33.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/1338141330 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3d50030c50 0x7f3d50033100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 --2- 172.21.15.167:0/1338141330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b87eb293a0 0x55b87eb2ee00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/1338141330 >> 172.21.15.167:0/1338141330 conn(0x55b87eb24760 msgr2=0x55b87eb22800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/1338141330 shutdown_connections 2023-10-05T19:50:33.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.845+0000 7f3e139dde40 1 -- 172.21.15.167:0/1338141330 wait complete. 2023-10-05T19:50:33.857 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:33.858 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T19:50:33.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T19:50:33.858 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T19:50:33.898 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:33.899 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:33.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fc001c26e40 1 Processor -- start 2023-10-05T19:50:33.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fc001c26e40 1 -- start start 2023-10-05T19:50:33.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fc001c26e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5623a4c85920 0x5623a4c85cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fc001c26e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5623a4bd2bd0 con 0x5623a4c86230 2023-10-05T19:50:33.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fc001c26e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5623a4b8fee0 con 0x5623a4c85920 2023-10-05T19:50:33.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fbfff75b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5623a4c85920 0x5623a4c85cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fbffef5a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x5623a4c86230 0x5623a4c86cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39902/0 (socket says 172.21.15.167:39902) 2023-10-05T19:50:33.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fbffef5a700 1 -- 172.21.15.167:0/669876457 learned_addr learned my addr 172.21.15.167:0/669876457 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:33.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fbfff75b700 1 -- 172.21.15.167:0/669876457 >> v1:172.21.15.118:6789/0 conn(0x5623a4c86230 legacy=0x5623a4c86cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fbfff75b700 1 -- 172.21.15.167:0/669876457 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623a4c873e0 con 0x5623a4c85920 2023-10-05T19:50:33.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fbfff75b700 1 --2- 172.21.15.167:0/669876457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4c85cf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbff800a520 tx=0x7fbff8005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54d2e7ae71bab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fbffe759700 1 -- 172.21.15.167:0/669876457 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff800f590 con 0x5623a4c85920 2023-10-05T19:50:33.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fbffe759700 1 -- 172.21.15.167:0/669876457 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff800f6f0 con 0x5623a4c85920 2023-10-05T19:50:33.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fbffe759700 1 -- 172.21.15.167:0/669876457 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff800f880 con 0x5623a4c85920 2023-10-05T19:50:33.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fc001c26e40 1 -- 172.21.15.167:0/669876457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 msgr2=0x5623a4c85cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.893+0000 7fc001c26e40 1 --2- 172.21.15.167:0/669876457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4c85cf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbff800a520 tx=0x7fbff8005d40 comp rx=0 tx=0).stop 2023-10-05T19:50:33.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fc001c26e40 1 -- 172.21.15.167:0/669876457 shutdown_connections 2023-10-05T19:50:33.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fc001c26e40 1 --2- 172.21.15.167:0/669876457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4c85cf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fc001c26e40 1 -- 172.21.15.167:0/669876457 >> 172.21.15.167:0/669876457 conn(0x5623a4c81340 msgr2=0x5623a4c83750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fc001c26e40 1 -- 172.21.15.167:0/669876457 shutdown_connections 2023-10-05T19:50:33.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fc001c26e40 1 -- 172.21.15.167:0/669876457 wait complete. 2023-10-05T19:50:33.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fc001c26e40 1 Processor -- start 2023-10-05T19:50:33.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fc001c26e40 1 -- start start 2023-10-05T19:50:33.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fc001c26e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4bfb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fc001c26e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a4b53e30 con 0x5623a4c85920 2023-10-05T19:50:33.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fbfff75b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4bfb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fbfff75b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4bfb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47174/0 (socket says 172.21.15.167:47174) 2023-10-05T19:50:33.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fbfff75b700 1 -- 172.21.15.167:0/3888435291 learned_addr learned my addr 172.21.15.167:0/3888435291 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fbfff75b700 1 -- 172.21.15.167:0/3888435291 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff800a0e0 con 0x5623a4c85920 2023-10-05T19:50:33.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fbfff75b700 1 --2- 172.21.15.167:0/3888435291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4bfb230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbff8005d80 tx=0x7fbff8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c97eb3b0183c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fbffd757700 1 -- 172.21.15.167:0/3888435291 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff80057e0 con 0x5623a4c85920 2023-10-05T19:50:33.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fbffd757700 1 -- 172.21.15.167:0/3888435291 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff800f860 con 0x5623a4c85920 2023-10-05T19:50:33.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.897+0000 7fbffd757700 1 -- 172.21.15.167:0/3888435291 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff800fa50 con 0x5623a4c85920 2023-10-05T19:50:33.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 -- 172.21.15.167:0/3888435291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 msgr2=0x5623a4bfb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 --2- 172.21.15.167:0/3888435291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4bfb230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbff8005d80 tx=0x7fbff8014000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 -- 172.21.15.167:0/3888435291 shutdown_connections 2023-10-05T19:50:33.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 --2- 172.21.15.167:0/3888435291 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4bfb230 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 -- 172.21.15.167:0/3888435291 >> 172.21.15.167:0/3888435291 conn(0x5623a4c81340 msgr2=0x5623a4ca04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 -- 172.21.15.167:0/3888435291 shutdown_connections 2023-10-05T19:50:33.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 -- 172.21.15.167:0/3888435291 wait complete. 2023-10-05T19:50:33.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 Processor -- start 2023-10-05T19:50:33.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 -- start start 2023-10-05T19:50:33.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4cad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a4b26ed0 con 0x5623a4c85920 2023-10-05T19:50:33.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fbfff75b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4cad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fbfff75b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4cad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47178/0 (socket says 172.21.15.167:47178) 2023-10-05T19:50:33.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 learned_addr learned my addr 172.21.15.167:0/1195102468 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623a4c873e0 con 0x5623a4c85920 2023-10-05T19:50:33.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fbfff75b700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4cad720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbff8005d80 tx=0x7fbff801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fbff77fe700 1 -- 172.21.15.167:0/1195102468 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff802a070 con 0x5623a4c85920 2023-10-05T19:50:33.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fbff77fe700 1 -- 172.21.15.167:0/1195102468 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff800fcc0 con 0x5623a4c85920 2023-10-05T19:50:33.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.901+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5623a4cadc60 con 0x5623a4c85920 2023-10-05T19:50:33.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fbff77fe700 1 -- 172.21.15.167:0/1195102468 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff800fe30 con 0x5623a4c85920 2023-10-05T19:50:33.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623a4cae0a0 con 0x5623a4c85920 2023-10-05T19:50:33.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fbff77fe700 1 -- 172.21.15.167:0/1195102468 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fbff8010420 con 0x5623a4c85920 2023-10-05T19:50:33.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fbff77fe700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbfe4030c50 0x7fbfe4033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fbff77fe700 1 -- 172.21.15.167:0/1195102468 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fbff803ac80 con 0x5623a4c85920 2023-10-05T19:50:33.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fbffef5a700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbfe4030c50 0x7fbfe4033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fc001c26e40 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5623a4c86230 0x5623a4cb9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cb9810 con 0x5623a4c86230 2023-10-05T19:50:33.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fbffff5c700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5623a4c86230 0x5623a4cb9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fbffef5a700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbfe4030c50 0x7fbfe4033100 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8001e90 tx=0x7fbfe80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.905+0000 7fbffff5c700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5623a4c86230 0x5623a4cb9160 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff000a500 con 0x5623a4c86230 2023-10-05T19:50:33.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 realm 2023-10-05T19:50:33.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cb67c0 con 0x5623a4c86230 2023-10-05T19:50:33.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff000a500 con 0x5623a4c86230 2023-10-05T19:50:33.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:33.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cba2f0 con 0x5623a4c86230 2023-10-05T19:50:33.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff000a500 con 0x5623a4c86230 2023-10-05T19:50:33.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5623a4cb9f20 0x5623a4cbd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cbd890 con 0x5623a4cb9f20 2023-10-05T19:50:33.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fbfff75b700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5623a4cb9f20 0x5623a4cbd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fbfff75b700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5623a4cb9f20 0x5623a4cbd160 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cbe160 con 0x5623a4c86230 2023-10-05T19:50:33.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbff000a500 con 0x5623a4c86230 2023-10-05T19:50:33.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.909+0000 7fc001c26e40 20 searching for the correct realm 2023-10-05T19:50:33.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fc001c26e40 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5623a4cbdcd0 0x5623a4cc1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cbdcd0 2023-10-05T19:50:33.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffef5a700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5623a4cbdcd0 0x5623a4cc1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffef5a700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5623a4cbdcd0 0x5623a4cc1f30 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8006070 con 0x5623a4cbdcd0 2023-10-05T19:50:33.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cb9f20 2023-10-05T19:50:33.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbfff75b700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbff8018ae0 0x7fbff80383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x7fbff8018ae0 2023-10-05T19:50:33.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffff5c700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbff8018ae0 0x7fbff80383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffff5c700 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbff8018ae0 0x7fbff80383b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x7fbff8018ae0 2023-10-05T19:50:33.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.913+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cbdcd0 2023-10-05T19:50:33.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8006070 con 0x5623a4cbdcd0 2023-10-05T19:50:33.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cb9f20 2023-10-05T19:50:33.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cb9f20 2023-10-05T19:50:33.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x7fbff8018ae0 2023-10-05T19:50:33.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x7fbff8018ae0 2023-10-05T19:50:33.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.917+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x7fbff8018ae0 2023-10-05T19:50:33.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x7fbff8018ae0 2023-10-05T19:50:33.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cb9f20 2023-10-05T19:50:33.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cbdcd0 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8006070 con 0x5623a4cbdcd0 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cb9f20 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cbdcd0 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8006070 con 0x5623a4cbdcd0 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.921+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cbdcd0 2023-10-05T19:50:33.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8006070 con 0x5623a4cbdcd0 2023-10-05T19:50:33.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x7fbff8018ae0 2023-10-05T19:50:33.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x7fbff8018ae0 2023-10-05T19:50:33.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4c86230 2023-10-05T19:50:33.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x7fbff8018ae0 2023-10-05T19:50:33.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x7fbff8018ae0 2023-10-05T19:50:33.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cbdcd0 2023-10-05T19:50:33.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8006070 con 0x5623a4cbdcd0 2023-10-05T19:50:33.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.925+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x7fbff8018ae0 2023-10-05T19:50:33.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x7fbff8018ae0 2023-10-05T19:50:33.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cb9f20 2023-10-05T19:50:33.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cb9f20 2023-10-05T19:50:33.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cbdcd0 2023-10-05T19:50:33.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8006070 con 0x5623a4cbdcd0 2023-10-05T19:50:33.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cb9f20 2023-10-05T19:50:33.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.929+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2510 con 0x5623a4cb9f20 2023-10-05T19:50:33.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cbeca0 con 0x5623a4c86230 2023-10-05T19:50:33.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cbf620 con 0x5623a4cb9f20 2023-10-05T19:50:33.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cbe860 con 0x5623a4cb9f20 2023-10-05T19:50:33.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.933+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc2e70 con 0x5623a4cbdcd0 2023-10-05T19:50:33.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fbfe8006070 con 0x5623a4cbdcd0 2023-10-05T19:50:33.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4c86230 2023-10-05T19:50:33.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc35d0 con 0x5623a4cb9f20 2023-10-05T19:50:33.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc4990 con 0x5623a4cbdcd0 2023-10-05T19:50:33.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc4990 con 0x5623a4cb9f20 2023-10-05T19:50:33.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.937+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc35d0 con 0x7fbff8018ae0 2023-10-05T19:50:33.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x7fbff8018ae0 2023-10-05T19:50:33.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4c86230 2023-10-05T19:50:33.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4c86230 2023-10-05T19:50:33.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4cbdcd0 2023-10-05T19:50:33.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4c86230 2023-10-05T19:50:33.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4cb9f20 2023-10-05T19:50:33.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.941+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4cb9f20 2023-10-05T19:50:33.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4c86230 2023-10-05T19:50:33.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x7fbff8018ae0 2023-10-05T19:50:33.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x7fbff8018ae0 2023-10-05T19:50:33.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4c86230 2023-10-05T19:50:33.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x7fbff8018ae0 2023-10-05T19:50:33.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x7fbff8018ae0 2023-10-05T19:50:33.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4cb9f20 2023-10-05T19:50:33.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.945+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3220 con 0x5623a4cbdcd0 2023-10-05T19:50:33.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4c86230 2023-10-05T19:50:33.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4cb9f20 2023-10-05T19:50:33.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4c86230 2023-10-05T19:50:33.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0014040 con 0x5623a4c86230 2023-10-05T19:50:33.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4c86230 2023-10-05T19:50:33.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:33.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.949+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4c86230 2023-10-05T19:50:33.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:33.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x7fbff8018ae0 2023-10-05T19:50:33.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:33.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4c86230 2023-10-05T19:50:33.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:33.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x7fbff8018ae0 2023-10-05T19:50:33.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:33.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x7fbff8018ae0 2023-10-05T19:50:33.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:33.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.953+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4cb9f20 2023-10-05T19:50:33.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4cb9f20 2023-10-05T19:50:33.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8010c90 con 0x5623a4cb9f20 2023-10-05T19:50:33.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4cb9f20 2023-10-05T19:50:33.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbfe8028040 con 0x5623a4cb9f20 2023-10-05T19:50:33.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fc001c26e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:33.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fc001c26e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:33.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fc001c26e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:33.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.957+0000 7fc001c26e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:33.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc35d0 con 0x5623a4cb9f20 2023-10-05T19:50:33.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc35d0 con 0x5623a4c86230 2023-10-05T19:50:33.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:33.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:33.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3e70 con 0x5623a4cb9f20 2023-10-05T19:50:33.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:33.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.961+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3e70 con 0x5623a4cb9f20 2023-10-05T19:50:33.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:33.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3e70 con 0x7fbff8018ae0 2023-10-05T19:50:33.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:33.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 zone default found 2023-10-05T19:50:33.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 4 Realm: () 2023-10-05T19:50:33.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:33.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:33.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:33.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 zonegroup default 2023-10-05T19:50:33.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc3e70 con 0x7fbff8018ae0 2023-10-05T19:50:33.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc57f0 con 0x5623a4cbdcd0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc5ba0 con 0x5623a4cbdcd0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:33.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 started sync module instance, tier type = 2023-10-05T19:50:33.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:33.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.965+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc4f00 con 0x5623a4cb9f20 2023-10-05T19:50:33.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.969+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.969+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94711088695824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc5420 con 0x5623a4cb9f20 2023-10-05T19:50:33.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.969+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6980 con 0x5623a4c86230 2023-10-05T19:50:33.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.973+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94711088695824] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.973+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:33.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.973+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94711088701344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc5420 con 0x5623a4c86230 2023-10-05T19:50:33.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.973+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6f40 con 0x5623a4cb9f20 2023-10-05T19:50:33.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.973+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94711088701344] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:33.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.973+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.973+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94711088702448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6f40 con 0x5623a4cb9f20 2023-10-05T19:50:33.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.973+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc7830 con 0x7fbff8018ae0 2023-10-05T19:50:33.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.977+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:33.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.977+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94711088702448] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.977+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94711088706368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc7c80 con 0x7fbff8018ae0 2023-10-05T19:50:33.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.977+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6a50 con 0x5623a4cb9f20 2023-10-05T19:50:33.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.977+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.977+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94711088706368] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:33.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.977+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94711088707472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc7be0 con 0x5623a4cb9f20 2023-10-05T19:50:33.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.977+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc8b80 con 0x5623a4cbdcd0 2023-10-05T19:50:33.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.981+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.981+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94711088711312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc9420 con 0x5623a4cbdcd0 2023-10-05T19:50:33.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.981+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc9e30 con 0x5623a4cbdcd0 2023-10-05T19:50:33.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.981+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94711088707472] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:33.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.981+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.981+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94711088711312] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.981+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94711088710048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cca6d0 con 0x5623a4cbdcd0 2023-10-05T19:50:33.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.981+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4ccaa80 con 0x7fbff8018ae0 2023-10-05T19:50:33.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94711088710048] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:33.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:33.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94711088718304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4ccab20 con 0x7fbff8018ae0 2023-10-05T19:50:33.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 20 add_watcher() i=0 2023-10-05T19:50:33.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 20 add_watcher() i=1 2023-10-05T19:50:33.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 20 add_watcher() i=2 2023-10-05T19:50:33.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 20 add_watcher() i=3 2023-10-05T19:50:33.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 20 add_watcher() i=4 2023-10-05T19:50:33.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 20 add_watcher() i=5 2023-10-05T19:50:33.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 20 add_watcher() i=6 2023-10-05T19:50:33.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94711088718304] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:33.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 20 add_watcher() i=7 2023-10-05T19:50:33.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:33.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4ccdc90 con 0x5623a4c86230 2023-10-05T19:50:33.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:33.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.985+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94711088719408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4ccaf70 con 0x5623a4c86230 2023-10-05T19:50:33.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94711088719408] v30'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:33.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbfcffef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:33.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fc001c26e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:33.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fc001c26e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:33.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fc001c26e40 1 Processor -- start 2023-10-05T19:50:33.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fc001c26e40 1 -- start start 2023-10-05T19:50:33.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fc001c26e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cd85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:33.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fc001c26e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a4cd8b10 con 0x5623a4cd8200 2023-10-05T19:50:33.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbffef5a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cd85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:33.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbffef5a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cd85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47194/0 (socket says 172.21.15.167:47194) 2023-10-05T19:50:33.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbffef5a700 1 -- 172.21.15.167:0/262859354 learned_addr learned my addr 172.21.15.167:0/262859354 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:33.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbffef5a700 1 -- 172.21.15.167:0/262859354 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623a4cd8c50 con 0x5623a4cd8200 2023-10-05T19:50:33.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbffef5a700 1 --2- 172.21.15.167:0/262859354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cd85d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbff802fd80 tx=0x7fbfe8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bad37c2239b03c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:33.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbfcf7ee700 1 -- 172.21.15.167:0/262859354 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfe803b070 con 0x5623a4cd8200 2023-10-05T19:50:33.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbfcf7ee700 1 -- 172.21.15.167:0/262859354 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe8022040 con 0x5623a4cd8200 2023-10-05T19:50:33.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.989+0000 7fbfcf7ee700 1 -- 172.21.15.167:0/262859354 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfe8021040 con 0x5623a4cd8200 2023-10-05T19:50:33.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 -- 172.21.15.167:0/262859354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 msgr2=0x5623a4cd85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:33.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 --2- 172.21.15.167:0/262859354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cd85d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbff802fd80 tx=0x7fbfe8010000 comp rx=0 tx=0).stop 2023-10-05T19:50:33.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 -- 172.21.15.167:0/262859354 shutdown_connections 2023-10-05T19:50:33.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 --2- 172.21.15.167:0/262859354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cd85d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:33.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 -- 172.21.15.167:0/262859354 >> 172.21.15.167:0/262859354 conn(0x5623a4cd35c0 msgr2=0x5623a4cd1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:33.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 -- 172.21.15.167:0/262859354 shutdown_connections 2023-10-05T19:50:33.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 -- 172.21.15.167:0/262859354 wait complete. 2023-10-05T19:50:34.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 Processor -- start 2023-10-05T19:50:34.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 -- start start 2023-10-05T19:50:34.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a4cdebe0 con 0x5623a4cd8200 2023-10-05T19:50:34.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fbffef5a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fbffef5a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cddbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47206/0 (socket says 172.21.15.167:47206) 2023-10-05T19:50:34.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fbffef5a700 1 -- 172.21.15.167:0/2824145177 learned_addr learned my addr 172.21.15.167:0/2824145177 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fbffef5a700 1 -- 172.21.15.167:0/2824145177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623a4bd2bd0 con 0x5623a4cd8200 2023-10-05T19:50:34.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fbffef5a700 1 --2- 172.21.15.167:0/2824145177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cddbe0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5623a4cbf290 tx=0x7fbfe8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fbfcdfeb700 1 -- 172.21.15.167:0/2824145177 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfe8021070 con 0x5623a4cd8200 2023-10-05T19:50:34.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fbfcdfeb700 1 -- 172.21.15.167:0/2824145177 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe8041630 con 0x5623a4cd8200 2023-10-05T19:50:34.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fbfcdfeb700 1 -- 172.21.15.167:0/2824145177 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfe8046070 con 0x5623a4cd8200 2023-10-05T19:50:34.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 -- 172.21.15.167:0/2824145177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5623a4cde1e0 con 0x5623a4cd8200 2023-10-05T19:50:34.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.993+0000 7fc001c26e40 1 -- 172.21.15.167:0/2824145177 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623a4cde680 con 0x5623a4cd8200 2023-10-05T19:50:34.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.997+0000 7fbfcdfeb700 1 -- 172.21.15.167:0/2824145177 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fbfe803e020 con 0x5623a4cd8200 2023-10-05T19:50:34.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.997+0000 7fbfcdfeb700 1 --2- 172.21.15.167:0/2824145177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbf44030c00 0x7fbf440330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.997+0000 7fbfcdfeb700 1 -- 172.21.15.167:0/2824145177 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fbfe802e040 con 0x5623a4cd8200 2023-10-05T19:50:34.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.997+0000 7fbffff5c700 1 --2- 172.21.15.167:0/2824145177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbf44030c00 0x7fbf440330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.997+0000 7fc001c26e40 5 note: GC not initialized 2023-10-05T19:50:34.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.997+0000 7fbffff5c700 1 --2- 172.21.15.167:0/2824145177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbf44030c00 0x7fbf440330b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5623a4ccdd60 tx=0x7fbff000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.997+0000 7fbf3effd700 20 reqs_thread_entry: start 2023-10-05T19:50:34.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.997+0000 7fbf3cff9700 20 reqs_thread_entry: start 2023-10-05T19:50:34.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:33.997+0000 7fc001c26e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:34.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fc001c26e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:34.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fbf32ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:04 2023 2023-10-05T19:50:34.007 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:34.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fc001c26e40 20 get_system_obj_state: rctx=0x7fff22dc6918 obj=default.rgw.meta:users.uid:foo state=0x5623a4b5f0b0 s->prefetch_data=0 2023-10-05T19:50:34.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4d46450 con 0x5623a4c86230 2023-10-05T19:50:34.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fbf327fc700 20 reqs_thread_entry: start 2023-10-05T19:50:34.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:34.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fc001c26e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:34.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fc001c26e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:34.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fc001c26e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4d48ee0 con 0x5623a4c86230 2023-10-05T19:50:34.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:34.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fc001c26e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:34.009 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:34.009 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:34.009 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:34.009 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:34.009 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:34.009 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:34.009 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:34.009 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:34.010 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.011 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.012 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.012 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:34.012 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:34.012 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:34.012 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:34.012 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:34.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.001+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94711088695824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4c9b200 con 0x5623a4cb9f20 2023-10-05T19:50:34.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.005+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94711088695824] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:34.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.005+0000 7fc001c26e40 20 remove_watcher() i=0 2023-10-05T19:50:34.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.005+0000 7fc001c26e40 2 removed watcher, disabling cache 2023-10-05T19:50:34.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.005+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94711088701344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4c9b200 con 0x5623a4c86230 2023-10-05T19:50:34.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.005+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94711088701344] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:34.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.005+0000 7fc001c26e40 20 remove_watcher() i=1 2023-10-05T19:50:34.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.005+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94711088702448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4c9b200 con 0x5623a4cb9f20 2023-10-05T19:50:34.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.009+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94711088702448] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:34.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.009+0000 7fc001c26e40 20 remove_watcher() i=2 2023-10-05T19:50:34.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.009+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94711088706368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6490 con 0x7fbff8018ae0 2023-10-05T19:50:34.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.009+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94711088706368] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:34.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.009+0000 7fc001c26e40 20 remove_watcher() i=3 2023-10-05T19:50:34.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.009+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94711088707472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6490 con 0x5623a4cb9f20 2023-10-05T19:50:34.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.013+0000 7fbfff75b700 1 -- 172.21.15.167:0/1195102468 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94711088707472] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8068040 con 0x5623a4cb9f20 2023-10-05T19:50:34.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.013+0000 7fc001c26e40 20 remove_watcher() i=4 2023-10-05T19:50:34.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.013+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94711088711312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6490 con 0x5623a4cbdcd0 2023-10-05T19:50:34.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.013+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94711088711312] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:34.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.013+0000 7fc001c26e40 20 remove_watcher() i=5 2023-10-05T19:50:34.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.013+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94711088710048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6490 con 0x5623a4cbdcd0 2023-10-05T19:50:34.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.017+0000 7fbffef5a700 1 -- 172.21.15.167:0/1195102468 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94711088710048] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbfe8024040 con 0x5623a4cbdcd0 2023-10-05T19:50:34.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.017+0000 7fc001c26e40 20 remove_watcher() i=6 2023-10-05T19:50:34.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.017+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94711088718304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6490 con 0x7fbff8018ae0 2023-10-05T19:50:34.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.017+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94711088718304] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x7fbff8018ae0 2023-10-05T19:50:34.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.017+0000 7fc001c26e40 20 remove_watcher() i=7 2023-10-05T19:50:34.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fbfcffef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94711088719408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5623a4cc6490 con 0x5623a4c86230 2023-10-05T19:50:34.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94711088719408] v30'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbff0033040 con 0x5623a4c86230 2023-10-05T19:50:34.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5623a4cb9f20 msgr2=0x5623a4cbd160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5623a4cb9f20 0x5623a4cbd160 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5623a4c86230 msgr2=0x5623a4cb9160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5623a4c86230 0x5623a4cb9160 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbff8018ae0 msgr2=0x7fbff80383b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbff8018ae0 0x7fbff80383b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5623a4cbdcd0 msgr2=0x5623a4cc1f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5623a4cbdcd0 0x5623a4cc1f30 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbfe4030c50 msgr2=0x7fbfe4033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbfe4030c50 0x7fbfe4033100 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8001e90 tx=0x7fbfe80013b0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 msgr2=0x5623a4cad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 --2- 172.21.15.167:0/1195102468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4c85920 0x5623a4cad720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbff8005d80 tx=0x7fbff801d000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 reap_dead start 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fbffff5c700 1 -- 172.21.15.167:0/1195102468 reap_dead start 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 shutdown_connections 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 >> 172.21.15.167:0/1195102468 conn(0x5623a4c81340 msgr2=0x5623a4c9ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 shutdown_connections 2023-10-05T19:50:34.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.021+0000 7fc001c26e40 1 -- 172.21.15.167:0/1195102468 wait complete. 2023-10-05T19:50:34.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 -- 172.21.15.167:0/2824145177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbf44030c00 msgr2=0x7fbf440330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 --2- 172.21.15.167:0/2824145177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbf44030c00 0x7fbf440330b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x5623a4ccdd60 tx=0x7fbff000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:34.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 -- 172.21.15.167:0/2824145177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 msgr2=0x5623a4cddbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 --2- 172.21.15.167:0/2824145177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cddbe0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5623a4cbf290 tx=0x7fbfe8037000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 -- 172.21.15.167:0/2824145177 shutdown_connections 2023-10-05T19:50:34.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 --2- 172.21.15.167:0/2824145177 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbf44030c00 0x7fbf440330b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 --2- 172.21.15.167:0/2824145177 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5623a4cd8200 0x5623a4cddbe0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 -- 172.21.15.167:0/2824145177 >> 172.21.15.167:0/2824145177 conn(0x5623a4cd35c0 msgr2=0x5623a4cd16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 -- 172.21.15.167:0/2824145177 shutdown_connections 2023-10-05T19:50:34.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.025+0000 7fc001c26e40 1 -- 172.21.15.167:0/2824145177 wait complete. 2023-10-05T19:50:34.036 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:34.036 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2023-10-05T19:50:34.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2023-10-05T19:50:34.036 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2023-10-05T19:50:34.080 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:34.080 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:34.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.073+0000 7f936dfa8e40 1 Processor -- start 2023-10-05T19:50:34.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.073+0000 7f936dfa8e40 1 -- start start 2023-10-05T19:50:34.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.073+0000 7f936dfa8e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560fdaf140b0 0x560fdaf16490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.073+0000 7f936dfa8e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560fdae5abd0 con 0x560fdaf0fb30 2023-10-05T19:50:34.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.073+0000 7f936dfa8e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x560fdae17ee0 con 0x560fdaf140b0 2023-10-05T19:50:34.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936b2dc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560fdaf140b0 0x560fdaf16490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936badd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x560fdaf0fb30 0x560fdaf0ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39908/0 (socket says 172.21.15.167:39908) 2023-10-05T19:50:34.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936badd700 1 -- 172.21.15.167:0/4250983861 learned_addr learned my addr 172.21.15.167:0/4250983861 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:34.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936aadb700 1 -- 172.21.15.167:0/4250983861 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982035818 0 0) 0x560fdae5abd0 con 0x560fdaf0fb30 2023-10-05T19:50:34.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936aadb700 1 -- 172.21.15.167:0/4250983861 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9358001e10 con 0x560fdaf0fb30 2023-10-05T19:50:34.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936b2dc700 1 -- 172.21.15.167:0/4250983861 >> v1:172.21.15.118:6789/0 conn(0x560fdaf0fb30 legacy=0x560fdaf0ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936b2dc700 1 -- 172.21.15.167:0/4250983861 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fdaf10740 con 0x560fdaf140b0 2023-10-05T19:50:34.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936b2dc700 1 --2- 172.21.15.167:0/4250983861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf140b0 0x560fdaf16490 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f935400a5d0 tx=0x7f9354005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d7e6c5f5815680 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936aadb700 1 -- 172.21.15.167:0/4250983861 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9354007610 con 0x560fdaf140b0 2023-10-05T19:50:34.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936aadb700 1 -- 172.21.15.167:0/4250983861 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354007770 con 0x560fdaf140b0 2023-10-05T19:50:34.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936aadb700 1 -- 172.21.15.167:0/4250983861 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9354007a40 con 0x560fdaf140b0 2023-10-05T19:50:34.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 -- 172.21.15.167:0/4250983861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf140b0 msgr2=0x560fdaf16490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/4250983861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf140b0 0x560fdaf16490 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f935400a5d0 tx=0x7f9354005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:34.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 -- 172.21.15.167:0/4250983861 shutdown_connections 2023-10-05T19:50:34.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/4250983861 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf140b0 0x560fdaf16490 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 -- 172.21.15.167:0/4250983861 >> 172.21.15.167:0/4250983861 conn(0x560fdae834e0 msgr2=0x560fdaf0de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 -- 172.21.15.167:0/4250983861 shutdown_connections 2023-10-05T19:50:34.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 -- 172.21.15.167:0/4250983861 wait complete. 2023-10-05T19:50:34.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 Processor -- start 2023-10-05T19:50:34.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 -- start start 2023-10-05T19:50:34.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf2eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936dfa8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fdaddbe30 con 0x560fdaf0fb30 2023-10-05T19:50:34.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936badd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf2eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936badd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf2eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47224/0 (socket says 172.21.15.167:47224) 2023-10-05T19:50:34.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.077+0000 7f936badd700 1 -- 172.21.15.167:0/3489946117 learned_addr learned my addr 172.21.15.167:0/3489946117 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936badd700 1 -- 172.21.15.167:0/3489946117 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9354005cf0 con 0x560fdaf0fb30 2023-10-05T19:50:34.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936badd700 1 --2- 172.21.15.167:0/3489946117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf2eb10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f935c001c70 tx=0x7f935c001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3efe86e874d2553 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f9369ad9700 1 -- 172.21.15.167:0/3489946117 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935c00bbf0 con 0x560fdaf0fb30 2023-10-05T19:50:34.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f9369ad9700 1 -- 172.21.15.167:0/3489946117 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c00bd70 con 0x560fdaf0fb30 2023-10-05T19:50:34.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f9369ad9700 1 -- 172.21.15.167:0/3489946117 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935c00e5f0 con 0x560fdaf0fb30 2023-10-05T19:50:34.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 -- 172.21.15.167:0/3489946117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 msgr2=0x560fdaf2eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/3489946117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf2eb10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f935c001c70 tx=0x7f935c001820 comp rx=0 tx=0).stop 2023-10-05T19:50:34.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 -- 172.21.15.167:0/3489946117 shutdown_connections 2023-10-05T19:50:34.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/3489946117 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf2eb10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 -- 172.21.15.167:0/3489946117 >> 172.21.15.167:0/3489946117 conn(0x560fdae834e0 msgr2=0x560fdaf2a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 -- 172.21.15.167:0/3489946117 shutdown_connections 2023-10-05T19:50:34.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 -- 172.21.15.167:0/3489946117 wait complete. 2023-10-05T19:50:34.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 Processor -- start 2023-10-05T19:50:34.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 -- start start 2023-10-05T19:50:34.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf358a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936dfa8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fdadaeed0 con 0x560fdaf0fb30 2023-10-05T19:50:34.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936badd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936badd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf358a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47226/0 (socket says 172.21.15.167:47226) 2023-10-05T19:50:34.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 learned_addr learned my addr 172.21.15.167:0/1593532597 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.081+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9358001e10 con 0x560fdaf0fb30 2023-10-05T19:50:34.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f936badd700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf358a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x560fdaf2b170 tx=0x7f935c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f9363fff700 1 -- 172.21.15.167:0/1593532597 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935c01f070 con 0x560fdaf0fb30 2023-10-05T19:50:34.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f9363fff700 1 -- 172.21.15.167:0/1593532597 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c018640 con 0x560fdaf0fb30 2023-10-05T19:50:34.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f9363fff700 1 -- 172.21.15.167:0/1593532597 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935c018930 con 0x560fdaf0fb30 2023-10-05T19:50:34.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fdaf35de0 con 0x560fdaf0fb30 2023-10-05T19:50:34.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fdaf36220 con 0x560fdaf0fb30 2023-10-05T19:50:34.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f9363fff700 1 -- 172.21.15.167:0/1593532597 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f935c018ae0 con 0x560fdaf0fb30 2023-10-05T19:50:34.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f9363fff700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f934c030c00 0x7f934c0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f9363fff700 1 -- 172.21.15.167:0/1593532597 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f935c045170 con 0x560fdaf0fb30 2023-10-05T19:50:34.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f936b2dc700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f934c030c00 0x7f934c0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fdaf140b0 0x560fdaf412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf41a10 con 0x560fdaf140b0 2023-10-05T19:50:34.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f936c2de700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fdaf140b0 0x560fdaf412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.085+0000 7f936b2dc700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f934c030c00 0x7f934c0330b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f935400afd0 tx=0x7f9354014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936c2de700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fdaf140b0 0x560fdaf412e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 20 realm 2023-10-05T19:50:34.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf3e8c0 con 0x560fdaf140b0 2023-10-05T19:50:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf424f0 con 0x560fdaf140b0 2023-10-05T19:50:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fdaf43320 0x560fdaf45700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf45c40 con 0x560fdaf43320 2023-10-05T19:50:34.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936badd700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fdaf43320 0x560fdaf45700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936badd700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fdaf43320 0x560fdaf45700 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.089+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf464e0 con 0x560fdaf140b0 2023-10-05T19:50:34.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936dfa8e40 20 searching for the correct realm 2023-10-05T19:50:34.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fdaf482a0 0x560fdaf4a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf482a0 2023-10-05T19:50:34.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936b2dc700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fdaf482a0 0x560fdaf4a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936b2dc700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fdaf482a0 0x560fdaf4a680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9354007da0 con 0x560fdaf482a0 2023-10-05T19:50:34.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf43320 2023-10-05T19:50:34.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936badd700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f935c016730 0x7f935c022590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x7f935c016730 2023-10-05T19:50:34.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936c2de700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f935c016730 0x7f935c022590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936c2de700 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f935c016730 0x7f935c022590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.093+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf482a0 2023-10-05T19:50:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf43320 2023-10-05T19:50:34.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf43320 2023-10-05T19:50:34.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.097+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x7f935c016730 2023-10-05T19:50:34.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x7f935c016730 2023-10-05T19:50:34.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf43320 2023-10-05T19:50:34.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf482a0 2023-10-05T19:50:34.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.101+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf43320 2023-10-05T19:50:34.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf482a0 2023-10-05T19:50:34.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf482a0 2023-10-05T19:50:34.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x7f935c016730 2023-10-05T19:50:34.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.105+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf140b0 2023-10-05T19:50:34.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x7f935c016730 2023-10-05T19:50:34.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf482a0 2023-10-05T19:50:34.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x7f935c016730 2023-10-05T19:50:34.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf43320 2023-10-05T19:50:34.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf43320 2023-10-05T19:50:34.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.109+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf482a0 2023-10-05T19:50:34.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf43320 2023-10-05T19:50:34.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4abc0 con 0x560fdaf43320 2023-10-05T19:50:34.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf47050 con 0x560fdaf140b0 2023-10-05T19:50:34.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf479a0 con 0x560fdaf43320 2023-10-05T19:50:34.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.113+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4af70 con 0x560fdaf43320 2023-10-05T19:50:34.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4b320 con 0x560fdaf482a0 2023-10-05T19:50:34.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4b6d0 con 0x560fdaf140b0 2023-10-05T19:50:34.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf47540 con 0x560fdaf43320 2023-10-05T19:50:34.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf482a0 2023-10-05T19:50:34.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.117+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf43320 2023-10-05T19:50:34.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x7f935c016730 2023-10-05T19:50:34.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf482a0 2023-10-05T19:50:34.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf43320 2023-10-05T19:50:34.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.121+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf43320 2023-10-05T19:50:34.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x7f935c016730 2023-10-05T19:50:34.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x7f935c016730 2023-10-05T19:50:34.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf43320 2023-10-05T19:50:34.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.125+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf482a0 2023-10-05T19:50:34.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf43320 2023-10-05T19:50:34.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf482a0 2023-10-05T19:50:34.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.129+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf482a0 2023-10-05T19:50:34.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x7f935c016730 2023-10-05T19:50:34.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf140b0 2023-10-05T19:50:34.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x7f935c016730 2023-10-05T19:50:34.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf482a0 2023-10-05T19:50:34.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x7f935c016730 2023-10-05T19:50:34.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.133+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf43320 2023-10-05T19:50:34.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf43320 2023-10-05T19:50:34.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf482a0 2023-10-05T19:50:34.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf43320 2023-10-05T19:50:34.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4cfd0 con 0x560fdaf43320 2023-10-05T19:50:34.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936dfa8e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936dfa8e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936dfa8e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936dfa8e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.137+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4bfc0 con 0x560fdaf43320 2023-10-05T19:50:34.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4bfc0 con 0x560fdaf140b0 2023-10-05T19:50:34.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4c8b0 con 0x560fdaf43320 2023-10-05T19:50:34.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4c8b0 con 0x560fdaf43320 2023-10-05T19:50:34.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.141+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4c8b0 con 0x7f935c016730 2023-10-05T19:50:34.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 zone default found 2023-10-05T19:50:34.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 4 Realm: () 2023-10-05T19:50:34.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:34.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:34.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:34.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 zonegroup default 2023-10-05T19:50:34.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4c8b0 con 0x7f935c016730 2023-10-05T19:50:34.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4c8b0 con 0x560fdaf482a0 2023-10-05T19:50:34.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4ed00 con 0x560fdaf482a0 2023-10-05T19:50:34.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 started sync module instance, tier type = 2023-10-05T19:50:34.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:34.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.145+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4e3c0 con 0x560fdaf43320 2023-10-05T19:50:34.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.149+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.149+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94626097972160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4e3c0 con 0x560fdaf43320 2023-10-05T19:50:34.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.149+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4f5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.149+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94626097972160] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.149+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.149+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94626097981376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4e3c0 con 0x560fdaf140b0 2023-10-05T19:50:34.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.153+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4fc00 con 0x560fdaf43320 2023-10-05T19:50:34.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.153+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94626097981376] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.153+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.153+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94626097983664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4fc00 con 0x560fdaf43320 2023-10-05T19:50:34.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.153+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf504f0 con 0x7f935c016730 2023-10-05T19:50:34.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.157+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.157+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94626097987584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf50450 con 0x7f935c016730 2023-10-05T19:50:34.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.157+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf51440 con 0x560fdaf43320 2023-10-05T19:50:34.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.157+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94626097983664] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.157+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94626097987584] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.157+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.157+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94626097989872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf50f50 con 0x560fdaf43320 2023-10-05T19:50:34.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.157+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf517f0 con 0x560fdaf482a0 2023-10-05T19:50:34.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94626097992064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf52090 con 0x560fdaf482a0 2023-10-05T19:50:34.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf52aa0 con 0x560fdaf482a0 2023-10-05T19:50:34.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94626097989872] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94626097992064] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94626097997232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf52ea0 con 0x560fdaf482a0 2023-10-05T19:50:34.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf53740 con 0x7f935c016730 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94626098001024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf53dc0 con 0x7f935c016730 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94626097997232] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935401f480 con 0x560fdaf482a0 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 20 add_watcher() i=0 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 20 add_watcher() i=1 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 20 add_watcher() i=2 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 20 add_watcher() i=3 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 20 add_watcher() i=4 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 20 add_watcher() i=5 2023-10-05T19:50:34.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.161+0000 7f936dfa8e40 20 add_watcher() i=6 2023-10-05T19:50:34.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94626098001024] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x7f935c016730 2023-10-05T19:50:34.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936dfa8e40 20 add_watcher() i=7 2023-10-05T19:50:34.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936dfa8e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:34.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4f800 con 0x560fdaf140b0 2023-10-05T19:50:34.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94626098002128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf4f800 con 0x560fdaf140b0 2023-10-05T19:50:34.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94626098002128] v30'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f936400a5a0 con 0x560fdaf140b0 2023-10-05T19:50:34.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f933d7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936dfa8e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:34.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936dfa8e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:34.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936dfa8e40 1 Processor -- start 2023-10-05T19:50:34.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.165+0000 7f936dfa8e40 1 -- start start 2023-10-05T19:50:34.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fdaf61d30 con 0x560fdaf61420 2023-10-05T19:50:34.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936b2dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936b2dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf617f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47230/0 (socket says 172.21.15.167:47230) 2023-10-05T19:50:34.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936b2dc700 1 -- 172.21.15.167:0/2648547755 learned_addr learned my addr 172.21.15.167:0/2648547755 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936b2dc700 1 -- 172.21.15.167:0/2648547755 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fdaf61e70 con 0x560fdaf61420 2023-10-05T19:50:34.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936b2dc700 1 --2- 172.21.15.167:0/2648547755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf617f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x560fdaf10b50 tx=0x7f9354011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65a1f0cd3f2e5c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f933cfe1700 1 -- 172.21.15.167:0/2648547755 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9354025040 con 0x560fdaf61420 2023-10-05T19:50:34.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f933cfe1700 1 -- 172.21.15.167:0/2648547755 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354031040 con 0x560fdaf61420 2023-10-05T19:50:34.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f933cfe1700 1 -- 172.21.15.167:0/2648547755 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f935402b8a0 con 0x560fdaf61420 2023-10-05T19:50:34.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2648547755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 msgr2=0x560fdaf617f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/2648547755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf617f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x560fdaf10b50 tx=0x7f9354011000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2648547755 shutdown_connections 2023-10-05T19:50:34.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/2648547755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf617f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2648547755 >> 172.21.15.167:0/2648547755 conn(0x560fdaf5c7e0 msgr2=0x560fdaf5a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2648547755 shutdown_connections 2023-10-05T19:50:34.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2648547755 wait complete. 2023-10-05T19:50:34.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 Processor -- start 2023-10-05T19:50:34.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 -- start start 2023-10-05T19:50:34.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.169+0000 7f936dfa8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf66e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936dfa8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fdaf67e50 con 0x560fdaf61420 2023-10-05T19:50:34.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936b2dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf66e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936b2dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf66e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47246/0 (socket says 172.21.15.167:47246) 2023-10-05T19:50:34.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936b2dc700 1 -- 172.21.15.167:0/2597711555 learned_addr learned my addr 172.21.15.167:0/2597711555 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936b2dc700 1 -- 172.21.15.167:0/2597711555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fdaf10740 con 0x560fdaf61420 2023-10-05T19:50:34.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936b2dc700 1 --2- 172.21.15.167:0/2597711555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf66e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x560fdaf5b4a0 tx=0x7f9354036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f92b6ffd700 1 -- 172.21.15.167:0/2597711555 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9354025030 con 0x560fdaf61420 2023-10-05T19:50:34.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f92b6ffd700 1 -- 172.21.15.167:0/2597711555 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354037cd0 con 0x560fdaf61420 2023-10-05T19:50:34.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f92b6ffd700 1 -- 172.21.15.167:0/2597711555 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9354037ea0 con 0x560fdaf61420 2023-10-05T19:50:34.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2597711555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fdaf67450 con 0x560fdaf61420 2023-10-05T19:50:34.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2597711555 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fdaf678f0 con 0x560fdaf61420 2023-10-05T19:50:34.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f92b6ffd700 1 -- 172.21.15.167:0/2597711555 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9354028040 con 0x560fdaf61420 2023-10-05T19:50:34.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f92b6ffd700 1 --2- 172.21.15.167:0/2597711555 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f92ac030c00 0x7f92ac0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f92b6ffd700 1 -- 172.21.15.167:0/2597711555 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f935404ac20 con 0x560fdaf61420 2023-10-05T19:50:34.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936c2de700 1 --2- 172.21.15.167:0/2597711555 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f92ac030c00 0x7f92ac0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.173+0000 7f936dfa8e40 5 note: GC not initialized 2023-10-05T19:50:34.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936c2de700 1 --2- 172.21.15.167:0/2597711555 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f92ac030c00 0x7f92ac0330b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x560fdaf53d90 tx=0x7f936400ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f92abfff700 20 reqs_thread_entry: start 2023-10-05T19:50:34.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f92a9ffb700 20 reqs_thread_entry: start 2023-10-05T19:50:34.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:34.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f92977fe700 20 reqs_thread_entry: start 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 20 get_system_obj_state: rctx=0x7ffe458e7928 obj=default.rgw.meta:users.uid:foo state=0x560fdade70b0 s->prefetch_data=0 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdafcf620 con 0x560fdaf140b0 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f9297fff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:04 2023 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f936403d050 con 0x560fdaf140b0 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:34.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:34.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:34.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:34.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.177+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdafd20b0 con 0x560fdaf140b0 2023-10-05T19:50:34.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f936403d050 con 0x560fdaf140b0 2023-10-05T19:50:34.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:34.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:34.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:34.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 20 get_system_obj_state: rctx=0x7ffe458e73c8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x560fdade70b0 s->prefetch_data=0 2023-10-05T19:50:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-10-05T19:50:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdafd0090 con 0x560fdaf482a0 2023-10-05T19:50:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 p5YnriCv1nAtykxBrupQ [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f935403d020 con 0x560fdaf482a0 2023-10-05T19:50:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-10-05T19:50:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:50:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 20 get_system_obj_state: rctx=0x7ffe458e78e8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x560fdade70b0 s->prefetch_data=0 2023-10-05T19:50:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T19:50:34.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~459 in=459b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdafd34b0 con 0x560fdaf140b0 2023-10-05T19:50:34.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~459] v30'4 uv4 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f936403d050 con 0x560fdaf140b0 2023-10-05T19:50:34.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:34.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:34.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.181+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94626098523808 in=647b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdafd2150 con 0x560fdaf43320 2023-10-05T19:50:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94626097989872 notify 128849018883 ret 0) v3 ==== 677+0+0 (crc 0 0 0) 0x560fdaf36220 con 0x560fdaf43320 2023-10-05T19:50:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f93692d8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94626097989872 notifier 4325 bl.length()=635 2023-10-05T19:50:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f93692d8700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.4 [notify cookie 94626098523808 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f93692d8700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f93692d8700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9350003d90 con 0x560fdaf43320 2023-10-05T19:50:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== watch-notify(notify_complete (2) cookie 94626098523808 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560fdaf35de0 con 0x560fdaf43320 2023-10-05T19:50:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdafd2ea0 con 0x560fdaf482a0 2023-10-05T19:50:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f935403d020 con 0x560fdaf482a0 2023-10-05T19:50:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936dfa8e40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T19:50:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936dfa8e40 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:50:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936dfa8e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T19:50:34.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.185+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify cookie 94626098523808 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdafd1d90 con 0x560fdaf43320 2023-10-05T19:50:34.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== watch-notify(notify (1) cookie 94626097983664 notify 128849018884 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x560fdaf35de0 con 0x560fdaf43320 2023-10-05T19:50:34.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f93692d8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94626097983664 notifier 4325 bl.length()=177 2023-10-05T19:50:34.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f93692d8700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T19:50:34.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f93692d8700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:50:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(109 notify.2 [notify cookie 94626098523808 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f93692d8700 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9350003d90 con 0x560fdaf43320 2023-10-05T19:50:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== watch-notify(notify_complete (2) cookie 94626098523808 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f9358001e10 con 0x560fdaf43320 2023-10-05T19:50:34.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(110 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:34.196 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:34.197 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.198 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.199 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.199 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.199 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:34.199 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:34.199 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:34.199 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:34.199 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94626097972160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf25330 con 0x560fdaf43320 2023-10-05T19:50:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.189+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(111 notify.0 [watch unwatch cookie 94626097972160] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.193+0000 7f936dfa8e40 20 remove_watcher() i=0 2023-10-05T19:50:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.193+0000 7f936dfa8e40 2 removed watcher, disabling cache 2023-10-05T19:50:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.193+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94626097981376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf25330 con 0x560fdaf140b0 2023-10-05T19:50:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.193+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 notify.1 [watch unwatch cookie 94626097981376] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f936403d050 con 0x560fdaf140b0 2023-10-05T19:50:34.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.193+0000 7f936dfa8e40 20 remove_watcher() i=1 2023-10-05T19:50:34.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.193+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94626097983664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf25330 con 0x560fdaf43320 2023-10-05T19:50:34.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.193+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(113 notify.2 [watch unwatch cookie 94626097983664] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.193+0000 7f936dfa8e40 20 remove_watcher() i=2 2023-10-05T19:50:34.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.193+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94626097987584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf25330 con 0x7f935c016730 2023-10-05T19:50:34.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.197+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(114 notify.3 [watch unwatch cookie 94626097987584] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f936403d050 con 0x7f935c016730 2023-10-05T19:50:34.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.197+0000 7f936dfa8e40 20 remove_watcher() i=3 2023-10-05T19:50:34.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.197+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:115 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94626097989872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf25330 con 0x560fdaf43320 2023-10-05T19:50:34.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.197+0000 7f936badd700 1 -- 172.21.15.167:0/1593532597 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(115 notify.4 [watch unwatch cookie 94626097989872] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935c035040 con 0x560fdaf43320 2023-10-05T19:50:34.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.197+0000 7f936dfa8e40 20 remove_watcher() i=4 2023-10-05T19:50:34.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.197+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94626097992064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf25330 con 0x560fdaf482a0 2023-10-05T19:50:34.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.201+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(116 notify.5 [watch unwatch cookie 94626097992064] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935403d020 con 0x560fdaf482a0 2023-10-05T19:50:34.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.201+0000 7f936dfa8e40 20 remove_watcher() i=5 2023-10-05T19:50:34.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.201+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94626097997232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf25330 con 0x560fdaf482a0 2023-10-05T19:50:34.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.201+0000 7f936b2dc700 1 -- 172.21.15.167:0/1593532597 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(117 notify.6 [watch unwatch cookie 94626097997232] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f935403d020 con 0x560fdaf482a0 2023-10-05T19:50:34.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.201+0000 7f936dfa8e40 20 remove_watcher() i=6 2023-10-05T19:50:34.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.201+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:118 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94626098001024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf25330 con 0x7f935c016730 2023-10-05T19:50:34.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.205+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(118 notify.7 [watch unwatch cookie 94626098001024] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f936403d050 con 0x7f935c016730 2023-10-05T19:50:34.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.205+0000 7f936dfa8e40 20 remove_watcher() i=7 2023-10-05T19:50:34.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.205+0000 7f933d7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.205+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:119 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94626098002128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fdaf25330 con 0x560fdaf140b0 2023-10-05T19:50:34.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(119 data_loggenerations_metadata [watch unwatch cookie 94626098002128] v30'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f936403d050 con 0x560fdaf140b0 2023-10-05T19:50:34.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fdaf43320 msgr2=0x560fdaf45700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fdaf43320 0x560fdaf45700 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fdaf140b0 msgr2=0x560fdaf412e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fdaf140b0 0x560fdaf412e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f935c016730 msgr2=0x7f935c022590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f935c016730 0x7f935c022590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fdaf482a0 msgr2=0x560fdaf4a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fdaf482a0 0x560fdaf4a680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f934c030c00 msgr2=0x7f934c0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f934c030c00 0x7f934c0330b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f935400afd0 tx=0x7f9354014000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 msgr2=0x560fdaf358a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/1593532597 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf0fb30 0x560fdaf358a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x560fdaf2b170 tx=0x7f935c016000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 reap_dead start 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936c2de700 1 -- 172.21.15.167:0/1593532597 reap_dead start 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 shutdown_connections 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 >> 172.21.15.167:0/1593532597 conn(0x560fdae834e0 msgr2=0x560fdaf290d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 shutdown_connections 2023-10-05T19:50:34.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/1593532597 wait complete. 2023-10-05T19:50:34.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2597711555 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f92ac030c00 msgr2=0x7f92ac0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/2597711555 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f92ac030c00 0x7f92ac0330b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x560fdaf53d90 tx=0x7f936400ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:34.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2597711555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 msgr2=0x560fdaf66e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/2597711555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf66e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x560fdaf5b4a0 tx=0x7f9354036000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2597711555 shutdown_connections 2023-10-05T19:50:34.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/2597711555 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f92ac030c00 0x7f92ac0330b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 --2- 172.21.15.167:0/2597711555 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fdaf61420 0x560fdaf66e50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2597711555 >> 172.21.15.167:0/2597711555 conn(0x560fdaf5c7e0 msgr2=0x560fdaf5a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2597711555 shutdown_connections 2023-10-05T19:50:34.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.209+0000 7f936dfa8e40 1 -- 172.21.15.167:0/2597711555 wait complete. 2023-10-05T19:50:34.222 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:34.223 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T19:50:34.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T19:50:34.223 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T19:50:34.261 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:34.261 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:34.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 Processor -- start 2023-10-05T19:50:34.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 -- start start 2023-10-05T19:50:34.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5642d3624f00 0x5642d36272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5642d356dbd0 con 0x5642d3620920 2023-10-05T19:50:34.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5642d352aee0 con 0x5642d3624f00 2023-10-05T19:50:34.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f8797c6a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5642d3624f00 0x5642d36272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f8797c6a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5642d3624f00 0x5642d36272e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47258/0 (socket says 172.21.15.167:47258) 2023-10-05T19:50:34.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f8797c6a700 1 -- 172.21.15.167:0/1512970667 learned_addr learned my addr 172.21.15.167:0/1512970667 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879846b700 1 --1- 172.21.15.167:0/1512970667 >> v1:172.21.15.118:6789/0 conn(0x5642d3620920 0x5642d3620cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39924/0 (socket says 172.21.15.167:39924) 2023-10-05T19:50:34.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f8797c6a700 1 -- 172.21.15.167:0/1512970667 >> v1:172.21.15.118:6789/0 conn(0x5642d3620920 legacy=0x5642d3620cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f8797c6a700 1 -- 172.21.15.167:0/1512970667 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d3621530 con 0x5642d3624f00 2023-10-05T19:50:34.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f8797c6a700 1 --2- 172.21.15.167:0/1512970667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3624f00 0x5642d36272e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f878c00a650 tx=0x7f878c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761f7d4742378e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f8797469700 1 -- 172.21.15.167:0/1512970667 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f878c008760 con 0x5642d3624f00 2023-10-05T19:50:34.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f8797469700 1 -- 172.21.15.167:0/1512970667 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c0088c0 con 0x5642d3624f00 2023-10-05T19:50:34.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f8797469700 1 -- 172.21.15.167:0/1512970667 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f878c008bb0 con 0x5642d3624f00 2023-10-05T19:50:34.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 -- 172.21.15.167:0/1512970667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3624f00 msgr2=0x5642d36272e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 --2- 172.21.15.167:0/1512970667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3624f00 0x5642d36272e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f878c00a650 tx=0x7f878c005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:34.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 -- 172.21.15.167:0/1512970667 shutdown_connections 2023-10-05T19:50:34.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 --2- 172.21.15.167:0/1512970667 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3624f00 0x5642d36272e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 -- 172.21.15.167:0/1512970667 >> 172.21.15.167:0/1512970667 conn(0x5642d361c340 msgr2=0x5642d361e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 -- 172.21.15.167:0/1512970667 shutdown_connections 2023-10-05T19:50:34.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 -- 172.21.15.167:0/1512970667 wait complete. 2023-10-05T19:50:34.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 Processor -- start 2023-10-05T19:50:34.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.257+0000 7f879a936e40 1 -- start start 2023-10-05T19:50:34.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d3596230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d34eee30 con 0x5642d3620920 2023-10-05T19:50:34.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879846b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d3596230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879846b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d3596230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47268/0 (socket says 172.21.15.167:47268) 2023-10-05T19:50:34.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879846b700 1 -- 172.21.15.167:0/2240584288 learned_addr learned my addr 172.21.15.167:0/2240584288 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879846b700 1 -- 172.21.15.167:0/2240584288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c005db0 con 0x5642d3620920 2023-10-05T19:50:34.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879846b700 1 --2- 172.21.15.167:0/2240584288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d3596230 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f87880014a0 tx=0x7f8788006b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7e835e4dce2568 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f8796467700 1 -- 172.21.15.167:0/2240584288 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8788006110 con 0x5642d3620920 2023-10-05T19:50:34.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f8796467700 1 -- 172.21.15.167:0/2240584288 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8788006270 con 0x5642d3620920 2023-10-05T19:50:34.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f8796467700 1 -- 172.21.15.167:0/2240584288 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87880135a0 con 0x5642d3620920 2023-10-05T19:50:34.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 -- 172.21.15.167:0/2240584288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 msgr2=0x5642d3596230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 --2- 172.21.15.167:0/2240584288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d3596230 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f87880014a0 tx=0x7f8788006b90 comp rx=0 tx=0).stop 2023-10-05T19:50:34.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 -- 172.21.15.167:0/2240584288 shutdown_connections 2023-10-05T19:50:34.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 --2- 172.21.15.167:0/2240584288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d3596230 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 -- 172.21.15.167:0/2240584288 >> 172.21.15.167:0/2240584288 conn(0x5642d361c340 msgr2=0x5642d363b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 -- 172.21.15.167:0/2240584288 shutdown_connections 2023-10-05T19:50:34.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 -- 172.21.15.167:0/2240584288 wait complete. 2023-10-05T19:50:34.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 Processor -- start 2023-10-05T19:50:34.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 -- start start 2023-10-05T19:50:34.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d36489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879a936e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d34c1ed0 con 0x5642d3620920 2023-10-05T19:50:34.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879846b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d36489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879846b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d36489f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47284/0 (socket says 172.21.15.167:47284) 2023-10-05T19:50:34.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.261+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 learned_addr learned my addr 172.21.15.167:0/1133249844 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d356dbd0 con 0x5642d3620920 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f879846b700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d36489f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8788006bd0 tx=0x7f8788014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f8794c64700 1 -- 172.21.15.167:0/1133249844 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8788003660 con 0x5642d3620920 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f8794c64700 1 -- 172.21.15.167:0/1133249844 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87880037c0 con 0x5642d3620920 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5642d3648f30 con 0x5642d3620920 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f8794c64700 1 -- 172.21.15.167:0/1133249844 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8788003a90 con 0x5642d3620920 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642d3649370 con 0x5642d3620920 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f8794c64700 1 -- 172.21.15.167:0/1133249844 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f8788003c90 con 0x5642d3620920 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f8794c64700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8784030bf0 0x7f87840330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f8794c64700 1 -- 172.21.15.167:0/1133249844 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f87880452d0 con 0x5642d3620920 2023-10-05T19:50:34.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f8797c6a700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8784030bf0 0x7f87840330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5642d3624f00 0x5642d3654460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3654b90 con 0x5642d3624f00 2023-10-05T19:50:34.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.265+0000 7f8798c6c700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5642d3624f00 0x5642d3654460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f8797c6a700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8784030bf0 0x7f87840330a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f878c0030a0 tx=0x7f878c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f8798c6c700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5642d3624f00 0x5642d3654460 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f879000a500 con 0x5642d3624f00 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 20 realm 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3651a00 con 0x5642d3624f00 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f879000a500 con 0x5642d3624f00 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:34.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3655670 con 0x5642d3624f00 2023-10-05T19:50:34.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f879000a500 con 0x5642d3624f00 2023-10-05T19:50:34.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5642d3655270 0x5642d3658480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3658b80 con 0x5642d3655270 2023-10-05T19:50:34.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879846b700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5642d3655270 0x5642d3658480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.269+0000 7f879846b700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5642d3655270 0x5642d3658480 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3659450 con 0x5642d3624f00 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f879000a500 con 0x5642d3624f00 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879a936e40 20 searching for the correct realm 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5642d3658fc0 0x5642d365d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3658fc0 2023-10-05T19:50:34.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f8797c6a700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5642d3658fc0 0x5642d365d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f8797c6a700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5642d3658fc0 0x5642d365d220 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3655270 2023-10-05T19:50:34.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879846b700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8788026360 0x7f8788043a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x7f8788026360 2023-10-05T19:50:34.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f8798c6c700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8788026360 0x7f8788043a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.273+0000 7f8798c6c700 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8788026360 0x7f8788043a50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x7f8788026360 2023-10-05T19:50:34.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3658fc0 2023-10-05T19:50:34.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3655270 2023-10-05T19:50:34.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3655270 2023-10-05T19:50:34.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.277+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x7f8788026360 2023-10-05T19:50:34.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x7f8788026360 2023-10-05T19:50:34.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x7f8788026360 2023-10-05T19:50:34.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x7f8788026360 2023-10-05T19:50:34.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3655270 2023-10-05T19:50:34.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3658fc0 2023-10-05T19:50:34.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.281+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3655270 2023-10-05T19:50:34.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3658fc0 2023-10-05T19:50:34.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3658fc0 2023-10-05T19:50:34.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.285+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x7f8788026360 2023-10-05T19:50:34.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x7f8788026360 2023-10-05T19:50:34.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3624f00 2023-10-05T19:50:34.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x7f8788026360 2023-10-05T19:50:34.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x7f8788026360 2023-10-05T19:50:34.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3658fc0 2023-10-05T19:50:34.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x7f8788026360 2023-10-05T19:50:34.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x7f8788026360 2023-10-05T19:50:34.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3655270 2023-10-05T19:50:34.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.289+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3655270 2023-10-05T19:50:34.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3658fc0 2023-10-05T19:50:34.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3655270 2023-10-05T19:50:34.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365d800 con 0x5642d3655270 2023-10-05T19:50:34.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879a936e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879a936e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879a936e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879a936e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3659f90 con 0x5642d3624f00 2023-10-05T19:50:34.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.293+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365a8e0 con 0x5642d3655270 2023-10-05T19:50:34.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3659b50 con 0x5642d3655270 2023-10-05T19:50:34.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e160 con 0x5642d3658fc0 2023-10-05T19:50:34.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.297+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e8c0 con 0x5642d3655270 2023-10-05T19:50:34.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365fc80 con 0x5642d3658fc0 2023-10-05T19:50:34.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365fc80 con 0x5642d3655270 2023-10-05T19:50:34.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365fc80 con 0x7f8788026360 2023-10-05T19:50:34.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x7f8788026360 2023-10-05T19:50:34.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.301+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3658fc0 2023-10-05T19:50:34.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3655270 2023-10-05T19:50:34.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3655270 2023-10-05T19:50:34.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x7f8788026360 2023-10-05T19:50:34.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x7f8788026360 2023-10-05T19:50:34.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.305+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x7f8788026360 2023-10-05T19:50:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x7f8788026360 2023-10-05T19:50:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3655270 2023-10-05T19:50:34.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3658fc0 2023-10-05T19:50:34.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.309+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3655270 2023-10-05T19:50:34.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3658fc0 2023-10-05T19:50:34.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790014040 con 0x5642d3624f00 2023-10-05T19:50:34.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3658fc0 2023-10-05T19:50:34.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x7f8788026360 2023-10-05T19:50:34.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.313+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3624f00 2023-10-05T19:50:34.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x7f8788026360 2023-10-05T19:50:34.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3658fc0 2023-10-05T19:50:34.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x7f8788026360 2023-10-05T19:50:34.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3655270 2023-10-05T19:50:34.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.317+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3655270 2023-10-05T19:50:34.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3658fc0 2023-10-05T19:50:34.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3655270 2023-10-05T19:50:34.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365e510 con 0x5642d3655270 2023-10-05T19:50:34.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879a936e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879a936e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879a936e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879a936e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365ec70 con 0x5642d3655270 2023-10-05T19:50:34.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.321+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365f020 con 0x5642d3624f00 2023-10-05T19:50:34.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365dd90 con 0x5642d3655270 2023-10-05T19:50:34.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365dd60 con 0x5642d3655270 2023-10-05T19:50:34.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365f990 con 0x7f8788026360 2023-10-05T19:50:34.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 zone default found 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 4 Realm: () 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 zonegroup default 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.325+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d365f990 con 0x7f8788026360 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3661310 con 0x5642d3658fc0 2023-10-05T19:50:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36616c0 con 0x5642d3658fc0 2023-10-05T19:50:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 20 started sync module instance, tier type = 2023-10-05T19:50:34.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:34.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.329+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36609d0 con 0x5642d3655270 2023-10-05T19:50:34.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.333+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.333+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94845014504400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36609d0 con 0x5642d3655270 2023-10-05T19:50:34.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.333+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3662060 con 0x5642d3624f00 2023-10-05T19:50:34.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.333+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.333+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94845014514480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3661f80 con 0x5642d3624f00 2023-10-05T19:50:34.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.333+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3662e80 con 0x5642d3655270 2023-10-05T19:50:34.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.333+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94845014504400] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.337+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94845014514480] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.337+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.337+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94845014510976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3661f80 con 0x5642d3655270 2023-10-05T19:50:34.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.337+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3663280 con 0x7f8788026360 2023-10-05T19:50:34.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.337+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.337+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94845014510976] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.337+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94845014516720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3663280 con 0x7f8788026360 2023-10-05T19:50:34.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.337+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3663b20 con 0x5642d3655270 2023-10-05T19:50:34.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.341+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94845014516720] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.341+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.341+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94845014520256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3663b00 con 0x5642d3655270 2023-10-05T19:50:34.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.341+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36643a0 con 0x5642d3658fc0 2023-10-05T19:50:34.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.341+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.341+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94845014523248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3664c40 con 0x5642d3658fc0 2023-10-05T19:50:34.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.341+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3665720 con 0x5642d3658fc0 2023-10-05T19:50:34.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.341+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94845014520256] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94845014523248] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94845014521360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3665b20 con 0x5642d3658fc0 2023-10-05T19:50:34.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36663c0 con 0x7f8788026360 2023-10-05T19:50:34.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94845014521360] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f878c008ad0 con 0x5642d3658fc0 2023-10-05T19:50:34.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94845014531792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3666810 con 0x7f8788026360 2023-10-05T19:50:34.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 20 add_watcher() i=0 2023-10-05T19:50:34.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 20 add_watcher() i=1 2023-10-05T19:50:34.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 20 add_watcher() i=2 2023-10-05T19:50:34.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 20 add_watcher() i=3 2023-10-05T19:50:34.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 20 add_watcher() i=4 2023-10-05T19:50:34.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 20 add_watcher() i=5 2023-10-05T19:50:34.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.345+0000 7f879a936e40 20 add_watcher() i=6 2023-10-05T19:50:34.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94845014531792] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 20 add_watcher() i=7 2023-10-05T19:50:34.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:34.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36699b0 con 0x5642d3624f00 2023-10-05T19:50:34.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94845014533264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d3666eb0 con 0x5642d3624f00 2023-10-05T19:50:34.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94845014533264] v30'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f8769fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:34.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:34.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 1 Processor -- start 2023-10-05T19:50:34.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 1 -- start start 2023-10-05T19:50:34.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d3674220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.349+0000 7f879a936e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d3674760 con 0x5642d3673e50 2023-10-05T19:50:34.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f8797c6a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d3674220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f8797c6a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d3674220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47288/0 (socket says 172.21.15.167:47288) 2023-10-05T19:50:34.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f8797c6a700 1 -- 172.21.15.167:0/2558582024 learned_addr learned my addr 172.21.15.167:0/2558582024 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f8797c6a700 1 -- 172.21.15.167:0/2558582024 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d36748a0 con 0x5642d3673e50 2023-10-05T19:50:34.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f8797c6a700 1 --2- 172.21.15.167:0/2558582024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d3674220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f878c002000 tx=0x7f878c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae41c92c0924863 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f87697e2700 1 -- 172.21.15.167:0/2558582024 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f878c02d040 con 0x5642d3673e50 2023-10-05T19:50:34.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f87697e2700 1 -- 172.21.15.167:0/2558582024 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c028890 con 0x5642d3673e50 2023-10-05T19:50:34.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f87697e2700 1 -- 172.21.15.167:0/2558582024 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f878c012980 con 0x5642d3673e50 2023-10-05T19:50:34.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 -- 172.21.15.167:0/2558582024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 msgr2=0x5642d3674220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 --2- 172.21.15.167:0/2558582024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d3674220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f878c002000 tx=0x7f878c012000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 -- 172.21.15.167:0/2558582024 shutdown_connections 2023-10-05T19:50:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 --2- 172.21.15.167:0/2558582024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d3674220 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 -- 172.21.15.167:0/2558582024 >> 172.21.15.167:0/2558582024 conn(0x5642d366f210 msgr2=0x5642d366d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 -- 172.21.15.167:0/2558582024 shutdown_connections 2023-10-05T19:50:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 -- 172.21.15.167:0/2558582024 wait complete. 2023-10-05T19:50:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 Processor -- start 2023-10-05T19:50:34.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 -- start start 2023-10-05T19:50:34.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d36798c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.353+0000 7f879a936e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d367a8c0 con 0x5642d3673e50 2023-10-05T19:50:34.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f8797c6a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d36798c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f8797c6a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d36798c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47292/0 (socket says 172.21.15.167:47292) 2023-10-05T19:50:34.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f8797c6a700 1 -- 172.21.15.167:0/44269819 learned_addr learned my addr 172.21.15.167:0/44269819 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f8797c6a700 1 -- 172.21.15.167:0/44269819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d3621530 con 0x5642d3673e50 2023-10-05T19:50:34.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f8797c6a700 1 --2- 172.21.15.167:0/44269819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d36798c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f878c035040 tx=0x7f878c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f86e37fe700 1 -- 172.21.15.167:0/44269819 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f878c009640 con 0x5642d3673e50 2023-10-05T19:50:34.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f86e37fe700 1 -- 172.21.15.167:0/44269819 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c0097a0 con 0x5642d3673e50 2023-10-05T19:50:34.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f879a936e40 1 -- 172.21.15.167:0/44269819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5642d3679ec0 con 0x5642d3673e50 2023-10-05T19:50:34.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f86e37fe700 1 -- 172.21.15.167:0/44269819 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f878c009950 con 0x5642d3673e50 2023-10-05T19:50:34.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f879a936e40 1 -- 172.21.15.167:0/44269819 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642d367a360 con 0x5642d3673e50 2023-10-05T19:50:34.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f86e37fe700 1 -- 172.21.15.167:0/44269819 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f878c009ab0 con 0x5642d3673e50 2023-10-05T19:50:34.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f86e37fe700 1 --2- 172.21.15.167:0/44269819 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86d8030c00 0x7f86d80330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f86e37fe700 1 -- 172.21.15.167:0/44269819 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f878c0470c0 con 0x5642d3673e50 2023-10-05T19:50:34.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f8798c6c700 1 --2- 172.21.15.167:0/44269819 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86d8030c00 0x7f86d80330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.357+0000 7f879a936e40 5 note: GC not initialized 2023-10-05T19:50:34.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f8798c6c700 1 --2- 172.21.15.167:0/44269819 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86d8030c00 0x7f86d80330b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5642d3666e10 tx=0x7f879000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f86e0ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:34.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f879a936e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:34.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f86d67fc700 20 reqs_thread_entry: start 2023-10-05T19:50:34.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f879a936e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:34.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f86d4ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:04 2023 2023-10-05T19:50:34.369 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:34.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f86bbfff700 20 reqs_thread_entry: start 2023-10-05T19:50:34.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f879a936e40 20 get_system_obj_state: rctx=0x7fff254427f8 obj=default.rgw.meta:users.uid:foo state=0x5642d34fa0b0 s->prefetch_data=0 2023-10-05T19:50:34.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2050 con 0x5642d3624f00 2023-10-05T19:50:34.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f879a936e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:34.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f879a936e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:34.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f879a936e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.361+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2020 con 0x5642d3624f00 2023-10-05T19:50:34.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.365+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 273+0+582 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.365+0000 7f879a936e40 20 rados_obj.operate() r=0 bl.length=459 2023-10-05T19:50:34.371 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:34.374 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:34.375 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:34.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.365+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94845014504400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36362c0 con 0x5642d3655270 2023-10-05T19:50:34.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.365+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94845014504400] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.365+0000 7f879a936e40 20 remove_watcher() i=0 2023-10-05T19:50:34.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.365+0000 7f879a936e40 2 removed watcher, disabling cache 2023-10-05T19:50:34.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.365+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94845014514480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2020 con 0x5642d3624f00 2023-10-05T19:50:34.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.369+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94845014514480] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.369+0000 7f879a936e40 20 remove_watcher() i=1 2023-10-05T19:50:34.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.369+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94845014510976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2020 con 0x5642d3655270 2023-10-05T19:50:34.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.369+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94845014510976] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.369+0000 7f879a936e40 20 remove_watcher() i=2 2023-10-05T19:50:34.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.369+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94845014516720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2020 con 0x7f8788026360 2023-10-05T19:50:34.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.373+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94845014516720] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.373+0000 7f879a936e40 20 remove_watcher() i=3 2023-10-05T19:50:34.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.373+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94845014520256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2020 con 0x5642d3655270 2023-10-05T19:50:34.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.373+0000 7f879846b700 1 -- 172.21.15.167:0/1133249844 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94845014520256] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8788024020 con 0x5642d3655270 2023-10-05T19:50:34.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.373+0000 7f879a936e40 20 remove_watcher() i=4 2023-10-05T19:50:34.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.373+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94845014523248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2020 con 0x5642d3658fc0 2023-10-05T19:50:34.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.377+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94845014523248] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f878c042070 con 0x5642d3658fc0 2023-10-05T19:50:34.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.377+0000 7f879a936e40 20 remove_watcher() i=5 2023-10-05T19:50:34.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.377+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94845014521360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2020 con 0x5642d3658fc0 2023-10-05T19:50:34.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.377+0000 7f8797c6a700 1 -- 172.21.15.167:0/1133249844 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94845014521360] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f878c042070 con 0x5642d3658fc0 2023-10-05T19:50:34.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.377+0000 7f879a936e40 20 remove_watcher() i=6 2023-10-05T19:50:34.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.377+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94845014531792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2020 con 0x7f8788026360 2023-10-05T19:50:34.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.381+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94845014531792] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8790033040 con 0x7f8788026360 2023-10-05T19:50:34.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.381+0000 7f879a936e40 20 remove_watcher() i=7 2023-10-05T19:50:34.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.381+0000 7f8769fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.381+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94845014533264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5642d36e2020 con 0x5642d3624f00 2023-10-05T19:50:34.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94845014533264] v30'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8790033040 con 0x5642d3624f00 2023-10-05T19:50:34.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5642d3655270 msgr2=0x5642d3658480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5642d3655270 0x5642d3658480 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5642d3624f00 msgr2=0x5642d3654460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5642d3624f00 0x5642d3654460 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8788026360 msgr2=0x7f8788043a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8788026360 0x7f8788043a50 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5642d3658fc0 msgr2=0x5642d365d220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5642d3658fc0 0x5642d365d220 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8784030bf0 msgr2=0x7f87840330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8784030bf0 0x7f87840330a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f878c0030a0 tx=0x7f878c015000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 msgr2=0x5642d36489f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f8798c6c700 1 -- 172.21.15.167:0/1133249844 reap_dead start 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d36489f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8788006bd0 tx=0x7f8788014000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 shutdown_connections 2023-10-05T19:50:34.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/1133249844 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3620920 0x5642d36489f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 >> 172.21.15.167:0/1133249844 conn(0x5642d361c340 msgr2=0x5642d363a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 shutdown_connections 2023-10-05T19:50:34.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/1133249844 wait complete. 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/44269819 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86d8030c00 msgr2=0x7f86d80330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/44269819 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86d8030c00 0x7f86d80330b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5642d3666e10 tx=0x7f879000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/44269819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 msgr2=0x5642d36798c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/44269819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d36798c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f878c035040 tx=0x7f878c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/44269819 shutdown_connections 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/44269819 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86d8030c00 0x7f86d80330b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 --2- 172.21.15.167:0/44269819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5642d3673e50 0x5642d36798c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/44269819 >> 172.21.15.167:0/44269819 conn(0x5642d366f210 msgr2=0x5642d366d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/44269819 shutdown_connections 2023-10-05T19:50:34.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.385+0000 7f879a936e40 1 -- 172.21.15.167:0/44269819 wait complete. 2023-10-05T19:50:34.399 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:34.399 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2023-10-05T19:50:34.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2023-10-05T19:50:34.399 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2023-10-05T19:50:34.441 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:34.442 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 Processor -- start 2023-10-05T19:50:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 -- start start 2023-10-05T19:50:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c73fe77e10 0x55c73fe7a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c73fdc1bd0 con 0x55c73fe73830 2023-10-05T19:50:34.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c73fd7eee0 con 0x55c73fe77e10 2023-10-05T19:50:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f6c04c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c73fe77e10 0x55c73fe7a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f6c04c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c73fe77e10 0x55c73fe7a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47308/0 (socket says 172.21.15.167:47308) 2023-10-05T19:50:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f6c04c700 1 -- 172.21.15.167:0/3109839920 learned_addr learned my addr 172.21.15.167:0/3109839920 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f7484d700 1 --1- 172.21.15.167:0/3109839920 >> v1:172.21.15.118:6789/0 conn(0x55c73fe73830 0x55c73fe73c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39940/0 (socket says 172.21.15.167:39940) 2023-10-05T19:50:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f6c04c700 1 -- 172.21.15.167:0/3109839920 >> v1:172.21.15.118:6789/0 conn(0x55c73fe73830 legacy=0x55c73fe73c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f6c04c700 1 -- 172.21.15.167:0/3109839920 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c73fe74440 con 0x55c73fe77e10 2023-10-05T19:50:34.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f6c04c700 1 --2- 172.21.15.167:0/3109839920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 0x55c73fe7a1f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00a650 tx=0x7f2f5c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf7ebc6fd561a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f6ffff700 1 -- 172.21.15.167:0/3109839920 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c008760 con 0x55c73fe77e10 2023-10-05T19:50:34.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f6ffff700 1 -- 172.21.15.167:0/3109839920 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0088c0 con 0x55c73fe77e10 2023-10-05T19:50:34.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f6ffff700 1 -- 172.21.15.167:0/3109839920 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c008bb0 con 0x55c73fe77e10 2023-10-05T19:50:34.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3109839920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 msgr2=0x55c73fe7a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/3109839920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 0x55c73fe7a1f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00a650 tx=0x7f2f5c005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:34.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3109839920 shutdown_connections 2023-10-05T19:50:34.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/3109839920 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 0x55c73fe7a1f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3109839920 >> 172.21.15.167:0/3109839920 conn(0x55c73fe6f250 msgr2=0x55c73fe71660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3109839920 shutdown_connections 2023-10-05T19:50:34.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3109839920 wait complete. 2023-10-05T19:50:34.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 Processor -- start 2023-10-05T19:50:34.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.437+0000 7f2f76d18e40 1 -- start start 2023-10-05T19:50:34.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe73830 0x55c73fe98540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c73fd42e30 con 0x55c73fe73830 2023-10-05T19:50:34.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f7484d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe73830 0x55c73fe98540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f7484d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe73830 0x55c73fe98540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47324/0 (socket says 172.21.15.167:47324) 2023-10-05T19:50:34.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f7484d700 1 -- 172.21.15.167:0/3659645150 learned_addr learned my addr 172.21.15.167:0/3659645150 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f7484d700 1 -- 172.21.15.167:0/3659645150 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c005db0 con 0x55c73fe73830 2023-10-05T19:50:34.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f7484d700 1 --2- 172.21.15.167:0/3659645150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe73830 0x55c73fe98540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2f64001cf0 tx=0x7f2f640018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a258fcd67736f07 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f6effd700 1 -- 172.21.15.167:0/3659645150 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f64014070 con 0x55c73fe73830 2023-10-05T19:50:34.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f6effd700 1 -- 172.21.15.167:0/3659645150 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6400be10 con 0x55c73fe73830 2023-10-05T19:50:34.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f6effd700 1 -- 172.21.15.167:0/3659645150 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f6400f590 con 0x55c73fe73830 2023-10-05T19:50:34.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3659645150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe73830 msgr2=0x55c73fe98540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/3659645150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe73830 0x55c73fe98540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2f64001cf0 tx=0x7f2f640018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3659645150 shutdown_connections 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/3659645150 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe73830 0x55c73fe98540 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3659645150 >> 172.21.15.167:0/3659645150 conn(0x55c73fe6f250 msgr2=0x55c73fe7b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3659645150 shutdown_connections 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3659645150 wait complete. 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 Processor -- start 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 -- start start 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 0x55c73fe9cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f76d18e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c73fd15ed0 con 0x55c73fe77e10 2023-10-05T19:50:34.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f7484d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 0x55c73fe9cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f7484d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 0x55c73fe9cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47336/0 (socket says 172.21.15.167:47336) 2023-10-05T19:50:34.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.441+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 learned_addr learned my addr 172.21.15.167:0/1327095164 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c73fdc1bd0 con 0x55c73fe77e10 2023-10-05T19:50:34.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f7484d700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 0x55c73fe9cbb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2f640018e0 tx=0x7f2f64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f6d7fa700 1 -- 172.21.15.167:0/1327095164 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f6401c770 con 0x55c73fe77e10 2023-10-05T19:50:34.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f6d7fa700 1 -- 172.21.15.167:0/1327095164 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6401c8f0 con 0x55c73fe77e10 2023-10-05T19:50:34.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c73fe9d0f0 con 0x55c73fe77e10 2023-10-05T19:50:34.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f6d7fa700 1 -- 172.21.15.167:0/1327095164 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f6401cbe0 con 0x55c73fe77e10 2023-10-05T19:50:34.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c73fe9d530 con 0x55c73fe77e10 2023-10-05T19:50:34.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f6d7fa700 1 -- 172.21.15.167:0/1327095164 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2f64023020 con 0x55c73fe77e10 2023-10-05T19:50:34.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.445+0000 7f2f6d7fa700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2f54030ca0 0x7f2f54033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f6d7fa700 1 -- 172.21.15.167:0/1327095164 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2f64008030 con 0x55c73fe77e10 2023-10-05T19:50:34.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f6c04c700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2f54030ca0 0x7f2f54033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c73fea6660 0x55c73fea8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73fea90f0 con 0x55c73fea6660 2023-10-05T19:50:34.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f7504e700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c73fea6660 0x55c73fea8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f6c04c700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2f54030ca0 0x7f2f54033150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0030a0 tx=0x7f2f5c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f7504e700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c73fea6660 0x55c73fea8a40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 20 realm 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73fea5c90 con 0x55c73fea6660 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73fea9bd0 con 0x55c73fea6660 2023-10-05T19:50:34.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c73fea9800 0x55c73feac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73fead110 con 0x55c73fea9800 2023-10-05T19:50:34.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.449+0000 7f2f7484d700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c73fea9800 0x55c73feac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f7484d700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c73fea9800 0x55c73feac9e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73fead9b0 con 0x55c73fea6660 2023-10-05T19:50:34.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f76d18e40 20 searching for the correct realm 2023-10-05T19:50:34.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c73feaf770 0x55c73feb1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73feaf770 2023-10-05T19:50:34.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f6c04c700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c73feaf770 0x55c73feb1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f6c04c700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c73feaf770 0x55c73feb1b50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea9800 2023-10-05T19:50:34.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f7484d700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2f6401a070 0x7f2f64043670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x7f2f6401a070 2023-10-05T19:50:34.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.453+0000 7f2f7504e700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2f6401a070 0x7f2f64043670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7504e700 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2f6401a070 0x7f2f64043670 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73feaf770 2023-10-05T19:50:34.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea9800 2023-10-05T19:50:34.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.457+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea9800 2023-10-05T19:50:34.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x7f2f6401a070 2023-10-05T19:50:34.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x7f2f6401a070 2023-10-05T19:50:34.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea9800 2023-10-05T19:50:34.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73feaf770 2023-10-05T19:50:34.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.461+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea9800 2023-10-05T19:50:34.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73feaf770 2023-10-05T19:50:34.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73feaf770 2023-10-05T19:50:34.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x7f2f6401a070 2023-10-05T19:50:34.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.465+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea6660 2023-10-05T19:50:34.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x7f2f6401a070 2023-10-05T19:50:34.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73feaf770 2023-10-05T19:50:34.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x7f2f6401a070 2023-10-05T19:50:34.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea9800 2023-10-05T19:50:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea9800 2023-10-05T19:50:34.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.469+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73feaf770 2023-10-05T19:50:34.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea9800 2023-10-05T19:50:34.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2160 con 0x55c73fea9800 2023-10-05T19:50:34.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feae4c0 con 0x55c73fea6660 2023-10-05T19:50:34.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feae0c0 con 0x55c73fea9800 2023-10-05T19:50:34.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.473+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb25d0 con 0x55c73fea9800 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2980 con 0x55c73feaf770 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb2d30 con 0x55c73fea6660 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb3110 con 0x55c73fea9800 2023-10-05T19:50:34.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73feaf770 2023-10-05T19:50:34.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.477+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea9800 2023-10-05T19:50:34.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x7f2f6401a070 2023-10-05T19:50:34.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73feaf770 2023-10-05T19:50:34.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea9800 2023-10-05T19:50:34.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.481+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea9800 2023-10-05T19:50:34.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x7f2f6401a070 2023-10-05T19:50:34.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x7f2f6401a070 2023-10-05T19:50:34.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea9800 2023-10-05T19:50:34.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.485+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73feaf770 2023-10-05T19:50:34.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea9800 2023-10-05T19:50:34.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73feaf770 2023-10-05T19:50:34.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.489+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73feaf770 2023-10-05T19:50:34.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x7f2f6401a070 2023-10-05T19:50:34.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea6660 2023-10-05T19:50:34.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x7f2f6401a070 2023-10-05T19:50:34.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73feaf770 2023-10-05T19:50:34.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x7f2f6401a070 2023-10-05T19:50:34.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.493+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea9800 2023-10-05T19:50:34.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea9800 2023-10-05T19:50:34.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73feaf770 2023-10-05T19:50:34.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea9800 2023-10-05T19:50:34.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4550 con 0x55c73fea9800 2023-10-05T19:50:34.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f76d18e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f76d18e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f76d18e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f76d18e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.497+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb3540 con 0x55c73fea9800 2023-10-05T19:50:34.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb38f0 con 0x55c73fea6660 2023-10-05T19:50:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4950 con 0x55c73fea9800 2023-10-05T19:50:34.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4950 con 0x55c73fea9800 2023-10-05T19:50:34.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4950 con 0x7f2f6401a070 2023-10-05T19:50:34.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 zone default found 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 4 Realm: () 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 zonegroup default 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.501+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb4950 con 0x7f2f6401a070 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb62d0 con 0x55c73feaf770 2023-10-05T19:50:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb6680 con 0x55c73feaf770 2023-10-05T19:50:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 20 started sync module instance, tier type = 2023-10-05T19:50:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:34.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.505+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb57b0 con 0x55c73fea9800 2023-10-05T19:50:34.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.509+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.509+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94314259239904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb5d20 con 0x55c73fea9800 2023-10-05T19:50:34.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.509+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb6f20 con 0x55c73fea6660 2023-10-05T19:50:34.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.509+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.509+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94314259239904] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.509+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94314259241296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb6f20 con 0x55c73fea6660 2023-10-05T19:50:34.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.509+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb77c0 con 0x55c73fea9800 2023-10-05T19:50:34.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.513+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94314259241296] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.513+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.513+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94314259245616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb73b0 con 0x55c73fea9800 2023-10-05T19:50:34.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.513+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb7e90 con 0x7f2f6401a070 2023-10-05T19:50:34.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.513+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94314259245616] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.513+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.513+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94314259246720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb7e50 con 0x7f2f6401a070 2023-10-05T19:50:34.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.513+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb8780 con 0x55c73fea9800 2023-10-05T19:50:34.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.517+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94314259246720] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.517+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.517+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94314259250064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb8780 con 0x55c73fea9800 2023-10-05T19:50:34.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.517+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb9190 con 0x55c73feaf770 2023-10-05T19:50:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.517+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.517+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94314259254432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb9a30 con 0x55c73feaf770 2023-10-05T19:50:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.517+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94314259250064] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.517+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb8290 con 0x55c73feaf770 2023-10-05T19:50:34.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94314259254432] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94314259259216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feb9650 con 0x55c73feaf770 2023-10-05T19:50:34.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73febb020 con 0x7f2f6401a070 2023-10-05T19:50:34.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94314259262752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73febb770 con 0x7f2f6401a070 2023-10-05T19:50:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 20 add_watcher() i=0 2023-10-05T19:50:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94314259259216] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f5c008ad0 con 0x55c73feaf770 2023-10-05T19:50:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 20 add_watcher() i=1 2023-10-05T19:50:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 20 add_watcher() i=2 2023-10-05T19:50:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 20 add_watcher() i=3 2023-10-05T19:50:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 20 add_watcher() i=4 2023-10-05T19:50:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 20 add_watcher() i=5 2023-10-05T19:50:34.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 20 add_watcher() i=6 2023-10-05T19:50:34.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94314259262752] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x7f2f6401a070 2023-10-05T19:50:34.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 20 add_watcher() i=7 2023-10-05T19:50:34.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:34.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.521+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73feba3a0 con 0x55c73fea6660 2023-10-05T19:50:34.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94314259264064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73febbc60 con 0x55c73fea6660 2023-10-05T19:50:34.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94314259264064] v30'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2f7000a5a0 con 0x55c73fea6660 2023-10-05T19:50:34.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f467e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f76d18e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f76d18e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f76d18e40 1 Processor -- start 2023-10-05T19:50:34.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f76d18e40 1 -- start start 2023-10-05T19:50:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f76d18e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fec91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f76d18e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c73fec96e0 con 0x55c73fec8dd0 2023-10-05T19:50:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f6c04c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fec91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f6c04c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fec91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47352/0 (socket says 172.21.15.167:47352) 2023-10-05T19:50:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f6c04c700 1 -- 172.21.15.167:0/3107172698 learned_addr learned my addr 172.21.15.167:0/3107172698 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.525+0000 7f2f6c04c700 1 -- 172.21.15.167:0/3107172698 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c73fec9820 con 0x55c73fec8dd0 2023-10-05T19:50:34.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f6c04c700 1 --2- 172.21.15.167:0/3107172698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fec91a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c73fe748b0 tx=0x7f2f5c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322bc473662e9aa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f45fe3700 1 -- 172.21.15.167:0/3107172698 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c02d040 con 0x55c73fec8dd0 2023-10-05T19:50:34.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f45fe3700 1 -- 172.21.15.167:0/3107172698 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c028890 con 0x55c73fec8dd0 2023-10-05T19:50:34.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f45fe3700 1 -- 172.21.15.167:0/3107172698 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c012960 con 0x55c73fec8dd0 2023-10-05T19:50:34.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3107172698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 msgr2=0x55c73fec91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/3107172698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fec91a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c73fe748b0 tx=0x7f2f5c012000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3107172698 shutdown_connections 2023-10-05T19:50:34.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/3107172698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fec91a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3107172698 >> 172.21.15.167:0/3107172698 conn(0x55c73fec4190 msgr2=0x55c73fec22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3107172698 shutdown_connections 2023-10-05T19:50:34.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 -- 172.21.15.167:0/3107172698 wait complete. 2023-10-05T19:50:34.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 Processor -- start 2023-10-05T19:50:34.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 -- start start 2023-10-05T19:50:34.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fece810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f76d18e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c73fecf810 con 0x55c73fec8dd0 2023-10-05T19:50:34.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f6c04c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fece810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f6c04c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fece810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47358/0 (socket says 172.21.15.167:47358) 2023-10-05T19:50:34.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f6c04c700 1 -- 172.21.15.167:0/2788858471 learned_addr learned my addr 172.21.15.167:0/2788858471 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.529+0000 7f2f6c04c700 1 -- 172.21.15.167:0/2788858471 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c73fe74440 con 0x55c73fec8dd0 2023-10-05T19:50:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2f6c04c700 1 --2- 172.21.15.167:0/2788858471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fece810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55c73fec2e50 tx=0x7f2f5c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2eb7fff700 1 -- 172.21.15.167:0/2788858471 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c009640 con 0x55c73fec8dd0 2023-10-05T19:50:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2eb7fff700 1 -- 172.21.15.167:0/2788858471 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0097c0 con 0x55c73fec8dd0 2023-10-05T19:50:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2f76d18e40 1 -- 172.21.15.167:0/2788858471 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c73fecee10 con 0x55c73fec8dd0 2023-10-05T19:50:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2eb7fff700 1 -- 172.21.15.167:0/2788858471 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c009970 con 0x55c73fec8dd0 2023-10-05T19:50:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2f76d18e40 1 -- 172.21.15.167:0/2788858471 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c73fecf2b0 con 0x55c73fec8dd0 2023-10-05T19:50:34.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2eb7fff700 1 -- 172.21.15.167:0/2788858471 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2f5c009bf0 con 0x55c73fec8dd0 2023-10-05T19:50:34.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2eb7fff700 1 --2- 172.21.15.167:0/2788858471 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ebc030c00 0x7f2ebc0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2eb7fff700 1 -- 172.21.15.167:0/2788858471 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2f5c046c20 con 0x55c73fec8dd0 2023-10-05T19:50:34.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2f7504e700 1 --2- 172.21.15.167:0/2788858471 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ebc030c00 0x7f2ebc0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2f76d18e40 5 note: GC not initialized 2023-10-05T19:50:34.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.533+0000 7f2f7504e700 1 --2- 172.21.15.167:0/2788858471 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ebc030c00 0x7f2ebc0330b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55c73febb700 tx=0x7f2f7000ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2eaeffd700 20 reqs_thread_entry: start 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2eb57fa700 20 reqs_thread_entry: start 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2eacff9700 20 reqs_thread_entry: start 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 20 get_system_obj_state: rctx=0x7ffdfaba2da8 obj=default.rgw.meta:users.uid:foo state=0x55c73fd4e0b0 s->prefetch_data=0 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff37060 con 0x55c73fea6660 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2ead7fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:04 2023 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:34.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f2f7003d050 con 0x55c73fea6660 2023-10-05T19:50:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff39af0 con 0x55c73fea6660 2023-10-05T19:50:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 273+0+582 (crc 0 0 0) 0x7f2f7003d050 con 0x55c73fea6660 2023-10-05T19:50:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 20 rados_obj.operate() r=0 bl.length=459 2023-10-05T19:50:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.537+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff36390 con 0x55c73fea6660 2023-10-05T19:50:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~357] v30'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f2f7003d050 con 0x55c73fea6660 2023-10-05T19:50:34.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f76d18e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f76d18e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f76d18e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94314259766896 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff3ab00 con 0x55c73fea9800 2023-10-05T19:50:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94314259250064 notify 128849018885 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55c73fe9d530 con 0x55c73fea9800 2023-10-05T19:50:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f6effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94314259250064 notifier 4337 bl.length()=533 2023-10-05T19:50:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.4 [notify cookie 94314259766896 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f6effd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f6effd700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f6effd700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2f58003d90 con 0x55c73fea9800 2023-10-05T19:50:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94314259766896 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c73fe9d0f0 con 0x55c73fea9800 2023-10-05T19:50:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f76d18e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T19:50:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [notify cookie 94314259766896 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff3a610 con 0x55c73fea9800 2023-10-05T19:50:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== watch-notify(notify (1) cookie 94314259245616 notify 128849018886 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55c73fe9d0f0 con 0x55c73fea9800 2023-10-05T19:50:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f6effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94314259245616 notifier 4337 bl.length()=170 2023-10-05T19:50:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(107 notify.2 [notify cookie 94314259766896 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.541+0000 7f2f6effd700 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2f58003d90 con 0x55c73fea9800 2023-10-05T19:50:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.545+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(108 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.545+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== watch-notify(notify_complete (2) cookie 94314259766896 notify 128849018886 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c73fdc1bd0 con 0x55c73fea9800 2023-10-05T19:50:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.545+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff35e70 con 0x55c73feaf770 2023-10-05T19:50:34.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.545+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2f5c039020 con 0x55c73feaf770 2023-10-05T19:50:34.553 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:34.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:34.554 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.555 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:34.556 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:34.556 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:34.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.545+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94314259239904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73fe8a300 con 0x55c73fea9800 2023-10-05T19:50:34.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.549+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94314259239904] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.549+0000 7f2f76d18e40 20 remove_watcher() i=0 2023-10-05T19:50:34.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.549+0000 7f2f76d18e40 2 removed watcher, disabling cache 2023-10-05T19:50:34.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.549+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94314259241296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff363e0 con 0x55c73fea6660 2023-10-05T19:50:34.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.549+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94314259241296] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f7003d050 con 0x55c73fea6660 2023-10-05T19:50:34.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.549+0000 7f2f76d18e40 20 remove_watcher() i=1 2023-10-05T19:50:34.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.549+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94314259245616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff363e0 con 0x55c73fea9800 2023-10-05T19:50:34.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.553+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94314259245616] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.553+0000 7f2f76d18e40 20 remove_watcher() i=2 2023-10-05T19:50:34.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.553+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94314259246720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff363e0 con 0x7f2f6401a070 2023-10-05T19:50:34.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.553+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94314259246720] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f7003d050 con 0x7f2f6401a070 2023-10-05T19:50:34.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.553+0000 7f2f76d18e40 20 remove_watcher() i=3 2023-10-05T19:50:34.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.553+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94314259250064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff363e0 con 0x55c73fea9800 2023-10-05T19:50:34.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.557+0000 7f2f7484d700 1 -- 172.21.15.167:0/1327095164 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94314259250064] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f64016070 con 0x55c73fea9800 2023-10-05T19:50:34.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.557+0000 7f2f76d18e40 20 remove_watcher() i=4 2023-10-05T19:50:34.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.557+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94314259254432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff363e0 con 0x55c73feaf770 2023-10-05T19:50:34.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.561+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94314259254432] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f5c039020 con 0x55c73feaf770 2023-10-05T19:50:34.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.561+0000 7f2f76d18e40 20 remove_watcher() i=5 2023-10-05T19:50:34.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.561+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94314259259216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff363e0 con 0x55c73feaf770 2023-10-05T19:50:34.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.561+0000 7f2f6c04c700 1 -- 172.21.15.167:0/1327095164 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94314259259216] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f5c039020 con 0x55c73feaf770 2023-10-05T19:50:34.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.561+0000 7f2f76d18e40 20 remove_watcher() i=6 2023-10-05T19:50:34.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.561+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94314259262752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff363e0 con 0x7f2f6401a070 2023-10-05T19:50:34.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.565+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94314259262752] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2f7003d050 con 0x7f2f6401a070 2023-10-05T19:50:34.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.565+0000 7f2f76d18e40 20 remove_watcher() i=7 2023-10-05T19:50:34.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.565+0000 7f2f467e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.565+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94314259264064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c73ff363e0 con 0x55c73fea6660 2023-10-05T19:50:34.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94314259264064] v30'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2f7003d050 con 0x55c73fea6660 2023-10-05T19:50:34.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c73fea9800 msgr2=0x55c73feac9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c73fea9800 0x55c73feac9e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c73fea6660 msgr2=0x55c73fea8a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c73fea6660 0x55c73fea8a40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2f6401a070 msgr2=0x7f2f64043670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2f6401a070 0x7f2f64043670 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c73feaf770 msgr2=0x55c73feb1b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c73feaf770 0x55c73feb1b50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2f54030ca0 msgr2=0x7f2f54033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2f54030ca0 0x7f2f54033150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0030a0 tx=0x7f2f5c015000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 msgr2=0x55c73fe9cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/1327095164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fe77e10 0x55c73fe9cbb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2f640018e0 tx=0x7f2f64016000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f7504e700 1 -- 172.21.15.167:0/1327095164 reap_dead start 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 shutdown_connections 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 >> 172.21.15.167:0/1327095164 conn(0x55c73fe6f250 msgr2=0x55c73fe7b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 shutdown_connections 2023-10-05T19:50:34.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/1327095164 wait complete. 2023-10-05T19:50:34.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/2788858471 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ebc030c00 msgr2=0x7f2ebc0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/2788858471 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ebc030c00 0x7f2ebc0330b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55c73febb700 tx=0x7f2f7000ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:34.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/2788858471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 msgr2=0x55c73fece810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/2788858471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fece810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55c73fec2e50 tx=0x7f2f5c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/2788858471 shutdown_connections 2023-10-05T19:50:34.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/2788858471 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ebc030c00 0x7f2ebc0330b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 --2- 172.21.15.167:0/2788858471 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c73fec8dd0 0x55c73fece810 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/2788858471 >> 172.21.15.167:0/2788858471 conn(0x55c73fec4190 msgr2=0x55c73fec2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/2788858471 shutdown_connections 2023-10-05T19:50:34.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.569+0000 7f2f76d18e40 1 -- 172.21.15.167:0/2788858471 wait complete. 2023-10-05T19:50:34.581 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:34.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2023-10-05T19:50:34.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2023-10-05T19:50:34.582 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2023-10-05T19:50:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:34.621 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:34.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 Processor -- start 2023-10-05T19:50:34.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 -- start start 2023-10-05T19:50:34.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5555a3df0270 0x5555a3e84a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5555a3dc8bd0 con 0x5555a3df1580 2023-10-05T19:50:34.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5555a3d85ee0 con 0x5555a3df0270 2023-10-05T19:50:34.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff465349700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5555a3df0270 0x5555a3e84a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff465349700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5555a3df0270 0x5555a3e84a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47364/0 (socket says 172.21.15.167:47364) 2023-10-05T19:50:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff465349700 1 -- 172.21.15.167:0/2551395734 learned_addr learned my addr 172.21.15.167:0/2551395734 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff465b4a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x5555a3df1580 0x5555a3defb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39956/0 (socket says 172.21.15.167:39956) 2023-10-05T19:50:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff465349700 1 -- 172.21.15.167:0/2551395734 >> v1:172.21.15.118:6789/0 conn(0x5555a3df1580 legacy=0x5555a3defb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff465349700 1 -- 172.21.15.167:0/2551395734 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555a3df1a10 con 0x5555a3df0270 2023-10-05T19:50:34.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff465349700 1 --2- 172.21.15.167:0/2551395734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df0270 0x5555a3e84a60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff45000a650 tx=0x7ff450005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b355062e58ca5a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff464b48700 1 -- 172.21.15.167:0/2551395734 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff450008760 con 0x5555a3df0270 2023-10-05T19:50:34.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff464b48700 1 -- 172.21.15.167:0/2551395734 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4500088c0 con 0x5555a3df0270 2023-10-05T19:50:34.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff464b48700 1 -- 172.21.15.167:0/2551395734 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff450008bb0 con 0x5555a3df0270 2023-10-05T19:50:34.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 -- 172.21.15.167:0/2551395734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df0270 msgr2=0x5555a3e84a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 --2- 172.21.15.167:0/2551395734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df0270 0x5555a3e84a60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff45000a650 tx=0x7ff450005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:34.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 -- 172.21.15.167:0/2551395734 shutdown_connections 2023-10-05T19:50:34.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 --2- 172.21.15.167:0/2551395734 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df0270 0x5555a3e84a60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 -- 172.21.15.167:0/2551395734 >> 172.21.15.167:0/2551395734 conn(0x5555a3e77350 msgr2=0x5555a3e79760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 -- 172.21.15.167:0/2551395734 shutdown_connections 2023-10-05T19:50:34.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 -- 172.21.15.167:0/2551395734 wait complete. 2023-10-05T19:50:34.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 Processor -- start 2023-10-05T19:50:34.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 -- start start 2023-10-05T19:50:34.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.617+0000 7ff468015e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3e9ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a3d49e30 con 0x5555a3df1580 2023-10-05T19:50:34.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff465b4a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3e9ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff465b4a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3e9ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47366/0 (socket says 172.21.15.167:47366) 2023-10-05T19:50:34.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff465b4a700 1 -- 172.21.15.167:0/2940522154 learned_addr learned my addr 172.21.15.167:0/2940522154 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff465b4a700 1 -- 172.21.15.167:0/2940522154 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450005db0 con 0x5555a3df1580 2023-10-05T19:50:34.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff465b4a700 1 --2- 172.21.15.167:0/2940522154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3e9ccc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff460001cf0 tx=0x7ff4600018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fcb26a02592b56 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff45f7fe700 1 -- 172.21.15.167:0/2940522154 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff460014070 con 0x5555a3df1580 2023-10-05T19:50:34.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff45f7fe700 1 -- 172.21.15.167:0/2940522154 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46000be10 con 0x5555a3df1580 2023-10-05T19:50:34.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff45f7fe700 1 -- 172.21.15.167:0/2940522154 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff46000f590 con 0x5555a3df1580 2023-10-05T19:50:34.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 -- 172.21.15.167:0/2940522154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 msgr2=0x5555a3e9ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 --2- 172.21.15.167:0/2940522154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3e9ccc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff460001cf0 tx=0x7ff4600018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 -- 172.21.15.167:0/2940522154 shutdown_connections 2023-10-05T19:50:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 --2- 172.21.15.167:0/2940522154 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3e9ccc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 -- 172.21.15.167:0/2940522154 >> 172.21.15.167:0/2940522154 conn(0x5555a3e77350 msgr2=0x5555a3e98880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 -- 172.21.15.167:0/2940522154 shutdown_connections 2023-10-05T19:50:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 -- 172.21.15.167:0/2940522154 wait complete. 2023-10-05T19:50:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 Processor -- start 2023-10-05T19:50:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 -- start start 2023-10-05T19:50:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3ea3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff468015e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a3d1ced0 con 0x5555a3df1580 2023-10-05T19:50:34.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff465b4a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3ea3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff465b4a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3ea3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47382/0 (socket says 172.21.15.167:47382) 2023-10-05T19:50:34.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.621+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 learned_addr learned my addr 172.21.15.167:0/559898982 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555a3dc8bd0 con 0x5555a3df1580 2023-10-05T19:50:34.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff465b4a700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3ea3a90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff4600018e0 tx=0x7ff460016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff45dffb700 1 -- 172.21.15.167:0/559898982 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff46001c790 con 0x5555a3df1580 2023-10-05T19:50:34.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff45dffb700 1 -- 172.21.15.167:0/559898982 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46001c8f0 con 0x5555a3df1580 2023-10-05T19:50:34.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5555a3ea3fd0 con 0x5555a3df1580 2023-10-05T19:50:34.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff45dffb700 1 -- 172.21.15.167:0/559898982 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff46001cbe0 con 0x5555a3df1580 2023-10-05T19:50:34.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555a3ea4410 con 0x5555a3df1580 2023-10-05T19:50:34.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff45dffb700 1 -- 172.21.15.167:0/559898982 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff460023020 con 0x5555a3df1580 2023-10-05T19:50:34.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff45dffb700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff448030c00 0x7ff4480330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff45dffb700 1 -- 172.21.15.167:0/559898982 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7ff460008030 con 0x5555a3df1580 2023-10-05T19:50:34.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff465349700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff448030c00 0x7ff4480330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5555a3ead570 0x5555a3eaf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.625+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb0050 con 0x5555a3ead570 2023-10-05T19:50:34.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff46634b700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5555a3ead570 0x5555a3eaf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff465349700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff448030c00 0x7ff4480330b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5555a3df0640 tx=0x7ff450015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff46634b700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5555a3ead570 0x5555a3eaf950 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 20 realm 2023-10-05T19:50:34.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eacba0 con 0x5555a3ead570 2023-10-05T19:50:34.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:34.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb0b30 con 0x5555a3ead570 2023-10-05T19:50:34.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5555a3eb0760 0x5555a3eb3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb4070 con 0x5555a3eb0760 2023-10-05T19:50:34.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff465b4a700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5555a3eb0760 0x5555a3eb3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.629+0000 7ff465b4a700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5555a3eb0760 0x5555a3eb3940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb4910 con 0x5555a3ead570 2023-10-05T19:50:34.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff468015e40 20 searching for the correct realm 2023-10-05T19:50:34.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5555a3eb66d0 0x5555a3eb8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff465349700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5555a3eb66d0 0x5555a3eb8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff465349700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5555a3eb66d0 0x5555a3eb8ab0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb0760 2023-10-05T19:50:34.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff465b4a700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff46001a070 0x7ff460042df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x7ff46001a070 2023-10-05T19:50:34.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.633+0000 7ff46634b700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff46001a070 0x7ff460042df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff46634b700 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff46001a070 0x7ff460042df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb0760 2023-10-05T19:50:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.637+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb0760 2023-10-05T19:50:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x7ff46001a070 2023-10-05T19:50:34.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x7ff46001a070 2023-10-05T19:50:34.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb0760 2023-10-05T19:50:34.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.641+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb0760 2023-10-05T19:50:34.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.645+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x7ff46001a070 2023-10-05T19:50:34.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3ead570 2023-10-05T19:50:34.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x7ff46001a070 2023-10-05T19:50:34.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x7ff46001a070 2023-10-05T19:50:34.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.649+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb0760 2023-10-05T19:50:34.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb0760 2023-10-05T19:50:34.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb0760 2023-10-05T19:50:34.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb90c0 con 0x5555a3eb0760 2023-10-05T19:50:34.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff468015e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff468015e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff468015e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff468015e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb5480 con 0x5555a3ead570 2023-10-05T19:50:34.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.653+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb5dd0 con 0x5555a3eb0760 2023-10-05T19:50:34.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb9530 con 0x5555a3eb0760 2023-10-05T19:50:34.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb98e0 con 0x5555a3eb66d0 2023-10-05T19:50:34.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb9c90 con 0x5555a3ead570 2023-10-05T19:50:34.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eb59a0 con 0x5555a3eb0760 2023-10-05T19:50:34.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.657+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb0760 2023-10-05T19:50:34.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff460016070 con 0x5555a3eb0760 2023-10-05T19:50:34.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x7ff46001a070 2023-10-05T19:50:34.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.661+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb0760 2023-10-05T19:50:34.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb0760 2023-10-05T19:50:34.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x7ff46001a070 2023-10-05T19:50:34.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.665+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x7ff46001a070 2023-10-05T19:50:34.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb0760 2023-10-05T19:50:34.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb0760 2023-10-05T19:50:34.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.669+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x7ff46001a070 2023-10-05T19:50:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3ead570 2023-10-05T19:50:34.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.673+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x7ff46001a070 2023-10-05T19:50:34.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x7ff46001a070 2023-10-05T19:50:34.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb0760 2023-10-05T19:50:34.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb0760 2023-10-05T19:50:34.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.677+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb0760 2023-10-05T19:50:34.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb5c0 con 0x5555a3eb0760 2023-10-05T19:50:34.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eba5b0 con 0x5555a3eb0760 2023-10-05T19:50:34.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3eba960 con 0x5555a3ead570 2023-10-05T19:50:34.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.681+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb970 con 0x5555a3eb0760 2023-10-05T19:50:34.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb970 con 0x5555a3eb0760 2023-10-05T19:50:34.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb970 con 0x7ff46001a070 2023-10-05T19:50:34.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 zone default found 2023-10-05T19:50:34.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 4 Realm: () 2023-10-05T19:50:34.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:34.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:34.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:34.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 zonegroup default 2023-10-05T19:50:34.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebb970 con 0x7ff46001a070 2023-10-05T19:50:34.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebd2f0 con 0x5555a3eb66d0 2023-10-05T19:50:34.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.685+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebd6a0 con 0x5555a3eb66d0 2023-10-05T19:50:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.689+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.689+0000 7ff468015e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.689+0000 7ff468015e40 20 started sync module instance, tier type = 2023-10-05T19:50:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.689+0000 7ff468015e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:34.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.689+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebc7d0 con 0x5555a3eb0760 2023-10-05T19:50:34.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.689+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.689+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93826310720752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebc7d0 con 0x5555a3eb0760 2023-10-05T19:50:34.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.689+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebdf40 con 0x5555a3ead570 2023-10-05T19:50:34.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.693+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.693+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93826310724176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebe390 con 0x5555a3ead570 2023-10-05T19:50:34.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.693+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebec30 con 0x5555a3eb0760 2023-10-05T19:50:34.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.693+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93826310720752] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.693+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.693+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93826310726544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebc400 con 0x5555a3eb0760 2023-10-05T19:50:34.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.693+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebf410 con 0x7ff46001a070 2023-10-05T19:50:34.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.693+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93826310724176] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.697+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.697+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93826310726544] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.697+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93826310725280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebf410 con 0x7ff46001a070 2023-10-05T19:50:34.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.697+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebf810 con 0x5555a3eb0760 2023-10-05T19:50:34.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.697+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93826310725280] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.697+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.697+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93826310729504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebf370 con 0x5555a3eb0760 2023-10-05T19:50:34.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.697+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ec01f0 con 0x5555a3eb66d0 2023-10-05T19:50:34.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.701+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.701+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93826310733056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ec0a90 con 0x5555a3eb66d0 2023-10-05T19:50:34.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.701+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ec14a0 con 0x5555a3eb66d0 2023-10-05T19:50:34.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.701+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93826310729504] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.701+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.701+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 93826310733056] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.701+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93826310731792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ec1d40 con 0x5555a3eb66d0 2023-10-05T19:50:34.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.701+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ec20f0 con 0x7ff46001a070 2023-10-05T19:50:34.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93826310731792] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff450012450 con 0x5555a3eb66d0 2023-10-05T19:50:34.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93826310740048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ec25e0 con 0x7ff46001a070 2023-10-05T19:50:34.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 20 add_watcher() i=0 2023-10-05T19:50:34.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 20 add_watcher() i=1 2023-10-05T19:50:34.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 20 add_watcher() i=2 2023-10-05T19:50:34.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 20 add_watcher() i=3 2023-10-05T19:50:34.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 20 add_watcher() i=4 2023-10-05T19:50:34.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 20 add_watcher() i=5 2023-10-05T19:50:34.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 20 add_watcher() i=6 2023-10-05T19:50:34.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93826310740048] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x7ff46001a070 2023-10-05T19:50:34.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 20 add_watcher() i=7 2023-10-05T19:50:34.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:34.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ec5610 con 0x5555a3ead570 2023-10-05T19:50:34.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.705+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93826310742256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ec2ba0 con 0x5555a3ead570 2023-10-05T19:50:34.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93826310742256] v30'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff45800a5a0 con 0x5555a3ead570 2023-10-05T19:50:34.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff436fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff468015e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:34.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff468015e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:34.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff468015e40 1 Processor -- start 2023-10-05T19:50:34.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff468015e40 1 -- start start 2023-10-05T19:50:34.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff468015e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff468015e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a3ed06c0 con 0x5555a3ecfdb0 2023-10-05T19:50:34.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff465349700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff465349700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47398/0 (socket says 172.21.15.167:47398) 2023-10-05T19:50:34.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff465349700 1 -- 172.21.15.167:0/4155758371 learned_addr learned my addr 172.21.15.167:0/4155758371 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff465349700 1 -- 172.21.15.167:0/4155758371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555a3ed0800 con 0x5555a3ecfdb0 2023-10-05T19:50:34.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff465349700 1 --2- 172.21.15.167:0/4155758371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed0180 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5555a3df19e0 tx=0x7ff450012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76acb68caf58ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff4367e4700 1 -- 172.21.15.167:0/4155758371 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff45002d040 con 0x5555a3ecfdb0 2023-10-05T19:50:34.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff4367e4700 1 -- 172.21.15.167:0/4155758371 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450012d50 con 0x5555a3ecfdb0 2023-10-05T19:50:34.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.709+0000 7ff4367e4700 1 -- 172.21.15.167:0/4155758371 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff450028890 con 0x5555a3ecfdb0 2023-10-05T19:50:34.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 -- 172.21.15.167:0/4155758371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 msgr2=0x5555a3ed0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 --2- 172.21.15.167:0/4155758371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed0180 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5555a3df19e0 tx=0x7ff450012000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 -- 172.21.15.167:0/4155758371 shutdown_connections 2023-10-05T19:50:34.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 --2- 172.21.15.167:0/4155758371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed0180 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 -- 172.21.15.167:0/4155758371 >> 172.21.15.167:0/4155758371 conn(0x5555a3ecb170 msgr2=0x5555a3ec92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 -- 172.21.15.167:0/4155758371 shutdown_connections 2023-10-05T19:50:34.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 -- 172.21.15.167:0/4155758371 wait complete. 2023-10-05T19:50:34.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 Processor -- start 2023-10-05T19:50:34.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 -- start start 2023-10-05T19:50:34.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555a3ed6880 con 0x5555a3ecfdb0 2023-10-05T19:50:34.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff465349700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff465349700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47408/0 (socket says 172.21.15.167:47408) 2023-10-05T19:50:34.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff465349700 1 -- 172.21.15.167:0/2803941314 learned_addr learned my addr 172.21.15.167:0/2803941314 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff465349700 1 -- 172.21.15.167:0/2803941314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555a3df1a10 con 0x5555a3ecfdb0 2023-10-05T19:50:34.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff465349700 1 --2- 172.21.15.167:0/2803941314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed5880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5555a3ec9e30 tx=0x7ff45002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff434fe1700 1 -- 172.21.15.167:0/2803941314 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff450009430 con 0x5555a3ecfdb0 2023-10-05T19:50:34.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff434fe1700 1 -- 172.21.15.167:0/2803941314 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4500095b0 con 0x5555a3ecfdb0 2023-10-05T19:50:34.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 -- 172.21.15.167:0/2803941314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5555a3ed5e80 con 0x5555a3ecfdb0 2023-10-05T19:50:34.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff434fe1700 1 -- 172.21.15.167:0/2803941314 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff450009760 con 0x5555a3ecfdb0 2023-10-05T19:50:34.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.713+0000 7ff468015e40 1 -- 172.21.15.167:0/2803941314 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555a3ed6320 con 0x5555a3ecfdb0 2023-10-05T19:50:34.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.717+0000 7ff434fe1700 1 -- 172.21.15.167:0/2803941314 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff4500098c0 con 0x5555a3ecfdb0 2023-10-05T19:50:34.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.717+0000 7ff434fe1700 1 --2- 172.21.15.167:0/2803941314 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3ac030ca0 0x7ff3ac033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.717+0000 7ff434fe1700 1 -- 172.21.15.167:0/2803941314 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7ff450046c20 con 0x5555a3ecfdb0 2023-10-05T19:50:34.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.717+0000 7ff46634b700 1 --2- 172.21.15.167:0/2803941314 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3ac030ca0 0x7ff3ac033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.717+0000 7ff468015e40 5 note: GC not initialized 2023-10-05T19:50:34.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.717+0000 7ff46634b700 1 --2- 172.21.15.167:0/2803941314 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3ac030ca0 0x7ff3ac033150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5555a3ec2b00 tx=0x7ff45800ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.717+0000 7ff39f7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:34.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.717+0000 7ff468015e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:34.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.717+0000 7ff3a5ffb700 20 reqs_thread_entry: start 2023-10-05T19:50:34.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:34.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff39d7fa700 20 reqs_thread_entry: start 2023-10-05T19:50:34.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 20 get_system_obj_state: rctx=0x7fff6b8dcf98 obj=default.rgw.meta:users.uid:foo state=0x5555a3d550b0 s->prefetch_data=0 2023-10-05T19:50:34.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:34.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f3e0d0 con 0x5555a3ead570 2023-10-05T19:50:34.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff39dffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:04 2023 2023-10-05T19:50:34.727 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:34.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff45803d050 con 0x5555a3ead570 2023-10-05T19:50:34.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:34.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:34.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:34.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:34.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:34.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f40b60 con 0x5555a3ead570 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7ff45803d050 con 0x5555a3ead570 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 20 get_system_obj_state: rctx=0x7fff6b8dc7e8 obj=default.rgw.meta:users.swift:foo:foo1 state=0x5555a3d550b0 s->prefetch_data=0 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.8 8:17d68d04:users.swift::foo%3afoo1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f3eb40 con 0x5555a3ead570 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 foo:foo1 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7ff45803d050 con 0x5555a3ead570 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2023-10-05T19:50:34.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2023-10-05T19:50:34.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 20 get_system_obj_state: rctx=0x7fff6b8dce88 obj=default.rgw.meta:users.swift:foo:foo1 state=0x5555a3d550b0 s->prefetch_data=0 2023-10-05T19:50:34.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2023-10-05T19:50:34.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.721+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f41de0 con 0x5555a3ead570 2023-10-05T19:50:34.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~513] v30'6 uv6 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7ff45803d050 con 0x5555a3ead570 2023-10-05T19:50:34.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff468015e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:34.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff468015e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff468015e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:34.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 93826311264816 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f40ba0 con 0x5555a3eb0760 2023-10-05T19:50:34.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 93826310729504 notify 128849018887 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x7ff46005e040 con 0x5555a3eb0760 2023-10-05T19:50:34.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff45effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 93826310729504 notifier 4343 bl.length()=689 2023-10-05T19:50:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff45effd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff45effd700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.4 [notify cookie 93826311264816 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff45effd700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff444003d90 con 0x5555a3eb0760 2023-10-05T19:50:34.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== watch-notify(notify_complete (2) cookie 93826311264816 notify 128849018887 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5555a3ea4410 con 0x5555a3eb0760 2023-10-05T19:50:34.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.725+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f41a30 con 0x5555a3ead570 2023-10-05T19:50:34.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(108 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7ff45803d050 con 0x5555a3ead570 2023-10-05T19:50:34.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff468015e40 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2023-10-05T19:50:34.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff468015e40 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2023-10-05T19:50:34.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff468015e40 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2023-10-05T19:50:34.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93826311264816 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f40670 con 0x5555a3eb0760 2023-10-05T19:50:34.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== watch-notify(notify (1) cookie 93826310720752 notify 128849018888 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x5555a3ea4410 con 0x5555a3eb0760 2023-10-05T19:50:34.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff45f7fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 93826310720752 notifier 4343 bl.length()=166 2023-10-05T19:50:34.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff45f7fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2023-10-05T19:50:34.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff45f7fe700 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2023-10-05T19:50:34.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(109 notify.0 [notify cookie 93826311264816 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff45f7fe700 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3b4003410 con 0x5555a3eb0760 2023-10-05T19:50:34.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(110 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== watch-notify(notify_complete (2) cookie 93826311264816 notify 128849018888 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5555a3ea3fd0 con 0x5555a3eb0760 2023-10-05T19:50:34.737 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:34.737 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [ 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo1", 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "full-control" 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.738 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [ 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo1", 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "zeEiwKVDZhiUh2oPcruGYELGNuAHaDc1Xwn8AvS3" 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.739 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.740 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:34.741 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:34.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.729+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93826310720752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f412c0 con 0x5555a3eb0760 2023-10-05T19:50:34.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.733+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(111 notify.0 [watch unwatch cookie 93826310720752] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.733+0000 7ff468015e40 20 remove_watcher() i=0 2023-10-05T19:50:34.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.733+0000 7ff468015e40 2 removed watcher, disabling cache 2023-10-05T19:50:34.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.733+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93826310724176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f41ae0 con 0x5555a3ead570 2023-10-05T19:50:34.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.733+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(112 notify.1 [watch unwatch cookie 93826310724176] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45803d050 con 0x5555a3ead570 2023-10-05T19:50:34.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.733+0000 7ff468015e40 20 remove_watcher() i=1 2023-10-05T19:50:34.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.733+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93826310726544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3e934c0 con 0x5555a3eb0760 2023-10-05T19:50:34.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.737+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(113 notify.2 [watch unwatch cookie 93826310726544] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46004f040 con 0x5555a3eb0760 2023-10-05T19:50:34.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.737+0000 7ff468015e40 20 remove_watcher() i=2 2023-10-05T19:50:34.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.737+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93826310725280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f41ae0 con 0x7ff46001a070 2023-10-05T19:50:34.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.737+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(114 notify.3 [watch unwatch cookie 93826310725280] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45803d050 con 0x7ff46001a070 2023-10-05T19:50:34.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.737+0000 7ff468015e40 20 remove_watcher() i=3 2023-10-05T19:50:34.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.737+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:115 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93826310729504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3ebdf40 con 0x5555a3eb0760 2023-10-05T19:50:34.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.741+0000 7ff465b4a700 1 -- 172.21.15.167:0/559898982 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(115 notify.4 [watch unwatch cookie 93826310729504] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff46006d040 con 0x5555a3eb0760 2023-10-05T19:50:34.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.741+0000 7ff468015e40 20 remove_watcher() i=4 2023-10-05T19:50:34.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.741+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93826310733056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3e934c0 con 0x5555a3eb66d0 2023-10-05T19:50:34.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.741+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(116 notify.5 [watch unwatch cookie 93826310733056] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff450039020 con 0x5555a3eb66d0 2023-10-05T19:50:34.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.741+0000 7ff468015e40 20 remove_watcher() i=5 2023-10-05T19:50:34.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.741+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93826310731792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f41ae0 con 0x5555a3eb66d0 2023-10-05T19:50:34.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.745+0000 7ff465349700 1 -- 172.21.15.167:0/559898982 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(117 notify.6 [watch unwatch cookie 93826310731792] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff450039020 con 0x5555a3eb66d0 2023-10-05T19:50:34.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.745+0000 7ff468015e40 20 remove_watcher() i=6 2023-10-05T19:50:34.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.745+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:118 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93826310740048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3e934c0 con 0x7ff46001a070 2023-10-05T19:50:34.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.745+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(118 notify.7 [watch unwatch cookie 93826310740048] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff45803d050 con 0x7ff46001a070 2023-10-05T19:50:34.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.745+0000 7ff468015e40 20 remove_watcher() i=7 2023-10-05T19:50:34.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff436fe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:119 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93826310742256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5555a3f41ae0 con 0x5555a3ead570 2023-10-05T19:50:34.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(119 data_loggenerations_metadata [watch unwatch cookie 93826310742256] v30'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff45803d050 con 0x5555a3ead570 2023-10-05T19:50:34.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5555a3eb0760 msgr2=0x5555a3eb3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5555a3eb0760 0x5555a3eb3940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5555a3ead570 msgr2=0x5555a3eaf950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5555a3ead570 0x5555a3eaf950 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff46001a070 msgr2=0x7ff460042df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff46001a070 0x7ff460042df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5555a3eb66d0 msgr2=0x5555a3eb8ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5555a3eb66d0 0x5555a3eb8ab0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff448030c00 msgr2=0x7ff4480330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff448030c00 0x7ff4480330b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5555a3df0640 tx=0x7ff450015000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff46634b700 1 -- 172.21.15.167:0/559898982 reap_dead start 2023-10-05T19:50:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 msgr2=0x5555a3ea3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3ea3a90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff4600018e0 tx=0x7ff460016000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 shutdown_connections 2023-10-05T19:50:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 --2- 172.21.15.167:0/559898982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3df1580 0x5555a3ea3a90 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff4600018e0 tx=0x7ff460016000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 >> 172.21.15.167:0/559898982 conn(0x5555a3e77350 msgr2=0x5555a3e97300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.749+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 shutdown_connections 2023-10-05T19:50:34.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 -- 172.21.15.167:0/559898982 wait complete. 2023-10-05T19:50:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 -- 172.21.15.167:0/2803941314 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3ac030ca0 msgr2=0x7ff3ac033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 --2- 172.21.15.167:0/2803941314 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3ac030ca0 0x7ff3ac033150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x5555a3ec2b00 tx=0x7ff45800ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 -- 172.21.15.167:0/2803941314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 msgr2=0x5555a3ed5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 --2- 172.21.15.167:0/2803941314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed5880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5555a3ec9e30 tx=0x7ff45002c000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 -- 172.21.15.167:0/2803941314 shutdown_connections 2023-10-05T19:50:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 --2- 172.21.15.167:0/2803941314 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff3ac030ca0 0x7ff3ac033150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 --2- 172.21.15.167:0/2803941314 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5555a3ecfdb0 0x5555a3ed5880 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 -- 172.21.15.167:0/2803941314 >> 172.21.15.167:0/2803941314 conn(0x5555a3ecb170 msgr2=0x5555a3ec9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 -- 172.21.15.167:0/2803941314 shutdown_connections 2023-10-05T19:50:34.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.753+0000 7ff468015e40 1 -- 172.21.15.167:0/2803941314 wait complete. 2023-10-05T19:50:34.765 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'zeEiwKVDZhiUh2oPcruGYELGNuAHaDc1Xwn8AvS3'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:34.766 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2023-10-05T19:50:34.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2023-10-05T19:50:34.766 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2023-10-05T19:50:34.849 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:34.849 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:34.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 Processor -- start 2023-10-05T19:50:34.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 -- start start 2023-10-05T19:50:34.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a003ae6af0 0x55a003ae6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a003a31bd0 con 0x55a003ae7400 2023-10-05T19:50:34.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a0039eeee0 con 0x55a003ae6af0 2023-10-05T19:50:34.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0823f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a003ae6af0 0x55a003ae6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb07a3e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55a003ae7400 0x55a003ae7e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39962/0 (socket says 172.21.15.167:39962) 2023-10-05T19:50:34.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb07a3e700 1 -- 172.21.15.167:0/3039785589 learned_addr learned my addr 172.21.15.167:0/3039785589 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:34.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0823f700 1 -- 172.21.15.167:0/3039785589 >> v1:172.21.15.118:6789/0 conn(0x55a003ae7400 legacy=0x55a003ae7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0723d700 1 -- 172.21.15.167:0/3039785589 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407178074 0 0) 0x55a003a31bd0 con 0x55a003ae7400 2023-10-05T19:50:34.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0823f700 1 -- 172.21.15.167:0/3039785589 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a003ae85a0 con 0x55a003ae6af0 2023-10-05T19:50:34.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0823f700 1 --2- 172.21.15.167:0/3039785589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003ae6ec0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800a5d0 tx=0x7fbaf8005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b148995365857ae server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0723d700 1 -- 172.21.15.167:0/3039785589 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf80086a0 con 0x55a003ae6af0 2023-10-05T19:50:34.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0723d700 1 -- 172.21.15.167:0/3039785589 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf8008800 con 0x55a003ae6af0 2023-10-05T19:50:34.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0723d700 1 -- 172.21.15.167:0/3039785589 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf8008ad0 con 0x55a003ae6af0 2023-10-05T19:50:34.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/3039785589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 msgr2=0x55a003ae6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/3039785589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003ae6ec0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800a5d0 tx=0x7fbaf8005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:34.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/3039785589 shutdown_connections 2023-10-05T19:50:34.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/3039785589 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003ae6ec0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/3039785589 >> 172.21.15.167:0/3039785589 conn(0x55a003a5a560 msgr2=0x55a003a5a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/3039785589 shutdown_connections 2023-10-05T19:50:34.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.845+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/3039785589 wait complete. 2023-10-05T19:50:34.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 Processor -- start 2023-10-05T19:50:34.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 -- start start 2023-10-05T19:50:34.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b05a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0039b2e30 con 0x55a003ae6af0 2023-10-05T19:50:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0823f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b05a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0823f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b05a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47432/0 (socket says 172.21.15.167:47432) 2023-10-05T19:50:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0823f700 1 -- 172.21.15.167:0/2964064802 learned_addr learned my addr 172.21.15.167:0/2964064802 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0823f700 1 -- 172.21.15.167:0/2964064802 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf8005cf0 con 0x55a003ae6af0 2023-10-05T19:50:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0823f700 1 --2- 172.21.15.167:0/2964064802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b05a10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8005a90 tx=0x7fbaf8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3309754a97fc783 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0623b700 1 -- 172.21.15.167:0/2964064802 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf8008a40 con 0x55a003ae6af0 2023-10-05T19:50:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0623b700 1 -- 172.21.15.167:0/2964064802 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf8008ba0 con 0x55a003ae6af0 2023-10-05T19:50:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0623b700 1 -- 172.21.15.167:0/2964064802 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf8008e70 con 0x55a003ae6af0 2023-10-05T19:50:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2964064802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 msgr2=0x55a003b05a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/2964064802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b05a10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8005a90 tx=0x7fbaf8015000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2964064802 shutdown_connections 2023-10-05T19:50:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/2964064802 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b05a10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2964064802 >> 172.21.15.167:0/2964064802 conn(0x55a003a5a560 msgr2=0x55a003b01550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2964064802 shutdown_connections 2023-10-05T19:50:34.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2964064802 wait complete. 2023-10-05T19:50:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 Processor -- start 2023-10-05T19:50:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 -- start start 2023-10-05T19:50:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b0c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0a70ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a003985ed0 con 0x55a003ae6af0 2023-10-05T19:50:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0823f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b0c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0823f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b0c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47448/0 (socket says 172.21.15.167:47448) 2023-10-05T19:50:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.849+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 learned_addr learned my addr 172.21.15.167:0/308578070 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a003ae85a0 con 0x55a003ae6af0 2023-10-05T19:50:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb0823f700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b0c690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbaf801e040 tx=0x7fbaf8003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb04a38700 1 -- 172.21.15.167:0/308578070 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf8012b50 con 0x55a003ae6af0 2023-10-05T19:50:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb04a38700 1 -- 172.21.15.167:0/308578070 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf802a070 con 0x55a003ae6af0 2023-10-05T19:50:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a003b0cbd0 con 0x55a003ae6af0 2023-10-05T19:50:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb04a38700 1 -- 172.21.15.167:0/308578070 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf8012e10 con 0x55a003ae6af0 2023-10-05T19:50:34.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a003b0d070 con 0x55a003ae6af0 2023-10-05T19:50:34.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb04a38700 1 -- 172.21.15.167:0/308578070 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fbaf8019070 con 0x55a003ae6af0 2023-10-05T19:50:34.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb04a38700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbae8030ca0 0x7fbae8033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.853+0000 7fbb04a38700 1 -- 172.21.15.167:0/308578070 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fbaf802c070 con 0x55a003ae6af0 2023-10-05T19:50:34.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb07a3e700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbae8030ca0 0x7fbae8033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a003ae7400 0x55a003b181b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b18820 con 0x55a003ae7400 2023-10-05T19:50:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb08a40700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a003ae7400 0x55a003b181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb07a3e700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbae8030ca0 0x7fbae8033150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00011e0 tx=0x7fbaf00013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb08a40700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a003ae7400 0x55a003b181b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 20 realm 2023-10-05T19:50:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b15810 con 0x55a003ae7400 2023-10-05T19:50:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b19300 con 0x55a003ae7400 2023-10-05T19:50:34.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a003b1a130 0x55a003b1c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b1ca50 con 0x55a003b1a130 2023-10-05T19:50:34.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.857+0000 7fbb0823f700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a003b1a130 0x55a003b1c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0823f700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a003b1a130 0x55a003b1c510 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b1d2f0 con 0x55a003ae7400 2023-10-05T19:50:34.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0a70ae40 20 searching for the correct realm 2023-10-05T19:50:34.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a003b1f0b0 0x55a003b21490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b219d0 con 0x55a003b1f0b0 2023-10-05T19:50:34.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb07a3e700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a003b1f0b0 0x55a003b21490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb07a3e700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a003b1f0b0 0x55a003b21490 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0006070 con 0x55a003b1f0b0 2023-10-05T19:50:34.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b219d0 con 0x55a003b1a130 2023-10-05T19:50:34.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0823f700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbaf8007030 0x7fbaf80113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x7fbaf8007030 2023-10-05T19:50:34.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.861+0000 7fbb08a40700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbaf8007030 0x7fbaf80113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb08a40700 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbaf8007030 0x7fbaf80113b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1f0b0 2023-10-05T19:50:34.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0006070 con 0x55a003b1f0b0 2023-10-05T19:50:34.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1a130 2023-10-05T19:50:34.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.865+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1a130 2023-10-05T19:50:34.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x7fbaf8007030 2023-10-05T19:50:34.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x7fbaf8007030 2023-10-05T19:50:34.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1a130 2023-10-05T19:50:34.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.869+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1f0b0 2023-10-05T19:50:34.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0006070 con 0x55a003b1f0b0 2023-10-05T19:50:34.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1a130 2023-10-05T19:50:34.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1f0b0 2023-10-05T19:50:34.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0006070 con 0x55a003b1f0b0 2023-10-05T19:50:34.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.873+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1f0b0 2023-10-05T19:50:34.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0006070 con 0x55a003b1f0b0 2023-10-05T19:50:34.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x7fbaf8007030 2023-10-05T19:50:34.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003ae7400 2023-10-05T19:50:34.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x7fbaf8007030 2023-10-05T19:50:34.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1f0b0 2023-10-05T19:50:34.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0006070 con 0x55a003b1f0b0 2023-10-05T19:50:34.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x7fbaf8007030 2023-10-05T19:50:34.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1a130 2023-10-05T19:50:34.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.877+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1a130 2023-10-05T19:50:34.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1f0b0 2023-10-05T19:50:34.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0006070 con 0x55a003b1f0b0 2023-10-05T19:50:34.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1a130 2023-10-05T19:50:34.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf8046040 con 0x55a003b1a130 2023-10-05T19:50:34.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0a70ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0a70ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0a70ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0a70ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b1de60 con 0x55a003ae7400 2023-10-05T19:50:34.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.881+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b1e7b0 con 0x55a003b1a130 2023-10-05T19:50:34.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbaf8022020 con 0x55a003b1a130 2023-10-05T19:50:34.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003b1a130 2023-10-05T19:50:34.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b221c0 con 0x55a003b1f0b0 2023-10-05T19:50:34.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fbaf0006070 con 0x55a003b1f0b0 2023-10-05T19:50:34.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b22570 con 0x55a003ae7400 2023-10-05T19:50:34.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.885+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b1e320 con 0x55a003b1a130 2023-10-05T19:50:34.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b1e2f0 con 0x55a003b1f0b0 2023-10-05T19:50:34.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b1e2f0 con 0x55a003b1a130 2023-10-05T19:50:34.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x7fbaf8007030 2023-10-05T19:50:34.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003ae7400 2023-10-05T19:50:34.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003ae7400 2023-10-05T19:50:34.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.889+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003b1f0b0 2023-10-05T19:50:34.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003ae7400 2023-10-05T19:50:34.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003b1a130 2023-10-05T19:50:34.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003b1a130 2023-10-05T19:50:34.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003ae7400 2023-10-05T19:50:34.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x7fbaf8007030 2023-10-05T19:50:34.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.893+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003ae7400 2023-10-05T19:50:34.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x7fbaf8007030 2023-10-05T19:50:34.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003b1a130 2023-10-05T19:50:34.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b21e10 con 0x55a003b1f0b0 2023-10-05T19:50:34.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003ae7400 2023-10-05T19:50:34.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003b1a130 2023-10-05T19:50:34.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.897+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003b1f0b0 2023-10-05T19:50:34.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003ae7400 2023-10-05T19:50:34.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003ae7400 2023-10-05T19:50:34.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003ae7400 2023-10-05T19:50:34.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003b1f0b0 2023-10-05T19:50:34.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x7fbaf8007030 2023-10-05T19:50:34.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.901+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003ae7400 2023-10-05T19:50:34.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x7fbaf8007030 2023-10-05T19:50:34.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003b1f0b0 2023-10-05T19:50:34.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x7fbaf8007030 2023-10-05T19:50:34.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003b1a130 2023-10-05T19:50:34.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003b1a130 2023-10-05T19:50:34.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.905+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003b1f0b0 2023-10-05T19:50:34.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003b1a130 2023-10-05T19:50:34.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaf0028040 con 0x55a003b1a130 2023-10-05T19:50:34.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:34.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:34.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:34.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:34.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b1e2f0 con 0x55a003b1a130 2023-10-05T19:50:34.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b1e2f0 con 0x55a003ae7400 2023-10-05T19:50:34.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:34.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.909+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b23020 con 0x55a003b1a130 2023-10-05T19:50:34.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:34.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b230b0 con 0x55a003b1a130 2023-10-05T19:50:34.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:34.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b234f0 con 0x7fbaf8007030 2023-10-05T19:50:34.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 zone default found 2023-10-05T19:50:34.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 4 Realm: () 2023-10-05T19:50:34.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:34.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:34.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:34.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 zonegroup default 2023-10-05T19:50:34.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b234f0 con 0x7fbaf8007030 2023-10-05T19:50:34.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b24e70 con 0x55a003b1f0b0 2023-10-05T19:50:34.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.913+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b25220 con 0x55a003b1f0b0 2023-10-05T19:50:34.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.917+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.917+0000 7fbb0a70ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:34.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.917+0000 7fbb0a70ae40 20 started sync module instance, tier type = 2023-10-05T19:50:34.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.917+0000 7fbb0a70ae40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:34.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.917+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b24530 con 0x55a003b1a130 2023-10-05T19:50:34.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.917+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.917+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94145745136320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b255d0 con 0x55a003b1a130 2023-10-05T19:50:34.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.917+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b25e70 con 0x55a003ae7400 2023-10-05T19:50:34.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.921+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94145745136320] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.921+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.921+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94145745144112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b25ac0 con 0x55a003ae7400 2023-10-05T19:50:34.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.921+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b26360 con 0x55a003b1a130 2023-10-05T19:50:34.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.921+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94145745144112] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.921+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.921+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94145745147632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b26030 con 0x55a003b1a130 2023-10-05T19:50:34.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.921+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b26c50 con 0x7fbaf8007030 2023-10-05T19:50:34.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.925+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.925+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94145745151840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b26bb0 con 0x7fbaf8007030 2023-10-05T19:50:34.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.925+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b27ba0 con 0x55a003b1a130 2023-10-05T19:50:34.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.925+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94145745147632] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.925+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.925+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94145745148736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b27ba0 con 0x55a003b1a130 2023-10-05T19:50:34.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.925+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b285b0 con 0x55a003b1f0b0 2023-10-05T19:50:34.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.925+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94145745151840] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.929+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94145745148736] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.929+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.929+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94145745154128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b27ba0 con 0x55a003b1f0b0 2023-10-05T19:50:34.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.929+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b28e50 con 0x55a003b1f0b0 2023-10-05T19:50:34.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.929+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.929+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94145745162752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b29b40 con 0x55a003b1f0b0 2023-10-05T19:50:34.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.929+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94145745154128] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.929+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b29ef0 con 0x7fbaf8007030 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94145745165120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b2a480 con 0x7fbaf8007030 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94145745162752] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 20 add_watcher() i=0 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 20 add_watcher() i=1 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 20 add_watcher() i=2 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 20 add_watcher() i=3 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 20 add_watcher() i=4 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 20 add_watcher() i=5 2023-10-05T19:50:34.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 20 add_watcher() i=6 2023-10-05T19:50:34.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94145745165120] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 20 add_watcher() i=7 2023-10-05T19:50:34.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:34.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b2d000 con 0x55a003ae7400 2023-10-05T19:50:34.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.933+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94145745163856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b2a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94145745163856] v30'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbad9fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:34.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:34.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 Processor -- start 2023-10-05T19:50:34.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 -- start start 2023-10-05T19:50:34.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b37c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a003b381d0 con 0x55a003b378c0 2023-10-05T19:50:34.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb07a3e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b37c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb07a3e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b37c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47458/0 (socket says 172.21.15.167:47458) 2023-10-05T19:50:34.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb07a3e700 1 -- 172.21.15.167:0/2586050536 learned_addr learned my addr 172.21.15.167:0/2586050536 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb07a3e700 1 -- 172.21.15.167:0/2586050536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a003b38310 con 0x55a003b378c0 2023-10-05T19:50:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb07a3e700 1 --2- 172.21.15.167:0/2586050536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b37c90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55a003b1dd50 tx=0x7fbaf0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e6e3b789450c88 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbad97e2700 1 -- 172.21.15.167:0/2586050536 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf003b070 con 0x55a003b378c0 2023-10-05T19:50:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbad97e2700 1 -- 172.21.15.167:0/2586050536 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf0022040 con 0x55a003b378c0 2023-10-05T19:50:34.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbad97e2700 1 -- 172.21.15.167:0/2586050536 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf0021040 con 0x55a003b378c0 2023-10-05T19:50:34.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2586050536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 msgr2=0x55a003b37c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/2586050536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b37c90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55a003b1dd50 tx=0x7fbaf0010000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2586050536 shutdown_connections 2023-10-05T19:50:34.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/2586050536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b37c90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2586050536 >> 172.21.15.167:0/2586050536 conn(0x55a003b32c80 msgr2=0x55a003b30dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2586050536 shutdown_connections 2023-10-05T19:50:34.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2586050536 wait complete. 2023-10-05T19:50:34.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.937+0000 7fbb0a70ae40 1 Processor -- start 2023-10-05T19:50:34.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb0a70ae40 1 -- start start 2023-10-05T19:50:34.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb0a70ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b3d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb0a70ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a003b3e400 con 0x55a003b378c0 2023-10-05T19:50:34.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb07a3e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b3d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb07a3e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b3d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47466/0 (socket says 172.21.15.167:47466) 2023-10-05T19:50:34.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb07a3e700 1 -- 172.21.15.167:0/2480901599 learned_addr learned my addr 172.21.15.167:0/2480901599 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb07a3e700 1 -- 172.21.15.167:0/2480901599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf000eaf0 con 0x55a003b378c0 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb07a3e700 1 --2- 172.21.15.167:0/2480901599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b3d400 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55a003b18ea0 tx=0x7fbaf0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fba537fe700 1 -- 172.21.15.167:0/2480901599 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf0021070 con 0x55a003b378c0 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2480901599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a003b3da00 con 0x55a003b378c0 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fba537fe700 1 -- 172.21.15.167:0/2480901599 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf0036e70 con 0x55a003b378c0 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fba537fe700 1 -- 172.21.15.167:0/2480901599 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbaf0046070 con 0x55a003b378c0 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2480901599 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a003b3dea0 con 0x55a003b378c0 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fba537fe700 1 -- 172.21.15.167:0/2480901599 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fbaf003e020 con 0x55a003b378c0 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fba537fe700 1 --2- 172.21.15.167:0/2480901599 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fba48030c00 0x7fba480330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fba537fe700 1 -- 172.21.15.167:0/2480901599 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fbaf002e040 con 0x55a003b378c0 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb0a70ae40 5 note: GC not initialized 2023-10-05T19:50:34.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.941+0000 7fbb08a40700 1 --2- 172.21.15.167:0/2480901599 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fba48030c00 0x7fba480330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:34.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fbb08a40700 1 --2- 172.21.15.167:0/2480901599 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fba48030c00 0x7fba480330b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55a003b2a500 tx=0x7fbb0000ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:34.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fba50ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:34.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fba467fc700 20 reqs_thread_entry: start 2023-10-05T19:50:34.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fbb0a70ae40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:34.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fbb0a70ae40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:34.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fba44ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:05 2023 2023-10-05T19:50:34.954 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:34.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fba33fff700 20 reqs_thread_entry: start 2023-10-05T19:50:34.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fbb0a70ae40 20 get_system_obj_state: rctx=0x7ffe4e229408 obj=default.rgw.meta:users.uid:foo state=0x55a0039be0b0 s->prefetch_data=0 2023-10-05T19:50:34.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fbb0a70ae40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:34.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.945+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003ba5c90 con 0x55a003ae7400 2023-10-05T19:50:34.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:34.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:34.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:34.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:34.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:34.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:34.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003ba8720 con 0x55a003ae7400 2023-10-05T19:50:34.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T19:50:34.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:34.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:34.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003ba4d20 con 0x55a003ae7400 2023-10-05T19:50:34.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~513] v30'7 uv7 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:34.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:34.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.949+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94145745668144 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003ba9240 con 0x55a003b1a130 2023-10-05T19:50:34.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.953+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94145745148736 notify 128849018889 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x55a003b0d070 con 0x55a003b1a130 2023-10-05T19:50:34.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.953+0000 7fbb0623b700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94145745148736 notifier 4349 bl.length()=689 2023-10-05T19:50:34.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.953+0000 7fbb0623b700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:34.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.953+0000 7fbb0623b700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:34.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.953+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.4 [notify cookie 94145745668144 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.953+0000 7fbb0623b700 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fbaec003d90 con 0x55a003b1a130 2023-10-05T19:50:34.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.953+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.953+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94145745668144 notify 128849018889 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a003b0cbd0 con 0x55a003b1a130 2023-10-05T19:50:34.960 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [ 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo1", 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "full-control" 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.961 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [ 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo1", 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T19:50:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.963 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:34.964 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:34.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.953+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94145745136320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003afc1f0 con 0x55a003b1a130 2023-10-05T19:50:34.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.957+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94145745136320] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.957+0000 7fbb0a70ae40 20 remove_watcher() i=0 2023-10-05T19:50:34.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.957+0000 7fbb0a70ae40 2 removed watcher, disabling cache 2023-10-05T19:50:34.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.957+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94145745144112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b22ac0 con 0x55a003ae7400 2023-10-05T19:50:34.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.957+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94145745144112] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.957+0000 7fbb0a70ae40 20 remove_watcher() i=1 2023-10-05T19:50:34.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.957+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94145745147632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003afc1f0 con 0x55a003b1a130 2023-10-05T19:50:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.961+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94145745147632] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.961+0000 7fbb0a70ae40 20 remove_watcher() i=2 2023-10-05T19:50:34.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.961+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94145745151840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b24930 con 0x7fbaf8007030 2023-10-05T19:50:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.961+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94145745151840] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.961+0000 7fbb0a70ae40 20 remove_watcher() i=3 2023-10-05T19:50:34.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.961+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94145745148736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b256f0 con 0x55a003b1a130 2023-10-05T19:50:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.965+0000 7fbb0823f700 1 -- 172.21.15.167:0/308578070 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94145745148736] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf805a040 con 0x55a003b1a130 2023-10-05T19:50:34.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.965+0000 7fbb0a70ae40 20 remove_watcher() i=4 2023-10-05T19:50:34.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.965+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94145745154128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003afc1f0 con 0x55a003b1f0b0 2023-10-05T19:50:34.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.965+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94145745154128] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.965+0000 7fbb0a70ae40 20 remove_watcher() i=5 2023-10-05T19:50:34.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.965+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94145745162752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b26760 con 0x55a003b1f0b0 2023-10-05T19:50:34.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.965+0000 7fbb07a3e700 1 -- 172.21.15.167:0/308578070 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94145745162752] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbaf0024040 con 0x55a003b1f0b0 2023-10-05T19:50:34.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.965+0000 7fbb0a70ae40 20 remove_watcher() i=6 2023-10-05T19:50:34.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.965+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94145745165120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003afc1f0 con 0x7fbaf8007030 2023-10-05T19:50:34.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.969+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94145745165120] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x7fbaf8007030 2023-10-05T19:50:34.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.969+0000 7fbb0a70ae40 20 remove_watcher() i=7 2023-10-05T19:50:34.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.969+0000 7fbad9fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:34.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.969+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94145745163856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a003b29200 con 0x55a003ae7400 2023-10-05T19:50:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94145745163856] v30'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbb0000a5a0 con 0x55a003ae7400 2023-10-05T19:50:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a003b1a130 msgr2=0x55a003b1c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a003b1a130 0x55a003b1c510 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a003ae7400 msgr2=0x55a003b181b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a003ae7400 0x55a003b181b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbaf8007030 msgr2=0x7fbaf80113b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fbaf8007030 0x7fbaf80113b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a003b1f0b0 msgr2=0x55a003b21490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a003b1f0b0 0x55a003b21490 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbae8030ca0 msgr2=0x7fbae8033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fbae8030ca0 0x7fbae8033150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00011e0 tx=0x7fbaf00013a0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 msgr2=0x55a003b0c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb08a40700 1 -- 172.21.15.167:0/308578070 reap_dead start 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b0c690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbaf801e040 tx=0x7fbaf8003050 comp rx=0 tx=0).stop 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 shutdown_connections 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/308578070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003ae6af0 0x55a003b0c690 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbaf801e040 tx=0x7fbaf8003050 comp rx=0 tx=0).stop 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 >> 172.21.15.167:0/308578070 conn(0x55a003a5a560 msgr2=0x55a003afffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 shutdown_connections 2023-10-05T19:50:34.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/308578070 wait complete. 2023-10-05T19:50:34.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2480901599 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fba48030c00 msgr2=0x7fba480330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/2480901599 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fba48030c00 0x7fba480330b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55a003b2a500 tx=0x7fbb0000ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:34.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2480901599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 msgr2=0x55a003b3d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/2480901599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b3d400 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55a003b18ea0 tx=0x7fbaf0037000 comp rx=0 tx=0).stop 2023-10-05T19:50:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2480901599 shutdown_connections 2023-10-05T19:50:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/2480901599 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fba48030c00 0x7fba480330b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 --2- 172.21.15.167:0/2480901599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a003b378c0 0x55a003b3d400 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2480901599 >> 172.21.15.167:0/2480901599 conn(0x55a003b32c80 msgr2=0x55a003b30d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2480901599 shutdown_connections 2023-10-05T19:50:34.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:34.973+0000 7fbb0a70ae40 1 -- 172.21.15.167:0/2480901599 wait complete. 2023-10-05T19:50:34.987 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:34.987 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T19:50:34.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T19:50:34.988 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T19:50:35.023 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:35.023 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:35.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2fbadbe40 1 Processor -- start 2023-10-05T19:50:35.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2fbadbe40 1 -- start start 2023-10-05T19:50:35.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2fbadbe40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55606bee7260 0x55606bf7ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2fbadbe40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55606bebfbd0 con 0x55606bee8570 2023-10-05T19:50:35.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2fbadbe40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55606be7cee0 con 0x55606bee7260 2023-10-05T19:50:35.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2f8e0f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55606bee7260 0x55606bf7ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2f8e0f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55606bee7260 0x55606bf7ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47472/0 (socket says 172.21.15.167:47472) 2023-10-05T19:50:35.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/428236569 learned_addr learned my addr 172.21.15.167:0/428236569 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2f9610700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55606bee8570 0x55606bee6b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39974/0 (socket says 172.21.15.167:39974) 2023-10-05T19:50:35.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/428236569 >> v1:172.21.15.118:6789/0 conn(0x55606bee8570 legacy=0x55606bee6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/428236569 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55606bee8a00 con 0x55606bee7260 2023-10-05T19:50:35.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2f8e0f700 1 --2- 172.21.15.167:0/428236569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf7ba50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400a5c0 tx=0x7ff2e4005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfdcbe2f6b58ac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.017+0000 7ff2f3fff700 1 -- 172.21.15.167:0/428236569 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e400e510 con 0x55606bee7260 2023-10-05T19:50:35.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f3fff700 1 -- 172.21.15.167:0/428236569 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e400e670 con 0x55606bee7260 2023-10-05T19:50:35.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f3fff700 1 -- 172.21.15.167:0/428236569 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e400e920 con 0x55606bee7260 2023-10-05T19:50:35.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/428236569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 msgr2=0x55606bf7ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/428236569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf7ba50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400a5c0 tx=0x7ff2e4005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:35.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/428236569 shutdown_connections 2023-10-05T19:50:35.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/428236569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf7ba50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/428236569 >> 172.21.15.167:0/428236569 conn(0x55606bf6e340 msgr2=0x55606bf70750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/428236569 shutdown_connections 2023-10-05T19:50:35.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/428236569 wait complete. 2023-10-05T19:50:35.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 Processor -- start 2023-10-05T19:50:35.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 -- start start 2023-10-05T19:50:35.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf93be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2fbadbe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606be40e30 con 0x55606bee7260 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f9610700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf93be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f9610700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf93be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47478/0 (socket says 172.21.15.167:47478) 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f9610700 1 -- 172.21.15.167:0/2493891331 learned_addr learned my addr 172.21.15.167:0/2493891331 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f9610700 1 -- 172.21.15.167:0/2493891331 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e400a180 con 0x55606bee7260 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f9610700 1 --2- 172.21.15.167:0/2493891331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf93be0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec001cf0 tx=0x7ff2ec0018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f66efae2069b0ef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f2ffd700 1 -- 172.21.15.167:0/2493891331 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2ec014070 con 0x55606bee7260 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f2ffd700 1 -- 172.21.15.167:0/2493891331 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec00be10 con 0x55606bee7260 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.021+0000 7ff2f2ffd700 1 -- 172.21.15.167:0/2493891331 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2ec00f590 con 0x55606bee7260 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2493891331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 msgr2=0x55606bf93be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/2493891331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf93be0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec001cf0 tx=0x7ff2ec0018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2493891331 shutdown_connections 2023-10-05T19:50:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/2493891331 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf93be0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2493891331 >> 172.21.15.167:0/2493891331 conn(0x55606bf6e340 msgr2=0x55606bf8f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2493891331 shutdown_connections 2023-10-05T19:50:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2493891331 wait complete. 2023-10-05T19:50:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 Processor -- start 2023-10-05T19:50:35.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 -- start start 2023-10-05T19:50:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf9a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606be13ed0 con 0x55606bee7260 2023-10-05T19:50:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2f9610700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf9a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2f9610700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf9a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47480/0 (socket says 172.21.15.167:47480) 2023-10-05T19:50:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 learned_addr learned my addr 172.21.15.167:0/838416278 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55606bebfbd0 con 0x55606bee7260 2023-10-05T19:50:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2f9610700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf9a9b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0018e0 tx=0x7ff2ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2f17fa700 1 -- 172.21.15.167:0/838416278 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2ec01c670 con 0x55606bee7260 2023-10-05T19:50:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2f17fa700 1 -- 172.21.15.167:0/838416278 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec01c7f0 con 0x55606bee7260 2023-10-05T19:50:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2f17fa700 1 -- 172.21.15.167:0/838416278 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2ec01cae0 con 0x55606bee7260 2023-10-05T19:50:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55606bf9aef0 con 0x55606bee7260 2023-10-05T19:50:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.025+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55606bf9b330 con 0x55606bee7260 2023-10-05T19:50:35.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2f17fa700 1 -- 172.21.15.167:0/838416278 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff2ec023020 con 0x55606bee7260 2023-10-05T19:50:35.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2f17fa700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2dc030c50 0x7ff2dc033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2f17fa700 1 -- 172.21.15.167:0/838416278 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7ff2ec008030 con 0x55606bee7260 2023-10-05T19:50:35.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55606bee8570 0x55606bfa6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2f8e0f700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2dc030c50 0x7ff2dc033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfa6b20 con 0x55606bee8570 2023-10-05T19:50:35.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2f9e11700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55606bee8570 0x55606bfa6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2f9e11700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55606bee8570 0x55606bfa6470 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2f8e0f700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2dc030c50 0x7ff2dc033100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4000f80 tx=0x7ff2e4013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff2f400a500 con 0x55606bee8570 2023-10-05T19:50:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 20 realm 2023-10-05T19:50:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfa3ad0 con 0x55606bee8570 2023-10-05T19:50:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff2f400a500 con 0x55606bee8570 2023-10-05T19:50:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.029+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfa7600 con 0x55606bee8570 2023-10-05T19:50:35.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff2f400a500 con 0x55606bee8570 2023-10-05T19:50:35.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55606bfa7230 0x55606bfaa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaaba0 con 0x55606bfa7230 2023-10-05T19:50:35.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2f9610700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55606bfa7230 0x55606bfaa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2f9610700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55606bfa7230 0x55606bfaa470 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff2ec016070 con 0x55606bfa7230 2023-10-05T19:50:35.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfab470 con 0x55606bee8570 2023-10-05T19:50:35.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff2f400a500 con 0x55606bee8570 2023-10-05T19:50:35.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 20 searching for the correct realm 2023-10-05T19:50:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55606bfaafe0 0x55606bfaf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfaafe0 2023-10-05T19:50:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2f8e0f700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55606bfaafe0 0x55606bfaf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.033+0000 7ff2f8e0f700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55606bfaafe0 0x55606bfaf240 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfa7230 2023-10-05T19:50:35.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec016070 con 0x55606bfa7230 2023-10-05T19:50:35.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f9610700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff2ec01a070 0x7ff2ec043760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x7ff2ec01a070 2023-10-05T19:50:35.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f9e11700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff2ec01a070 0x7ff2ec043760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f9e11700 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff2ec01a070 0x7ff2ec043760 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x7ff2ec01a070 2023-10-05T19:50:35.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.037+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfaafe0 2023-10-05T19:50:35.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfa7230 2023-10-05T19:50:35.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec016070 con 0x55606bfa7230 2023-10-05T19:50:35.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfa7230 2023-10-05T19:50:35.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec016070 con 0x55606bfa7230 2023-10-05T19:50:35.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x7ff2ec01a070 2023-10-05T19:50:35.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x7ff2ec01a070 2023-10-05T19:50:35.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.041+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x7ff2ec01a070 2023-10-05T19:50:35.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x7ff2ec01a070 2023-10-05T19:50:35.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfa7230 2023-10-05T19:50:35.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec039040 con 0x55606bfa7230 2023-10-05T19:50:35.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfaafe0 2023-10-05T19:50:35.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfa7230 2023-10-05T19:50:35.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec039040 con 0x55606bfa7230 2023-10-05T19:50:35.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfaafe0 2023-10-05T19:50:35.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.045+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfaafe0 2023-10-05T19:50:35.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x7ff2ec01a070 2023-10-05T19:50:35.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x7ff2ec01a070 2023-10-05T19:50:35.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bee8570 2023-10-05T19:50:35.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x7ff2ec01a070 2023-10-05T19:50:35.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x7ff2ec01a070 2023-10-05T19:50:35.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfaafe0 2023-10-05T19:50:35.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.049+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x7ff2ec01a070 2023-10-05T19:50:35.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x7ff2ec01a070 2023-10-05T19:50:35.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfa7230 2023-10-05T19:50:35.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec039040 con 0x55606bfa7230 2023-10-05T19:50:35.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfa7230 2023-10-05T19:50:35.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec039040 con 0x55606bfa7230 2023-10-05T19:50:35.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfaafe0 2023-10-05T19:50:35.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfa7230 2023-10-05T19:50:35.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff2ec039040 con 0x55606bfa7230 2023-10-05T19:50:35.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfaf820 con 0x55606bfa7230 2023-10-05T19:50:35.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec039040 con 0x55606bfa7230 2023-10-05T19:50:35.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2fbadbe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2fbadbe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2fbadbe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2fbadbe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.053+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfabfe0 con 0x55606bee8570 2023-10-05T19:50:35.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfac960 con 0x55606bfa7230 2023-10-05T19:50:35.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfabbd0 con 0x55606bfa7230 2023-10-05T19:50:35.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb01d0 con 0x55606bfaafe0 2023-10-05T19:50:35.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.057+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0930 con 0x55606bfa7230 2023-10-05T19:50:35.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb1cf0 con 0x55606bfaafe0 2023-10-05T19:50:35.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb1cf0 con 0x55606bfa7230 2023-10-05T19:50:35.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb1cf0 con 0x7ff2ec01a070 2023-10-05T19:50:35.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x7ff2ec01a070 2023-10-05T19:50:35.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.061+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfaafe0 2023-10-05T19:50:35.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfa7230 2023-10-05T19:50:35.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfa7230 2023-10-05T19:50:35.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x7ff2ec01a070 2023-10-05T19:50:35.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x7ff2ec01a070 2023-10-05T19:50:35.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.065+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x7ff2ec01a070 2023-10-05T19:50:35.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x7ff2ec01a070 2023-10-05T19:50:35.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfa7230 2023-10-05T19:50:35.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfaafe0 2023-10-05T19:50:35.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.069+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfa7230 2023-10-05T19:50:35.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfaafe0 2023-10-05T19:50:35.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4014040 con 0x55606bee8570 2023-10-05T19:50:35.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfaafe0 2023-10-05T19:50:35.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x7ff2ec01a070 2023-10-05T19:50:35.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.073+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bee8570 2023-10-05T19:50:35.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x7ff2ec01a070 2023-10-05T19:50:35.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfaafe0 2023-10-05T19:50:35.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x7ff2ec01a070 2023-10-05T19:50:35.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfa7230 2023-10-05T19:50:35.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfa7230 2023-10-05T19:50:35.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.077+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfaafe0 2023-10-05T19:50:35.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfa7230 2023-10-05T19:50:35.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0580 con 0x55606bfa7230 2023-10-05T19:50:35.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff2ec04c040 con 0x55606bfa7230 2023-10-05T19:50:35.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2fbadbe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2fbadbe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2fbadbe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2fbadbe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb0ce0 con 0x55606bfa7230 2023-10-05T19:50:35.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.081+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb1090 con 0x55606bee8570 2023-10-05T19:50:35.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb1930 con 0x55606bfa7230 2023-10-05T19:50:35.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb1ce0 con 0x55606bfa7230 2023-10-05T19:50:35.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb1ce0 con 0x7ff2ec01a070 2023-10-05T19:50:35.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 zone default found 2023-10-05T19:50:35.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 4 Realm: () 2023-10-05T19:50:35.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:35.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:35.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:35.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 zonegroup default 2023-10-05T19:50:35.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb1ce0 con 0x7ff2ec01a070 2023-10-05T19:50:35.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.085+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb3660 con 0x55606bfaafe0 2023-10-05T19:50:35.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb3a10 con 0x55606bfaafe0 2023-10-05T19:50:35.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2fbadbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2fbadbe40 20 started sync module instance, tier type = 2023-10-05T19:50:35.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2fbadbe40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:35.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb3210 con 0x55606bfa7230 2023-10-05T19:50:35.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93872616844576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb3170 con 0x55606bfa7230 2023-10-05T19:50:35.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.089+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb47a0 con 0x55606bee8570 2023-10-05T19:50:35.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.093+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93872616844576] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.093+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.093+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93872616845680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb42b0 con 0x55606bee8570 2023-10-05T19:50:35.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.093+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb4d00 con 0x55606bfa7230 2023-10-05T19:50:35.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.097+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93872616845680] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.097+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.097+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93872616851408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb42b0 con 0x55606bfa7230 2023-10-05T19:50:35.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.097+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb55f0 con 0x7ff2ec01a070 2023-10-05T19:50:35.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.097+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.097+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93872616851408] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.097+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93872616849120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb55f0 con 0x7ff2ec01a070 2023-10-05T19:50:35.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.097+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb5e90 con 0x55606bfa7230 2023-10-05T19:50:35.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.101+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93872616849120] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.101+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.101+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93872616854240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb5c20 con 0x55606bfa7230 2023-10-05T19:50:35.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.101+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb6770 con 0x55606bfaafe0 2023-10-05T19:50:35.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.101+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.101+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93872616858240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb7060 con 0x55606bfaafe0 2023-10-05T19:50:35.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.101+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93872616854240] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.101+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb7990 con 0x55606bfaafe0 2023-10-05T19:50:35.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93872616862880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb8230 con 0x55606bfaafe0 2023-10-05T19:50:35.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb8cb0 con 0x7ff2ec01a070 2023-10-05T19:50:35.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 93872616858240] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93872616862880] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2e4017050 con 0x55606bfaafe0 2023-10-05T19:50:35.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93872616865088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb8780 con 0x7ff2ec01a070 2023-10-05T19:50:35.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 20 add_watcher() i=0 2023-10-05T19:50:35.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 20 add_watcher() i=1 2023-10-05T19:50:35.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 20 add_watcher() i=2 2023-10-05T19:50:35.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 20 add_watcher() i=3 2023-10-05T19:50:35.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 20 add_watcher() i=4 2023-10-05T19:50:35.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 20 add_watcher() i=5 2023-10-05T19:50:35.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 20 add_watcher() i=6 2023-10-05T19:50:35.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93872616865088] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 20 add_watcher() i=7 2023-10-05T19:50:35.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:35.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb8780 con 0x55606bee8570 2023-10-05T19:50:35.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.105+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93872616860528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bfb9490 con 0x55606bee8570 2023-10-05T19:50:35.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93872616860528] v30'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2ca7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2fbadbe40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:35.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2fbadbe40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:35.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2fbadbe40 1 Processor -- start 2023-10-05T19:50:35.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2fbadbe40 1 -- start start 2023-10-05T19:50:35.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2fbadbe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfc65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2fbadbe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606bfc6af0 con 0x55606bfc61e0 2023-10-05T19:50:35.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2f8e0f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfc65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2f8e0f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfc65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47490/0 (socket says 172.21.15.167:47490) 2023-10-05T19:50:35.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/2348754277 learned_addr learned my addr 172.21.15.167:0/2348754277 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/2348754277 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55606bfc6c30 con 0x55606bfc61e0 2023-10-05T19:50:35.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.109+0000 7ff2f8e0f700 1 --2- 172.21.15.167:0/2348754277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfc65b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55606bee89d0 tx=0x7ff2e400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158629c3e027b663 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2c9fe3700 1 -- 172.21.15.167:0/2348754277 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e40108d0 con 0x55606bfc61e0 2023-10-05T19:50:35.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2c9fe3700 1 -- 172.21.15.167:0/2348754277 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e402e040 con 0x55606bfc61e0 2023-10-05T19:50:35.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2c9fe3700 1 -- 172.21.15.167:0/2348754277 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e4010a90 con 0x55606bfc61e0 2023-10-05T19:50:35.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2348754277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 msgr2=0x55606bfc65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/2348754277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfc65b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55606bee89d0 tx=0x7ff2e400f000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2348754277 shutdown_connections 2023-10-05T19:50:35.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/2348754277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfc65b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2348754277 >> 172.21.15.167:0/2348754277 conn(0x55606bfc15a0 msgr2=0x55606bfbf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2348754277 shutdown_connections 2023-10-05T19:50:35.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/2348754277 wait complete. 2023-10-05T19:50:35.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 Processor -- start 2023-10-05T19:50:35.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 -- start start 2023-10-05T19:50:35.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfcbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2fbadbe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606bfccb60 con 0x55606bfc61e0 2023-10-05T19:50:35.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2f8e0f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfcbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2f8e0f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfcbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47502/0 (socket says 172.21.15.167:47502) 2023-10-05T19:50:35.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/4166784147 learned_addr learned my addr 172.21.15.167:0/4166784147 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/4166784147 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55606bee8a00 con 0x55606bfc61e0 2023-10-05T19:50:35.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.113+0000 7ff2f8e0f700 1 --2- 172.21.15.167:0/4166784147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfcbb60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55606bfc02c0 tx=0x7ff2e402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff23bfff700 1 -- 172.21.15.167:0/4166784147 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e4029750 con 0x55606bfc61e0 2023-10-05T19:50:35.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff23bfff700 1 -- 172.21.15.167:0/4166784147 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4040070 con 0x55606bfc61e0 2023-10-05T19:50:35.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff23bfff700 1 -- 172.21.15.167:0/4166784147 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2e4029910 con 0x55606bfc61e0 2023-10-05T19:50:35.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/4166784147 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55606bfcc160 con 0x55606bfc61e0 2023-10-05T19:50:35.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/4166784147 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55606bfcc5a0 con 0x55606bfc61e0 2023-10-05T19:50:35.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff23bfff700 1 -- 172.21.15.167:0/4166784147 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff2e4029b80 con 0x55606bfc61e0 2023-10-05T19:50:35.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff23bfff700 1 --2- 172.21.15.167:0/4166784147 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff240030c50 0x7ff240033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff23bfff700 1 -- 172.21.15.167:0/4166784147 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7ff2e4042070 con 0x55606bfc61e0 2023-10-05T19:50:35.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff2fbadbe40 5 note: GC not initialized 2023-10-05T19:50:35.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff2f9e11700 1 --2- 172.21.15.167:0/4166784147 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff240030c50 0x7ff240033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.117+0000 7ff2f9e11700 1 --2- 172.21.15.167:0/4166784147 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff240030c50 0x7ff240033100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55606bfb88a0 tx=0x7ff2f400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2397fa700 20 reqs_thread_entry: start 2023-10-05T19:50:35.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2fbadbe40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:35.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff232ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:35.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2fbadbe40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:35.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2317fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:05 2023 2023-10-05T19:50:35.128 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:35.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff230ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:35.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2fbadbe40 20 get_system_obj_state: rctx=0x7fff1abd6a98 obj=default.rgw.meta:users.uid:foo state=0x55606be4c0b0 s->prefetch_data=0 2023-10-05T19:50:35.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606c034390 con 0x55606bee8570 2023-10-05T19:50:35.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2fbadbe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:35.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2fbadbe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:35.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2fbadbe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606c036e20 con 0x55606bee8570 2023-10-05T19:50:35.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.121+0000 7ff2fbadbe40 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [ 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo1", 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "full-control" 2023-10-05T19:50:35.131 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [ 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.132 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo1", 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.133 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:35.134 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:35.135 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:35.135 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:35.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.125+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93872616844576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bf8a480 con 0x55606bfa7230 2023-10-05T19:50:35.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.125+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93872616844576] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.125+0000 7ff2fbadbe40 20 remove_watcher() i=0 2023-10-05T19:50:35.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.125+0000 7ff2fbadbe40 2 removed watcher, disabling cache 2023-10-05T19:50:35.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.125+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93872616845680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bf8a480 con 0x55606bee8570 2023-10-05T19:50:35.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.129+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93872616845680] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.129+0000 7ff2fbadbe40 20 remove_watcher() i=1 2023-10-05T19:50:35.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.129+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93872616851408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bf8a480 con 0x55606bfa7230 2023-10-05T19:50:35.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.129+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93872616851408] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.129+0000 7ff2fbadbe40 20 remove_watcher() i=2 2023-10-05T19:50:35.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.129+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93872616849120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bf8a480 con 0x7ff2ec01a070 2023-10-05T19:50:35.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.129+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93872616849120] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.133+0000 7ff2fbadbe40 20 remove_watcher() i=3 2023-10-05T19:50:35.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.133+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93872616854240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bf8a480 con 0x55606bfa7230 2023-10-05T19:50:35.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.133+0000 7ff2f9610700 1 -- 172.21.15.167:0/838416278 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93872616854240] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2ec057040 con 0x55606bfa7230 2023-10-05T19:50:35.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.133+0000 7ff2fbadbe40 20 remove_watcher() i=4 2023-10-05T19:50:35.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.133+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93872616858240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bf8a480 con 0x55606bfaafe0 2023-10-05T19:50:35.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.133+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93872616858240] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2e4038020 con 0x55606bfaafe0 2023-10-05T19:50:35.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.133+0000 7ff2fbadbe40 20 remove_watcher() i=5 2023-10-05T19:50:35.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.133+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93872616862880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bf8a480 con 0x55606bfaafe0 2023-10-05T19:50:35.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.137+0000 7ff2f8e0f700 1 -- 172.21.15.167:0/838416278 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93872616862880] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2e4038020 con 0x55606bfaafe0 2023-10-05T19:50:35.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.137+0000 7ff2fbadbe40 20 remove_watcher() i=6 2023-10-05T19:50:35.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.137+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93872616865088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bf8a480 con 0x7ff2ec01a070 2023-10-05T19:50:35.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.137+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93872616865088] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x7ff2ec01a070 2023-10-05T19:50:35.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.137+0000 7ff2fbadbe40 20 remove_watcher() i=7 2023-10-05T19:50:35.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2ca7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93872616860528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55606bf8a480 con 0x55606bee8570 2023-10-05T19:50:35.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 93872616860528] v30'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff2f4033040 con 0x55606bee8570 2023-10-05T19:50:35.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55606bfa7230 msgr2=0x55606bfaa470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55606bfa7230 0x55606bfaa470 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55606bee8570 msgr2=0x55606bfa6470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55606bee8570 0x55606bfa6470 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff2ec01a070 msgr2=0x7ff2ec043760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff2ec01a070 0x7ff2ec043760 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55606bfaafe0 msgr2=0x55606bfaf240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55606bfaafe0 0x55606bfaf240 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2dc030c50 msgr2=0x7ff2dc033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2dc030c50 0x7ff2dc033100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4000f80 tx=0x7ff2e4013000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2f9e11700 1 -- 172.21.15.167:0/838416278 reap_dead start 2023-10-05T19:50:35.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 msgr2=0x55606bf9a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf9a9b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0018e0 tx=0x7ff2ec016000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 shutdown_connections 2023-10-05T19:50:35.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/838416278 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bee7260 0x55606bf9a9b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.141+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 >> 172.21.15.167:0/838416278 conn(0x55606bf6e340 msgr2=0x55606bf8e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 shutdown_connections 2023-10-05T19:50:35.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/838416278 wait complete. 2023-10-05T19:50:35.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/4166784147 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff240030c50 msgr2=0x7ff240033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/4166784147 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff240030c50 0x7ff240033100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55606bfb88a0 tx=0x7ff2f400e040 comp rx=0 tx=0).stop 2023-10-05T19:50:35.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/4166784147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 msgr2=0x55606bfcbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/4166784147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfcbb60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55606bfc02c0 tx=0x7ff2e402a000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/4166784147 shutdown_connections 2023-10-05T19:50:35.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/4166784147 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff240030c50 0x7ff240033100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 --2- 172.21.15.167:0/4166784147 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55606bfc61e0 0x55606bfcbb60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/4166784147 >> 172.21.15.167:0/4166784147 conn(0x55606bfc15a0 msgr2=0x55606bfbf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/4166784147 shutdown_connections 2023-10-05T19:50:35.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.145+0000 7ff2fbadbe40 1 -- 172.21.15.167:0/4166784147 wait complete. 2023-10-05T19:50:35.158 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:35.158 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T19:50:35.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T19:50:35.158 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T19:50:35.197 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:35.197 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:35.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.189+0000 7f874bfe4e40 1 Processor -- start 2023-10-05T19:50:35.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.189+0000 7f874bfe4e40 1 -- start start 2023-10-05T19:50:35.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.189+0000 7f874bfe4e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559b19d49570 0x559b19d47b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559b19d20bd0 con 0x559b19d48090 2023-10-05T19:50:35.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x559b19cddee0 con 0x559b19d49570 2023-10-05T19:50:35.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8749b19700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559b19d49570 0x559b19d47b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8749318700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x559b19d48090 0x559b19ddba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39986/0 (socket says 172.21.15.167:39986) 2023-10-05T19:50:35.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8749b19700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559b19d49570 0x559b19d47b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47508/0 (socket says 172.21.15.167:47508) 2023-10-05T19:50:35.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8749318700 1 -- 172.21.15.167:0/294482207 learned_addr learned my addr 172.21.15.167:0/294482207 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:35.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8749b19700 1 -- 172.21.15.167:0/294482207 >> v1:172.21.15.118:6789/0 conn(0x559b19d48090 legacy=0x559b19ddba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8748b17700 1 -- 172.21.15.167:0/294482207 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032665431 0 0) 0x559b19d20bd0 con 0x559b19d48090 2023-10-05T19:50:35.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8749b19700 1 -- 172.21.15.167:0/294482207 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b19d49a00 con 0x559b19d49570 2023-10-05T19:50:35.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8749b19700 1 --2- 172.21.15.167:0/294482207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d49570 0x559b19d47b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f873c00a5d0 tx=0x7f873c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba522639e558b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8748b17700 1 -- 172.21.15.167:0/294482207 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f873c0086a0 con 0x559b19d49570 2023-10-05T19:50:35.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8748b17700 1 -- 172.21.15.167:0/294482207 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c008800 con 0x559b19d49570 2023-10-05T19:50:35.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f8748b17700 1 -- 172.21.15.167:0/294482207 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f873c008ad0 con 0x559b19d49570 2023-10-05T19:50:35.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 -- 172.21.15.167:0/294482207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d49570 msgr2=0x559b19d47b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/294482207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d49570 0x559b19d47b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f873c00a5d0 tx=0x7f873c005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:35.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 -- 172.21.15.167:0/294482207 shutdown_connections 2023-10-05T19:50:35.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/294482207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d49570 0x559b19d47b50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 -- 172.21.15.167:0/294482207 >> 172.21.15.167:0/294482207 conn(0x559b19dcf340 msgr2=0x559b19dd1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 -- 172.21.15.167:0/294482207 shutdown_connections 2023-10-05T19:50:35.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 -- 172.21.15.167:0/294482207 wait complete. 2023-10-05T19:50:35.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 Processor -- start 2023-10-05T19:50:35.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 -- start start 2023-10-05T19:50:35.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19df4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.193+0000 7f874bfe4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b19ca1e30 con 0x559b19d48090 2023-10-05T19:50:35.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f8749b19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19df4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f8749b19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19df4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47518/0 (socket says 172.21.15.167:47518) 2023-10-05T19:50:35.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f8749b19700 1 -- 172.21.15.167:0/2363287660 learned_addr learned my addr 172.21.15.167:0/2363287660 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f8749b19700 1 -- 172.21.15.167:0/2363287660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c005cf0 con 0x559b19d48090 2023-10-05T19:50:35.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f8749b19700 1 --2- 172.21.15.167:0/2363287660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19df4970 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f873c005a90 tx=0x7f873c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e35e95eb20227a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f87437fe700 1 -- 172.21.15.167:0/2363287660 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f873c008a40 con 0x559b19d48090 2023-10-05T19:50:35.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f87437fe700 1 -- 172.21.15.167:0/2363287660 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c008bc0 con 0x559b19d48090 2023-10-05T19:50:35.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f87437fe700 1 -- 172.21.15.167:0/2363287660 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f873c012450 con 0x559b19d48090 2023-10-05T19:50:35.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2363287660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 msgr2=0x559b19df4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2363287660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19df4970 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f873c005a90 tx=0x7f873c015000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2363287660 shutdown_connections 2023-10-05T19:50:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2363287660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19df4970 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2363287660 >> 172.21.15.167:0/2363287660 conn(0x559b19dcf340 msgr2=0x559b19df0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2363287660 shutdown_connections 2023-10-05T19:50:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2363287660 wait complete. 2023-10-05T19:50:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 Processor -- start 2023-10-05T19:50:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 -- start start 2023-10-05T19:50:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19dfb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f874bfe4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b19c74ed0 con 0x559b19d48090 2023-10-05T19:50:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f8749b19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19dfb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.197+0000 7f8749b19700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19dfb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47524/0 (socket says 172.21.15.167:47524) 2023-10-05T19:50:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 learned_addr learned my addr 172.21.15.167:0/2078829115 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b19d49a00 con 0x559b19d48090 2023-10-05T19:50:35.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f8749b19700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19dfb5d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f873c00c010 tx=0x7f873c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f8741ffb700 1 -- 172.21.15.167:0/2078829115 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f873c008e50 con 0x559b19d48090 2023-10-05T19:50:35.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f8741ffb700 1 -- 172.21.15.167:0/2078829115 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c012660 con 0x559b19d48090 2023-10-05T19:50:35.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559b19dfbb10 con 0x559b19d48090 2023-10-05T19:50:35.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f8741ffb700 1 -- 172.21.15.167:0/2078829115 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f873c012950 con 0x559b19d48090 2023-10-05T19:50:35.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b19dfbfb0 con 0x559b19d48090 2023-10-05T19:50:35.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f8741ffb700 1 -- 172.21.15.167:0/2078829115 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f873c019070 con 0x559b19d48090 2023-10-05T19:50:35.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f8741ffb700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f872c030c50 0x7f872c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.201+0000 7f8741ffb700 1 -- 172.21.15.167:0/2078829115 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f873c0383c0 con 0x559b19d48090 2023-10-05T19:50:35.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f8749318700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f872c030c50 0x7f872c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b19d49570 0x559b19e07090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e07740 con 0x559b19d49570 2023-10-05T19:50:35.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874a31a700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b19d49570 0x559b19e07090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f8749318700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f872c030c50 0x7f872c033100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f87340011e0 tx=0x7f87340013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874a31a700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b19d49570 0x559b19e07090 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 20 realm 2023-10-05T19:50:35.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e046f0 con 0x559b19d49570 2023-10-05T19:50:35.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e08220 con 0x559b19d49570 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b19e07e50 0x559b19e0b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e0b7c0 con 0x559b19e07e50 2023-10-05T19:50:35.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f8749b19700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b19e07e50 0x559b19e0b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.205+0000 7f8749b19700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b19e07e50 0x559b19e0b090 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e0c090 con 0x559b19d49570 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f874bfe4e40 20 searching for the correct realm 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b19e0bc00 0x559b19e0fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e0bc00 2023-10-05T19:50:35.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f8749318700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b19e0bc00 0x559b19e0fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f8749318700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b19e0bc00 0x559b19e0fe60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734006070 con 0x559b19e0bc00 2023-10-05T19:50:35.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e07e50 2023-10-05T19:50:35.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f8749b19700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f873c007030 0x7f873c00c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x7f873c007030 2023-10-05T19:50:35.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.209+0000 7f874a31a700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f873c007030 0x7f873c00c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f874a31a700 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f873c007030 0x7f873c00c0b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e0bc00 2023-10-05T19:50:35.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734006070 con 0x559b19e0bc00 2023-10-05T19:50:35.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e07e50 2023-10-05T19:50:35.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.213+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e07e50 2023-10-05T19:50:35.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x7f873c007030 2023-10-05T19:50:35.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x7f873c007030 2023-10-05T19:50:35.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e07e50 2023-10-05T19:50:35.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.217+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e0bc00 2023-10-05T19:50:35.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734006070 con 0x559b19e0bc00 2023-10-05T19:50:35.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e07e50 2023-10-05T19:50:35.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e0bc00 2023-10-05T19:50:35.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734006070 con 0x559b19e0bc00 2023-10-05T19:50:35.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e0bc00 2023-10-05T19:50:35.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.221+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734006070 con 0x559b19e0bc00 2023-10-05T19:50:35.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x7f873c007030 2023-10-05T19:50:35.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19d49570 2023-10-05T19:50:35.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x7f873c007030 2023-10-05T19:50:35.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e0bc00 2023-10-05T19:50:35.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734006070 con 0x559b19e0bc00 2023-10-05T19:50:35.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x7f873c007030 2023-10-05T19:50:35.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e07e50 2023-10-05T19:50:35.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.225+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e07e50 2023-10-05T19:50:35.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e0bc00 2023-10-05T19:50:35.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734006070 con 0x559b19e0bc00 2023-10-05T19:50:35.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e07e50 2023-10-05T19:50:35.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10440 con 0x559b19e07e50 2023-10-05T19:50:35.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e0cc00 con 0x559b19d49570 2023-10-05T19:50:35.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e0d580 con 0x559b19e07e50 2023-10-05T19:50:35.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.229+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e0c7f0 con 0x559b19e07e50 2023-10-05T19:50:35.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10df0 con 0x559b19e0bc00 2023-10-05T19:50:35.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f8734006070 con 0x559b19e0bc00 2023-10-05T19:50:35.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e111a0 con 0x559b19d49570 2023-10-05T19:50:35.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e11550 con 0x559b19e07e50 2023-10-05T19:50:35.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.233+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19e0bc00 2023-10-05T19:50:35.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19e07e50 2023-10-05T19:50:35.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x7f873c007030 2023-10-05T19:50:35.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19d49570 2023-10-05T19:50:35.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19d49570 2023-10-05T19:50:35.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19e0bc00 2023-10-05T19:50:35.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.237+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19d49570 2023-10-05T19:50:35.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19e07e50 2023-10-05T19:50:35.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19e07e50 2023-10-05T19:50:35.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19d49570 2023-10-05T19:50:35.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x7f873c007030 2023-10-05T19:50:35.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19d49570 2023-10-05T19:50:35.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.241+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x7f873c007030 2023-10-05T19:50:35.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19e07e50 2023-10-05T19:50:35.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12910 con 0x559b19e0bc00 2023-10-05T19:50:35.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19d49570 2023-10-05T19:50:35.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19e07e50 2023-10-05T19:50:35.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19e0bc00 2023-10-05T19:50:35.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.245+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19d49570 2023-10-05T19:50:35.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19d49570 2023-10-05T19:50:35.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19d49570 2023-10-05T19:50:35.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19e0bc00 2023-10-05T19:50:35.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x7f873c007030 2023-10-05T19:50:35.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19d49570 2023-10-05T19:50:35.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x7f873c007030 2023-10-05T19:50:35.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.249+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19e0bc00 2023-10-05T19:50:35.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x7f873c007030 2023-10-05T19:50:35.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19e07e50 2023-10-05T19:50:35.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19e07e50 2023-10-05T19:50:35.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19e0bc00 2023-10-05T19:50:35.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19e07e50 2023-10-05T19:50:35.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.253+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8734028040 con 0x559b19e07e50 2023-10-05T19:50:35.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e11900 con 0x559b19e07e50 2023-10-05T19:50:35.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e11cb0 con 0x559b19d49570 2023-10-05T19:50:35.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e10930 con 0x559b19e07e50 2023-10-05T19:50:35.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12cc0 con 0x559b19e07e50 2023-10-05T19:50:35.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.257+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12cc0 con 0x7f873c007030 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 zone default found 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 4 Realm: () 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 zonegroup default 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e12cc0 con 0x7f873c007030 2023-10-05T19:50:35.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e14640 con 0x559b19e0bc00 2023-10-05T19:50:35.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e149f0 con 0x559b19e0bc00 2023-10-05T19:50:35.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 started sync module instance, tier type = 2023-10-05T19:50:35.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:35.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.261+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e13d00 con 0x559b19e07e50 2023-10-05T19:50:35.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.265+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.265+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94124642476272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e14da0 con 0x559b19e07e50 2023-10-05T19:50:35.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.265+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e15640 con 0x559b19d49570 2023-10-05T19:50:35.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.265+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94124642476272] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.265+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.265+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94124642484480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e15290 con 0x559b19d49570 2023-10-05T19:50:35.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.269+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e15d10 con 0x559b19e07e50 2023-10-05T19:50:35.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.269+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94124642484480] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.269+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.269+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94124642490336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e15290 con 0x559b19e07e50 2023-10-05T19:50:35.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.269+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e16600 con 0x7f873c007030 2023-10-05T19:50:35.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.273+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.273+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94124642492688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e16a50 con 0x7f873c007030 2023-10-05T19:50:35.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.273+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e17460 con 0x559b19e07e50 2023-10-05T19:50:35.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.273+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94124642490336] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.273+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94124642492688] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.273+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.273+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94124642493792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e169b0 con 0x559b19e07e50 2023-10-05T19:50:35.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.273+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e17950 con 0x559b19e0bc00 2023-10-05T19:50:35.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94124642493792] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94124642496368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e17d00 con 0x559b19e0bc00 2023-10-05T19:50:35.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e185a0 con 0x559b19e0bc00 2023-10-05T19:50:35.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94124642496368] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94124642502992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e19290 con 0x559b19e0bc00 2023-10-05T19:50:35.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e173c0 con 0x7f873c007030 2023-10-05T19:50:35.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94124642502992] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94124642504096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e191f0 con 0x7f873c007030 2023-10-05T19:50:35.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874bfe4e40 20 add_watcher() i=0 2023-10-05T19:50:35.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874bfe4e40 20 add_watcher() i=1 2023-10-05T19:50:35.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874bfe4e40 20 add_watcher() i=2 2023-10-05T19:50:35.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.277+0000 7f874bfe4e40 20 add_watcher() i=3 2023-10-05T19:50:35.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.281+0000 7f874bfe4e40 20 add_watcher() i=4 2023-10-05T19:50:35.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.281+0000 7f874bfe4e40 20 add_watcher() i=5 2023-10-05T19:50:35.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.281+0000 7f874bfe4e40 20 add_watcher() i=6 2023-10-05T19:50:35.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.281+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94124642504096] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x7f873c007030 2023-10-05T19:50:35.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.281+0000 7f874bfe4e40 20 add_watcher() i=7 2023-10-05T19:50:35.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.281+0000 7f874bfe4e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:35.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.281+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e191f0 con 0x559b19d49570 2023-10-05T19:50:35.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.281+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.281+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94124642506672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e1a0f0 con 0x559b19d49570 2023-10-05T19:50:35.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94124642506672] v30'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f874400a5a0 con 0x559b19d49570 2023-10-05T19:50:35.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f871afe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:35.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:35.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 1 Processor -- start 2023-10-05T19:50:35.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 1 -- start start 2023-10-05T19:50:35.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e27220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b19e27760 con 0x559b19e26e50 2023-10-05T19:50:35.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f8749318700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e27220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f8749318700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e27220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47526/0 (socket says 172.21.15.167:47526) 2023-10-05T19:50:35.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f8749318700 1 -- 172.21.15.167:0/3403761923 learned_addr learned my addr 172.21.15.167:0/3403761923 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f8749318700 1 -- 172.21.15.167:0/3403761923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b19e278a0 con 0x559b19e26e50 2023-10-05T19:50:35.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f8749318700 1 --2- 172.21.15.167:0/3403761923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e27220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x559b19e0c770 tx=0x7f8734010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f5e5e0b9b6fc94 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f871a7e4700 1 -- 172.21.15.167:0/3403761923 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f873403b070 con 0x559b19e26e50 2023-10-05T19:50:35.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f871a7e4700 1 -- 172.21.15.167:0/3403761923 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8734022040 con 0x559b19e26e50 2023-10-05T19:50:35.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f871a7e4700 1 -- 172.21.15.167:0/3403761923 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8734021040 con 0x559b19e26e50 2023-10-05T19:50:35.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 1 -- 172.21.15.167:0/3403761923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 msgr2=0x559b19e27220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/3403761923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e27220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x559b19e0c770 tx=0x7f8734010000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 1 -- 172.21.15.167:0/3403761923 shutdown_connections 2023-10-05T19:50:35.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/3403761923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e27220 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.285+0000 7f874bfe4e40 1 -- 172.21.15.167:0/3403761923 >> 172.21.15.167:0/3403761923 conn(0x559b19e22210 msgr2=0x559b19e203c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f874bfe4e40 1 -- 172.21.15.167:0/3403761923 shutdown_connections 2023-10-05T19:50:35.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f874bfe4e40 1 -- 172.21.15.167:0/3403761923 wait complete. 2023-10-05T19:50:35.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f874bfe4e40 1 Processor -- start 2023-10-05T19:50:35.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f874bfe4e40 1 -- start start 2023-10-05T19:50:35.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f874bfe4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e2c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f874bfe4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b19e2d960 con 0x559b19e26e50 2023-10-05T19:50:35.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f8749318700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e2c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f8749318700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e2c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47528/0 (socket says 172.21.15.167:47528) 2023-10-05T19:50:35.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f8749318700 1 -- 172.21.15.167:0/1709551582 learned_addr learned my addr 172.21.15.167:0/1709551582 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f8749318700 1 -- 172.21.15.167:0/1709551582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873400ead0 con 0x559b19e26e50 2023-10-05T19:50:35.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f8749318700 1 --2- 172.21.15.167:0/1709551582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e2c960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559b19e0c740 tx=0x7f8734037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f8718fe1700 1 -- 172.21.15.167:0/1709551582 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8734021070 con 0x559b19e26e50 2023-10-05T19:50:35.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f8718fe1700 1 -- 172.21.15.167:0/1709551582 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8734036e70 con 0x559b19e26e50 2023-10-05T19:50:35.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f874bfe4e40 1 -- 172.21.15.167:0/1709551582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559b19e2cf60 con 0x559b19e26e50 2023-10-05T19:50:35.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f8718fe1700 1 -- 172.21.15.167:0/1709551582 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8734046070 con 0x559b19e26e50 2023-10-05T19:50:35.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f874bfe4e40 1 -- 172.21.15.167:0/1709551582 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b19e2d400 con 0x559b19e26e50 2023-10-05T19:50:35.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.289+0000 7f8718fe1700 1 -- 172.21.15.167:0/1709551582 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f873403e020 con 0x559b19e26e50 2023-10-05T19:50:35.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f8718fe1700 1 --2- 172.21.15.167:0/1709551582 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8690030bb0 0x7f8690033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f8718fe1700 1 -- 172.21.15.167:0/1709551582 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f873402e040 con 0x559b19e26e50 2023-10-05T19:50:35.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f874bfe4e40 5 note: GC not initialized 2023-10-05T19:50:35.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f874a31a700 1 --2- 172.21.15.167:0/1709551582 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8690030bb0 0x7f8690033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f874a31a700 1 --2- 172.21.15.167:0/1709551582 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8690030bb0 0x7f8690033060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x559b19e192f0 tx=0x7f874400d630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f8689ffb700 20 reqs_thread_entry: start 2023-10-05T19:50:35.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f874bfe4e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:35.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f867b7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:35.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f874bfe4e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:35.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f8679ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:05 2023 2023-10-05T19:50:35.302 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:35.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f86797fa700 20 reqs_thread_entry: start 2023-10-05T19:50:35.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f874bfe4e40 20 get_system_obj_state: rctx=0x7ffd9963b688 obj=default.rgw.meta:users.uid:foo state=0x559b19cad0b0 s->prefetch_data=0 2023-10-05T19:50:35.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.293+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e95230 con 0x559b19d49570 2023-10-05T19:50:35.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f874403d050 con 0x559b19d49570 2023-10-05T19:50:35.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874bfe4e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:35.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874bfe4e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:35.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874bfe4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19e97cc0 con 0x559b19d49570 2023-10-05T19:50:35.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7f874403d050 con 0x559b19d49570 2023-10-05T19:50:35.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874bfe4e40 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T19:50:35.304 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:35.304 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:35.304 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:35.304 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:35.304 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:35.304 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:35.304 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [ 2023-10-05T19:50:35.304 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.304 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo1", 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "full-control" 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [ 2023-10-05T19:50:35.305 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo1", 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.306 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:35.307 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:35.308 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:35.308 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:35.308 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:35.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94124642476272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19deb210 con 0x559b19e07e50 2023-10-05T19:50:35.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94124642476272] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874bfe4e40 20 remove_watcher() i=0 2023-10-05T19:50:35.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874bfe4e40 2 removed watcher, disabling cache 2023-10-05T19:50:35.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.297+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94124642484480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19deb210 con 0x559b19d49570 2023-10-05T19:50:35.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.301+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94124642484480] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874403d050 con 0x559b19d49570 2023-10-05T19:50:35.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.301+0000 7f874bfe4e40 20 remove_watcher() i=1 2023-10-05T19:50:35.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.301+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94124642490336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19deb210 con 0x559b19e07e50 2023-10-05T19:50:35.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.301+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94124642490336] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.301+0000 7f874bfe4e40 20 remove_watcher() i=2 2023-10-05T19:50:35.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.301+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94124642492688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19deb210 con 0x7f873c007030 2023-10-05T19:50:35.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.305+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94124642492688] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874403d050 con 0x7f873c007030 2023-10-05T19:50:35.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.305+0000 7f874bfe4e40 20 remove_watcher() i=3 2023-10-05T19:50:35.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.305+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94124642493792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19deb210 con 0x559b19e07e50 2023-10-05T19:50:35.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.305+0000 7f8749b19700 1 -- 172.21.15.167:0/2078829115 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94124642493792] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f873c012ab0 con 0x559b19e07e50 2023-10-05T19:50:35.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.305+0000 7f874bfe4e40 20 remove_watcher() i=4 2023-10-05T19:50:35.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.305+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94124642496368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19deb210 con 0x559b19e0bc00 2023-10-05T19:50:35.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.309+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94124642496368] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.309+0000 7f874bfe4e40 20 remove_watcher() i=5 2023-10-05T19:50:35.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.309+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94124642502992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19deb210 con 0x559b19e0bc00 2023-10-05T19:50:35.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.309+0000 7f8749318700 1 -- 172.21.15.167:0/2078829115 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94124642502992] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8734024040 con 0x559b19e0bc00 2023-10-05T19:50:35.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.309+0000 7f874bfe4e40 20 remove_watcher() i=6 2023-10-05T19:50:35.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.309+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94124642504096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19deb210 con 0x7f873c007030 2023-10-05T19:50:35.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.313+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94124642504096] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f874403d050 con 0x7f873c007030 2023-10-05T19:50:35.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.313+0000 7f874bfe4e40 20 remove_watcher() i=7 2023-10-05T19:50:35.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.313+0000 7f871afe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.313+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94124642506672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b19deb210 con 0x559b19d49570 2023-10-05T19:50:35.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94124642506672] v30'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f874403d050 con 0x559b19d49570 2023-10-05T19:50:35.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b19e07e50 msgr2=0x559b19e0b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b19e07e50 0x559b19e0b090 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b19d49570 msgr2=0x559b19e07090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b19d49570 0x559b19e07090 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f873c007030 msgr2=0x7f873c00c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f873c007030 0x7f873c00c0b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b19e0bc00 msgr2=0x559b19e0fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b19e0bc00 0x559b19e0fe60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f872c030c50 msgr2=0x7f872c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f872c030c50 0x7f872c033100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f87340011e0 tx=0x7f87340013a0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 msgr2=0x559b19dfb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874a31a700 1 -- 172.21.15.167:0/2078829115 reap_dead start 2023-10-05T19:50:35.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19dfb5d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f873c00c010 tx=0x7f873c01c000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 shutdown_connections 2023-10-05T19:50:35.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/2078829115 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19d48090 0x559b19dfb5d0 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f873c00c010 tx=0x7f873c01c000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 >> 172.21.15.167:0/2078829115 conn(0x559b19dcf340 msgr2=0x559b19deefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 shutdown_connections 2023-10-05T19:50:35.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/2078829115 wait complete. 2023-10-05T19:50:35.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/1709551582 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8690030bb0 msgr2=0x7f8690033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/1709551582 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8690030bb0 0x7f8690033060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x559b19e192f0 tx=0x7f874400d630 comp rx=0 tx=0).stop 2023-10-05T19:50:35.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/1709551582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 msgr2=0x559b19e2c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/1709551582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e2c960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x559b19e0c740 tx=0x7f8734037000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/1709551582 shutdown_connections 2023-10-05T19:50:35.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/1709551582 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8690030bb0 0x7f8690033060 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 --2- 172.21.15.167:0/1709551582 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b19e26e50 0x559b19e2c960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/1709551582 >> 172.21.15.167:0/1709551582 conn(0x559b19e22210 msgr2=0x559b19e20310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/1709551582 shutdown_connections 2023-10-05T19:50:35.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.317+0000 7f874bfe4e40 1 -- 172.21.15.167:0/1709551582 wait complete. 2023-10-05T19:50:35.331 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:35.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2023-10-05T19:50:35.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2023-10-05T19:50:35.332 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2023-10-05T19:50:35.416 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:35.416 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:35.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.409+0000 7f98128cee40 1 Processor -- start 2023-10-05T19:50:35.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.409+0000 7f98128cee40 1 -- start start 2023-10-05T19:50:35.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.409+0000 7f98128cee40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a073076af0 0x55a073076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.409+0000 7f98128cee40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a072fc1bd0 con 0x55a073077400 2023-10-05T19:50:35.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.409+0000 7f98128cee40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a072f7eee0 con 0x55a073076af0 2023-10-05T19:50:35.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f980fc02700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55a073077400 0x55a073077e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:39990/0 (socket says 172.21.15.167:39990) 2023-10-05T19:50:35.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f980fc02700 1 -- 172.21.15.167:0/3796555721 learned_addr learned my addr 172.21.15.167:0/3796555721 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:35.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f9810403700 1 --2- 172.21.15.167:0/3796555721 >> v2:172.21.15.118:3300/0 conn(0x55a073076af0 0x55a073076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f980f401700 1 -- 172.21.15.167:0/3796555721 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405016265 0 0) 0x55a072fc1bd0 con 0x55a073077400 2023-10-05T19:50:35.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f980f401700 1 -- 172.21.15.167:0/3796555721 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f0001e10 con 0x55a073077400 2023-10-05T19:50:35.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f9810403700 1 -- 172.21.15.167:0/3796555721 >> v1:172.21.15.118:6789/0 conn(0x55a073077400 legacy=0x55a073077e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f9810403700 1 -- 172.21.15.167:0/3796555721 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0730785a0 con 0x55a073076af0 2023-10-05T19:50:35.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f9810403700 1 --2- 172.21.15.167:0/3796555721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a073076ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f980800a5d0 tx=0x7f9808005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59239192f7c7af86 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f980f401700 1 -- 172.21.15.167:0/3796555721 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9808007610 con 0x55a073076af0 2023-10-05T19:50:35.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f980f401700 1 -- 172.21.15.167:0/3796555721 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808007770 con 0x55a073076af0 2023-10-05T19:50:35.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f980f401700 1 -- 172.21.15.167:0/3796555721 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9808007a40 con 0x55a073076af0 2023-10-05T19:50:35.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f98128cee40 1 -- 172.21.15.167:0/3796555721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 msgr2=0x55a073076ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f98128cee40 1 --2- 172.21.15.167:0/3796555721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a073076ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f980800a5d0 tx=0x7f9808005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:35.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f98128cee40 1 -- 172.21.15.167:0/3796555721 shutdown_connections 2023-10-05T19:50:35.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f98128cee40 1 --2- 172.21.15.167:0/3796555721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a073076ec0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f98128cee40 1 -- 172.21.15.167:0/3796555721 >> 172.21.15.167:0/3796555721 conn(0x55a072fea560 msgr2=0x55a072fea960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f98128cee40 1 -- 172.21.15.167:0/3796555721 shutdown_connections 2023-10-05T19:50:35.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.413+0000 7f98128cee40 1 -- 172.21.15.167:0/3796555721 wait complete. 2023-10-05T19:50:35.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f98128cee40 1 Processor -- start 2023-10-05T19:50:35.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f98128cee40 1 -- start start 2023-10-05T19:50:35.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f98128cee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a073095a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f98128cee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a072f42e30 con 0x55a073076af0 2023-10-05T19:50:35.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f9810403700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a073095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f9810403700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a073095a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47542/0 (socket says 172.21.15.167:47542) 2023-10-05T19:50:35.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f9810403700 1 -- 172.21.15.167:0/1203094604 learned_addr learned my addr 172.21.15.167:0/1203094604 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f9810403700 1 -- 172.21.15.167:0/1203094604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808005cf0 con 0x55a073076af0 2023-10-05T19:50:35.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f9810403700 1 --2- 172.21.15.167:0/1203094604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a073095a70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9808000c00 tx=0x7f9808014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c52c43baa759bb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f980e3ff700 1 -- 172.21.15.167:0/1203094604 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98080078e0 con 0x55a073076af0 2023-10-05T19:50:35.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f980e3ff700 1 -- 172.21.15.167:0/1203094604 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808007a40 con 0x55a073076af0 2023-10-05T19:50:35.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f980e3ff700 1 -- 172.21.15.167:0/1203094604 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9808007bd0 con 0x55a073076af0 2023-10-05T19:50:35.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f98128cee40 1 -- 172.21.15.167:0/1203094604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 msgr2=0x55a073095a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.417+0000 7f98128cee40 1 --2- 172.21.15.167:0/1203094604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a073095a70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9808000c00 tx=0x7f9808014000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 -- 172.21.15.167:0/1203094604 shutdown_connections 2023-10-05T19:50:35.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 --2- 172.21.15.167:0/1203094604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a073095a70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 -- 172.21.15.167:0/1203094604 >> 172.21.15.167:0/1203094604 conn(0x55a072fea560 msgr2=0x55a0730915b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 -- 172.21.15.167:0/1203094604 shutdown_connections 2023-10-05T19:50:35.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 -- 172.21.15.167:0/1203094604 wait complete. 2023-10-05T19:50:35.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 Processor -- start 2023-10-05T19:50:35.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 -- start start 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a07309c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a072f15ed0 con 0x55a073076af0 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f9810403700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a07309c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f9810403700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a07309c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47550/0 (socket says 172.21.15.167:47550) 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 learned_addr learned my addr 172.21.15.167:0/3382001924 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0730785a0 con 0x55a073076af0 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f9810403700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a07309c770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f980801f040 tx=0x7f980801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f980cbfc700 1 -- 172.21.15.167:0/3382001924 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9808007bb0 con 0x55a073076af0 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f980cbfc700 1 -- 172.21.15.167:0/3382001924 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808029070 con 0x55a073076af0 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a07309ccb0 con 0x55a073076af0 2023-10-05T19:50:35.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f980cbfc700 1 -- 172.21.15.167:0/3382001924 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9808012610 con 0x55a073076af0 2023-10-05T19:50:35.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a07309d0f0 con 0x55a073076af0 2023-10-05T19:50:35.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.421+0000 7f980cbfc700 1 -- 172.21.15.167:0/3382001924 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9808012770 con 0x55a073076af0 2023-10-05T19:50:35.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f980cbfc700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f97f4030ca0 0x7f97f4033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f980cbfc700 1 -- 172.21.15.167:0/3382001924 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f980802b070 con 0x55a073076af0 2023-10-05T19:50:35.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f980fc02700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f97f4030ca0 0x7f97f4033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a073077400 0x55a0730a8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730a88a0 con 0x55a073077400 2023-10-05T19:50:35.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f9810c04700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a073077400 0x55a0730a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f980fc02700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f97f4030ca0 0x7f97f4033150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98000044f0 tx=0x7f9800006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f9810c04700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a073077400 0x55a0730a8230 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f97f800a500 con 0x55a073077400 2023-10-05T19:50:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 20 realm 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730a5890 con 0x55a073077400 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f97f800a500 con 0x55a073077400 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730a9380 con 0x55a073077400 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f97f800a500 con 0x55a073077400 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a0730aa1b0 0x55a0730ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730acad0 con 0x55a0730aa1b0 2023-10-05T19:50:35.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f9810403700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a0730aa1b0 0x55a0730ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.425+0000 7f9810403700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a0730aa1b0 0x55a0730ac590 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730ad370 con 0x55a073077400 2023-10-05T19:50:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f97f800a500 con 0x55a073077400 2023-10-05T19:50:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f98128cee40 20 searching for the correct realm 2023-10-05T19:50:35.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a0730af130 0x55a0730b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730af130 2023-10-05T19:50:35.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f980fc02700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a0730af130 0x55a0730b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f980fc02700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a0730af130 0x55a0730b1510 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9800004520 con 0x55a0730af130 2023-10-05T19:50:35.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730aa1b0 2023-10-05T19:50:35.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f9810403700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9808007030 0x7f9808031490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x7f9808007030 2023-10-05T19:50:35.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.429+0000 7f9810c04700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9808007030 0x7f9808031490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810c04700 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9808007030 0x7f9808031490 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x7f9808007030 2023-10-05T19:50:35.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730af130 2023-10-05T19:50:35.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9800004520 con 0x55a0730af130 2023-10-05T19:50:35.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730aa1b0 2023-10-05T19:50:35.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730aa1b0 2023-10-05T19:50:35.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.433+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x7f9808007030 2023-10-05T19:50:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x7f9808007030 2023-10-05T19:50:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x7f9808007030 2023-10-05T19:50:35.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x7f9808007030 2023-10-05T19:50:35.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730aa1b0 2023-10-05T19:50:35.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730af130 2023-10-05T19:50:35.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9800004520 con 0x55a0730af130 2023-10-05T19:50:35.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730aa1b0 2023-10-05T19:50:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.437+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730af130 2023-10-05T19:50:35.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730af130 2023-10-05T19:50:35.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x7f9808007030 2023-10-05T19:50:35.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x7f9808007030 2023-10-05T19:50:35.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a073077400 2023-10-05T19:50:35.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x7f9808007030 2023-10-05T19:50:35.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x7f9808007030 2023-10-05T19:50:35.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.441+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730af130 2023-10-05T19:50:35.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x7f9808007030 2023-10-05T19:50:35.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x7f9808007030 2023-10-05T19:50:35.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730aa1b0 2023-10-05T19:50:35.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730aa1b0 2023-10-05T19:50:35.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730af130 2023-10-05T19:50:35.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730aa1b0 2023-10-05T19:50:35.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.445+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1a50 con 0x55a0730aa1b0 2023-10-05T19:50:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730adee0 con 0x55a073077400 2023-10-05T19:50:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730ae830 con 0x55a0730aa1b0 2023-10-05T19:50:35.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b1e90 con 0x55a0730aa1b0 2023-10-05T19:50:35.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b2240 con 0x55a0730af130 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.449+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730ae3a0 con 0x55a0730aa1b0 2023-10-05T19:50:35.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b3ea0 con 0x55a0730af130 2023-10-05T19:50:35.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b3ea0 con 0x55a0730aa1b0 2023-10-05T19:50:35.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b3ea0 con 0x7f9808007030 2023-10-05T19:50:35.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x7f9808007030 2023-10-05T19:50:35.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.453+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730af130 2023-10-05T19:50:35.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x7f9808007030 2023-10-05T19:50:35.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x7f9808007030 2023-10-05T19:50:35.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.457+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x7f9808007030 2023-10-05T19:50:35.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x7f9808007030 2023-10-05T19:50:35.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730af130 2023-10-05T19:50:35.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.461+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730af130 2023-10-05T19:50:35.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8014040 con 0x55a073077400 2023-10-05T19:50:35.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730af130 2023-10-05T19:50:35.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x7f9808007030 2023-10-05T19:50:35.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.465+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x7f9808007030 2023-10-05T19:50:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730af130 2023-10-05T19:50:35.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x7f9808007030 2023-10-05T19:50:35.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.469+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730af130 2023-10-05T19:50:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b2e90 con 0x55a0730aa1b0 2023-10-05T19:50:35.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b2e90 con 0x55a073077400 2023-10-05T19:50:35.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.473+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b3780 con 0x55a0730aa1b0 2023-10-05T19:50:35.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b3780 con 0x55a0730aa1b0 2023-10-05T19:50:35.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b3290 con 0x7f9808007030 2023-10-05T19:50:35.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 zone default found 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 4 Realm: () 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 zonegroup default 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b3290 con 0x7f9808007030 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b3290 con 0x55a0730af130 2023-10-05T19:50:35.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.477+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b3690 con 0x55a0730af130 2023-10-05T19:50:35.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.481+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.481+0000 7f98128cee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.481+0000 7f98128cee40 20 started sync module instance, tier type = 2023-10-05T19:50:35.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.481+0000 7f98128cee40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:35.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.481+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b50f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.481+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.481+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94147613248800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b5660 con 0x55a0730aa1b0 2023-10-05T19:50:35.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.481+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b5f00 con 0x55a073077400 2023-10-05T19:50:35.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.485+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94147613248800] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.485+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.485+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94147613250192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b5bd0 con 0x55a073077400 2023-10-05T19:50:35.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.485+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b67f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.485+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.485+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94147613254400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b6c40 con 0x55a0730aa1b0 2023-10-05T19:50:35.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.485+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b7650 con 0x7f9808007030 2023-10-05T19:50:35.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.485+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94147613250192] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.489+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.489+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94147613251296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b7650 con 0x7f9808007030 2023-10-05T19:50:35.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.489+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94147613254400] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.489+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b7a00 con 0x55a0730aa1b0 2023-10-05T19:50:35.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.489+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94147613251296] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.489+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.489+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94147613258080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b7aa0 con 0x55a0730aa1b0 2023-10-05T19:50:35.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.489+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b8340 con 0x55a0730af130 2023-10-05T19:50:35.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.493+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.493+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94147613261008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b8be0 con 0x55a0730af130 2023-10-05T19:50:35.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.493+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b95f0 con 0x55a0730af130 2023-10-05T19:50:35.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.493+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94147613258080] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.493+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94147613261008] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.493+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.493+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94147613266176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b99a0 con 0x55a0730af130 2023-10-05T19:50:35.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.493+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730ba240 con 0x7f9808007030 2023-10-05T19:50:35.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94147613266176] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94147613269328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730ba690 con 0x7f9808007030 2023-10-05T19:50:35.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 20 add_watcher() i=0 2023-10-05T19:50:35.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 20 add_watcher() i=1 2023-10-05T19:50:35.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 20 add_watcher() i=2 2023-10-05T19:50:35.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 20 add_watcher() i=3 2023-10-05T19:50:35.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 20 add_watcher() i=4 2023-10-05T19:50:35.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 20 add_watcher() i=5 2023-10-05T19:50:35.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 20 add_watcher() i=6 2023-10-05T19:50:35.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94147613269328] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 20 add_watcher() i=7 2023-10-05T19:50:35.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:35.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730bd6f0 con 0x55a073077400 2023-10-05T19:50:35.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.497+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94147613270432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730baae0 con 0x55a073077400 2023-10-05T19:50:35.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94147613270432] v30'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f97e0ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f98128cee40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:35.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f98128cee40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:35.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f98128cee40 1 Processor -- start 2023-10-05T19:50:35.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f98128cee40 1 -- start start 2023-10-05T19:50:35.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f98128cee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730c8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f98128cee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0730c8870 con 0x55a0730c7f60 2023-10-05T19:50:35.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f980fc02700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f980fc02700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47552/0 (socket says 172.21.15.167:47552) 2023-10-05T19:50:35.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f980fc02700 1 -- 172.21.15.167:0/341460690 learned_addr learned my addr 172.21.15.167:0/341460690 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f980fc02700 1 -- 172.21.15.167:0/341460690 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0730c89b0 con 0x55a0730c7f60 2023-10-05T19:50:35.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.501+0000 7f980fc02700 1 --2- 172.21.15.167:0/341460690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730c8330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55a0730a8f20 tx=0x7f9800006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63a9897890859fe server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f975bfff700 1 -- 172.21.15.167:0/341460690 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f980001a040 con 0x55a0730c7f60 2023-10-05T19:50:35.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f975bfff700 1 -- 172.21.15.167:0/341460690 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980001b040 con 0x55a0730c7f60 2023-10-05T19:50:35.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f975bfff700 1 -- 172.21.15.167:0/341460690 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9800004990 con 0x55a0730c7f60 2023-10-05T19:50:35.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 -- 172.21.15.167:0/341460690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 msgr2=0x55a0730c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 --2- 172.21.15.167:0/341460690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730c8330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55a0730a8f20 tx=0x7f9800006000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 -- 172.21.15.167:0/341460690 shutdown_connections 2023-10-05T19:50:35.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 --2- 172.21.15.167:0/341460690 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730c8330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 -- 172.21.15.167:0/341460690 >> 172.21.15.167:0/341460690 conn(0x55a0730c3320 msgr2=0x55a0730c1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 -- 172.21.15.167:0/341460690 shutdown_connections 2023-10-05T19:50:35.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 -- 172.21.15.167:0/341460690 wait complete. 2023-10-05T19:50:35.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 Processor -- start 2023-10-05T19:50:35.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 -- start start 2023-10-05T19:50:35.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0730cea50 con 0x55a0730c7f60 2023-10-05T19:50:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f980fc02700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f980fc02700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47560/0 (socket says 172.21.15.167:47560) 2023-10-05T19:50:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f980fc02700 1 -- 172.21.15.167:0/1885835401 learned_addr learned my addr 172.21.15.167:0/1885835401 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f980fc02700 1 -- 172.21.15.167:0/1885835401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f0001e10 con 0x55a0730c7f60 2023-10-05T19:50:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f980fc02700 1 --2- 172.21.15.167:0/1885835401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730cda50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55a0730c1fe0 tx=0x7f9800030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f975a7fc700 1 -- 172.21.15.167:0/1885835401 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f980001a070 con 0x55a0730c7f60 2023-10-05T19:50:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 -- 172.21.15.167:0/1885835401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a0730ce050 con 0x55a0730c7f60 2023-10-05T19:50:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f975a7fc700 1 -- 172.21.15.167:0/1885835401 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800004260 con 0x55a0730c7f60 2023-10-05T19:50:35.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f975a7fc700 1 -- 172.21.15.167:0/1885835401 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f980002c940 con 0x55a0730c7f60 2023-10-05T19:50:35.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.505+0000 7f98128cee40 1 -- 172.21.15.167:0/1885835401 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0730ce490 con 0x55a0730c7f60 2023-10-05T19:50:35.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.509+0000 7f975a7fc700 1 -- 172.21.15.167:0/1885835401 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f980002caa0 con 0x55a0730c7f60 2023-10-05T19:50:35.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.509+0000 7f975a7fc700 1 --2- 172.21.15.167:0/1885835401 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9750030c00 0x7f97500330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.509+0000 7f975a7fc700 1 -- 172.21.15.167:0/1885835401 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f9800027040 con 0x55a0730c7f60 2023-10-05T19:50:35.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.509+0000 7f9810c04700 1 --2- 172.21.15.167:0/1885835401 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9750030c00 0x7f97500330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.509+0000 7f98128cee40 5 note: GC not initialized 2023-10-05T19:50:35.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.509+0000 7f9810c04700 1 --2- 172.21.15.167:0/1885835401 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9750030c00 0x7f97500330b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55a0730bd7c0 tx=0x7f97f800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.509+0000 7f974f7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:35.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:35.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f974d7fa700 20 reqs_thread_entry: start 2023-10-05T19:50:35.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:35.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f973b7fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:05 2023 2023-10-05T19:50:35.519 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:35.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 20 get_system_obj_state: rctx=0x7ffd98b70f78 obj=default.rgw.meta:users.uid:foo state=0x55a072f4e0b0 s->prefetch_data=0 2023-10-05T19:50:35.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:35.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a073136380 con 0x55a073077400 2023-10-05T19:50:35.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f973affd700 20 reqs_thread_entry: start 2023-10-05T19:50:35.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a073138e10 con 0x55a073077400 2023-10-05T19:50:35.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T19:50:35.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 20 get_system_obj_state: rctx=0x7ffd98b707c8 obj=default.rgw.meta:users.swift:foo:foo2 state=0x55a072f4e0b0 s->prefetch_data=0 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.2 8:45671577:users.swift::foo%3afoo2:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a073135410 con 0x7f9808007030 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo:foo2 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 20 get_system_obj_state: rctx=0x7ffd98b70e68 obj=default.rgw.meta:users.swift:foo:foo2 state=0x55a072f4e0b0 s->prefetch_data=0 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2023-10-05T19:50:35.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.513+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~621 in=621b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a073135810 con 0x55a073077400 2023-10-05T19:50:35.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 foo [delete,create,call,writefull 0~621] v30'8 uv8 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f98128cee40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:35.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f98128cee40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:35.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f98128cee40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:35.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify cookie 94147613773600 in=809b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a073139e20 con 0x55a0730aa1b0 2023-10-05T19:50:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94147613258080 notify 128849018890 ret 0) v3 ==== 839+0+0 (crc 0 0 0) 0x55a07309d0f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f980dbfe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94147613258080 notifier 4367 bl.length()=797 2023-10-05T19:50:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f980dbfe700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.4 [notify cookie 94147613773600 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f980dbfe700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f980dbfe700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f97e8003d90 con 0x55a0730aa1b0 2023-10-05T19:50:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94147613773600 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a07309ccb0 con 0x55a0730aa1b0 2023-10-05T19:50:35.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.517+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a073134f20 con 0x7f9808007030 2023-10-05T19:50:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(108 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f98128cee40 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2023-10-05T19:50:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f98128cee40 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2023-10-05T19:50:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f98128cee40 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2023-10-05T19:50:35.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94147613773600 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a073139e20 con 0x55a0730aa1b0 2023-10-05T19:50:35.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== watch-notify(notify (1) cookie 94147613248800 notify 128849018891 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x55a07309ccb0 con 0x55a0730aa1b0 2023-10-05T19:50:35.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f980dbfe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94147613248800 notifier 4367 bl.length()=166 2023-10-05T19:50:35.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f980dbfe700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2023-10-05T19:50:35.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f980dbfe700 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2023-10-05T19:50:35.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(109 notify.0 [notify cookie 94147613773600 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f980dbfe700 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f97e8004140 con 0x55a0730aa1b0 2023-10-05T19:50:35.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(110 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.521+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== watch-notify(notify_complete (2) cookie 94147613773600 notify 128849018891 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a0730785a0 con 0x55a0730aa1b0 2023-10-05T19:50:35.530 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:35.530 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [ 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo1", 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "full-control" 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo2", 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "" 2023-10-05T19:50:35.531 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [ 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo1", 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T19:50:35.532 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo2", 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:35.533 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.534 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:35.535 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:35.535 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:35.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.525+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94147613248800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a07308c250 con 0x55a0730aa1b0 2023-10-05T19:50:35.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.525+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(111 notify.0 [watch unwatch cookie 94147613248800] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.525+0000 7f98128cee40 20 remove_watcher() i=0 2023-10-05T19:50:35.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.525+0000 7f98128cee40 2 removed watcher, disabling cache 2023-10-05T19:50:35.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.525+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94147613250192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.529+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 notify.1 [watch unwatch cookie 94147613250192] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.529+0000 7f98128cee40 20 remove_watcher() i=1 2023-10-05T19:50:35.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.529+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94147613254400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.529+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(113 notify.2 [watch unwatch cookie 94147613254400] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.529+0000 7f98128cee40 20 remove_watcher() i=2 2023-10-05T19:50:35.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.529+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94147613251296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x7f9808007030 2023-10-05T19:50:35.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.533+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(114 notify.3 [watch unwatch cookie 94147613251296] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.533+0000 7f98128cee40 20 remove_watcher() i=3 2023-10-05T19:50:35.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.533+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:115 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94147613258080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730aa1b0 2023-10-05T19:50:35.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.533+0000 7f9810403700 1 -- 172.21.15.167:0/3382001924 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(115 notify.4 [watch unwatch cookie 94147613258080] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9808041040 con 0x55a0730aa1b0 2023-10-05T19:50:35.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.533+0000 7f98128cee40 20 remove_watcher() i=4 2023-10-05T19:50:35.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.533+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94147613261008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730af130 2023-10-05T19:50:35.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.537+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(116 notify.5 [watch unwatch cookie 94147613261008] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.537+0000 7f98128cee40 20 remove_watcher() i=5 2023-10-05T19:50:35.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.537+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94147613266176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a0730af130 2023-10-05T19:50:35.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.537+0000 7f980fc02700 1 -- 172.21.15.167:0/3382001924 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(117 notify.6 [watch unwatch cookie 94147613266176] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f980001d040 con 0x55a0730af130 2023-10-05T19:50:35.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.537+0000 7f98128cee40 20 remove_watcher() i=6 2023-10-05T19:50:35.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.537+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:118 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94147613269328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x7f9808007030 2023-10-05T19:50:35.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.541+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(118 notify.7 [watch unwatch cookie 94147613269328] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x7f9808007030 2023-10-05T19:50:35.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.541+0000 7f98128cee40 20 remove_watcher() i=7 2023-10-05T19:50:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.541+0000 7f97e0ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.541+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:119 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94147613270432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a0730b25f0 con 0x55a073077400 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(119 data_loggenerations_metadata [watch unwatch cookie 94147613270432] v30'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f97f8033040 con 0x55a073077400 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a0730aa1b0 msgr2=0x55a0730ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a0730aa1b0 0x55a0730ac590 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a073077400 msgr2=0x55a0730a8230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a073077400 0x55a0730a8230 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9808007030 msgr2=0x7f9808031490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9808007030 0x7f9808031490 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a0730af130 msgr2=0x55a0730b1510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a0730af130 0x55a0730b1510 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f97f4030ca0 msgr2=0x7f97f4033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f97f4030ca0 0x7f97f4033150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f98000044f0 tx=0x7f9800006690 comp rx=0 tx=0).stop 2023-10-05T19:50:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f9810c04700 1 -- 172.21.15.167:0/3382001924 reap_dead start 2023-10-05T19:50:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 msgr2=0x55a07309c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a07309c770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f980801f040 tx=0x7f980801c000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 shutdown_connections 2023-10-05T19:50:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/3382001924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a073076af0 0x55a07309c770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 >> 172.21.15.167:0/3382001924 conn(0x55a072fea560 msgr2=0x55a073090030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 shutdown_connections 2023-10-05T19:50:35.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/3382001924 wait complete. 2023-10-05T19:50:35.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/1885835401 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9750030c00 msgr2=0x7f97500330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/1885835401 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9750030c00 0x7f97500330b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55a0730bd7c0 tx=0x7f97f800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:35.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/1885835401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 msgr2=0x55a0730cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/1885835401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730cda50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55a0730c1fe0 tx=0x7f9800030000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/1885835401 shutdown_connections 2023-10-05T19:50:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/1885835401 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9750030c00 0x7f97500330b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 --2- 172.21.15.167:0/1885835401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a0730c7f60 0x55a0730cda50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/1885835401 >> 172.21.15.167:0/1885835401 conn(0x55a0730c3320 msgr2=0x55a0730c13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/1885835401 shutdown_connections 2023-10-05T19:50:35.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.545+0000 7f98128cee40 1 -- 172.21.15.167:0/1885835401 wait complete. 2023-10-05T19:50:35.558 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:35.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T19:50:35.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T19:50:35.558 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T19:50:35.599 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:35.599 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:35.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7ff684e40 1 Processor -- start 2023-10-05T19:50:35.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7ff684e40 1 -- start start 2023-10-05T19:50:35.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7ff684e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x556117ed7b50 0x556117ed7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7ff684e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556117e22bd0 con 0x556117ed8460 2023-10-05T19:50:35.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7ff684e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x556117ddfee0 con 0x556117ed7b50 2023-10-05T19:50:35.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7fd1b9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x556117ed7b50 0x556117ed7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7fc9b8700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x556117ed8460 0x556117ed8ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:40006/0 (socket says 172.21.15.167:40006) 2023-10-05T19:50:35.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2593913475 learned_addr learned my addr 172.21.15.167:0/2593913475 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:35.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2593913475 >> v1:172.21.15.118:6789/0 conn(0x556117ed8460 legacy=0x556117ed8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2593913475 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556117ed9600 con 0x556117ed7b50 2023-10-05T19:50:35.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7fd1b9700 1 --2- 172.21.15.167:0/2593913475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117ed7f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800a520 tx=0x7fa7f8005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f0808d4150f93d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7f7fff700 1 -- 172.21.15.167:0/2593913475 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7f800f590 con 0x556117ed7b50 2023-10-05T19:50:35.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7f7fff700 1 -- 172.21.15.167:0/2593913475 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f800f6f0 con 0x556117ed7b50 2023-10-05T19:50:35.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.593+0000 7fa7f7fff700 1 -- 172.21.15.167:0/2593913475 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7f800f880 con 0x556117ed7b50 2023-10-05T19:50:35.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2593913475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 msgr2=0x556117ed7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2593913475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117ed7f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800a520 tx=0x7fa7f8005d40 comp rx=0 tx=0).stop 2023-10-05T19:50:35.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2593913475 shutdown_connections 2023-10-05T19:50:35.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2593913475 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117ed7f20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2593913475 >> 172.21.15.167:0/2593913475 conn(0x556117e4b5c0 msgr2=0x556117e4b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2593913475 shutdown_connections 2023-10-05T19:50:35.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2593913475 wait complete. 2023-10-05T19:50:35.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 Processor -- start 2023-10-05T19:50:35.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 -- start start 2023-10-05T19:50:35.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117ef6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7ff684e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556117da3e30 con 0x556117ed7b50 2023-10-05T19:50:35.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7fd1b9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117ef6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7fd1b9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117ef6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47576/0 (socket says 172.21.15.167:47576) 2023-10-05T19:50:35.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/1624780343 learned_addr learned my addr 172.21.15.167:0/1624780343 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/1624780343 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f800a0e0 con 0x556117ed7b50 2023-10-05T19:50:35.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7fd1b9700 1 --2- 172.21.15.167:0/1624780343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117ef6b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8005b20 tx=0x7fa7f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b676e7ad972108 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7f6ffd700 1 -- 172.21.15.167:0/1624780343 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7f800f860 con 0x556117ed7b50 2023-10-05T19:50:35.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7f6ffd700 1 -- 172.21.15.167:0/1624780343 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f800f9c0 con 0x556117ed7b50 2023-10-05T19:50:35.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.597+0000 7fa7f6ffd700 1 -- 172.21.15.167:0/1624780343 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7f800fb30 con 0x556117ed7b50 2023-10-05T19:50:35.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 -- 172.21.15.167:0/1624780343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 msgr2=0x556117ef6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/1624780343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117ef6b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8005b20 tx=0x7fa7f8014000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 -- 172.21.15.167:0/1624780343 shutdown_connections 2023-10-05T19:50:35.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/1624780343 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117ef6b60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 -- 172.21.15.167:0/1624780343 >> 172.21.15.167:0/1624780343 conn(0x556117e4b5c0 msgr2=0x556117ef2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 -- 172.21.15.167:0/1624780343 shutdown_connections 2023-10-05T19:50:35.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 -- 172.21.15.167:0/1624780343 wait complete. 2023-10-05T19:50:35.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 Processor -- start 2023-10-05T19:50:35.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 -- start start 2023-10-05T19:50:35.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117efd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7ff684e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556117d76ed0 con 0x556117ed7b50 2023-10-05T19:50:35.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7fd1b9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117efd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7fd1b9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117efd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47590/0 (socket says 172.21.15.167:47590) 2023-10-05T19:50:35.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 learned_addr learned my addr 172.21.15.167:0/2651265641 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.601+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556117ed9600 con 0x556117ed7b50 2023-10-05T19:50:35.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7fd1b9700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117efd860 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x556117ef3240 tx=0x7fa7f801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7f57fa700 1 -- 172.21.15.167:0/2651265641 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7f802a070 con 0x556117ed7b50 2023-10-05T19:50:35.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7f57fa700 1 -- 172.21.15.167:0/2651265641 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8010420 con 0x556117ed7b50 2023-10-05T19:50:35.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556117efdda0 con 0x556117ed7b50 2023-10-05T19:50:35.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7f57fa700 1 -- 172.21.15.167:0/2651265641 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7f80105d0 con 0x556117ed7b50 2023-10-05T19:50:35.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556117efe180 con 0x556117ed7b50 2023-10-05T19:50:35.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7f57fa700 1 -- 172.21.15.167:0/2651265641 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fa7f8010850 con 0x556117ed7b50 2023-10-05T19:50:35.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7f57fa700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa7e0030c50 0x7fa7e0033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7f57fa700 1 -- 172.21.15.167:0/2651265641 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fa7f80465b0 con 0x556117ed7b50 2023-10-05T19:50:35.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7fc9b8700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa7e0030c50 0x7fa7e0033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556117ed8460 0x556117f09280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f099b0 con 0x556117ed8460 2023-10-05T19:50:35.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7fd9ba700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556117ed8460 0x556117f09280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.605+0000 7fa7fc9b8700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa7e0030c50 0x7fa7e0033100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8004170 tx=0x7fa7e8001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7fd9ba700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556117ed8460 0x556117f09280 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7f000a500 con 0x556117ed8460 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 20 realm 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f06860 con 0x556117ed8460 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7f000a500 con 0x556117ed8460 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f0a490 con 0x556117ed8460 2023-10-05T19:50:35.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7f000a500 con 0x556117ed8460 2023-10-05T19:50:35.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556117f0a0c0 0x556117f0d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f0da30 con 0x556117f0a0c0 2023-10-05T19:50:35.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7fd1b9700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556117f0a0c0 0x556117f0d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7fd1b9700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556117f0a0c0 0x556117f0d300 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.609+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f0e300 con 0x556117ed8460 2023-10-05T19:50:35.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa7f000a500 con 0x556117ed8460 2023-10-05T19:50:35.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7ff684e40 20 searching for the correct realm 2023-10-05T19:50:35.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556117f0de70 0x556117f120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0de70 2023-10-05T19:50:35.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7fc9b8700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556117f0de70 0x556117f120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7fc9b8700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556117f0de70 0x556117f120d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8006070 con 0x556117f0de70 2023-10-05T19:50:35.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0a0c0 2023-10-05T19:50:35.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7fd1b9700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa7f8024c20 0x7fa7f801a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x7fa7f8024c20 2023-10-05T19:50:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.613+0000 7fa7fd9ba700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa7f8024c20 0x7fa7f801a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd9ba700 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa7f8024c20 0x7fa7f801a5f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x7fa7f8024c20 2023-10-05T19:50:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0de70 2023-10-05T19:50:35.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8006070 con 0x556117f0de70 2023-10-05T19:50:35.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0a0c0 2023-10-05T19:50:35.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.617+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0a0c0 2023-10-05T19:50:35.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x7fa7f8024c20 2023-10-05T19:50:35.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x7fa7f8024c20 2023-10-05T19:50:35.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x7fa7f8024c20 2023-10-05T19:50:35.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x7fa7f8024c20 2023-10-05T19:50:35.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0a0c0 2023-10-05T19:50:35.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0de70 2023-10-05T19:50:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8006070 con 0x556117f0de70 2023-10-05T19:50:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.621+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0a0c0 2023-10-05T19:50:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0de70 2023-10-05T19:50:35.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8006070 con 0x556117f0de70 2023-10-05T19:50:35.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0de70 2023-10-05T19:50:35.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8006070 con 0x556117f0de70 2023-10-05T19:50:35.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x7fa7f8024c20 2023-10-05T19:50:35.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x7fa7f8024c20 2023-10-05T19:50:35.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117ed8460 2023-10-05T19:50:35.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x7fa7f8024c20 2023-10-05T19:50:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x7fa7f8024c20 2023-10-05T19:50:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.625+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0de70 2023-10-05T19:50:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8006070 con 0x556117f0de70 2023-10-05T19:50:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x7fa7f8024c20 2023-10-05T19:50:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x7fa7f8024c20 2023-10-05T19:50:35.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0a0c0 2023-10-05T19:50:35.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0a0c0 2023-10-05T19:50:35.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0de70 2023-10-05T19:50:35.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8006070 con 0x556117f0de70 2023-10-05T19:50:35.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0a0c0 2023-10-05T19:50:35.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f126b0 con 0x556117f0a0c0 2023-10-05T19:50:35.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7ff684e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7ff684e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7ff684e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7ff684e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.629+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f0ee70 con 0x556117ed8460 2023-10-05T19:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f0f7f0 con 0x556117f0a0c0 2023-10-05T19:50:35.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f0ea60 con 0x556117f0a0c0 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13060 con 0x556117f0de70 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fa7e8006070 con 0x556117f0de70 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117ed8460 2023-10-05T19:50:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f137c0 con 0x556117f0a0c0 2023-10-05T19:50:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.633+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f14b80 con 0x556117f0de70 2023-10-05T19:50:35.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f14b80 con 0x556117f0a0c0 2023-10-05T19:50:35.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f14b80 con 0x7fa7f8024c20 2023-10-05T19:50:35.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x7fa7f8024c20 2023-10-05T19:50:35.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117ed8460 2023-10-05T19:50:35.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117ed8460 2023-10-05T19:50:35.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117f0de70 2023-10-05T19:50:35.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117ed8460 2023-10-05T19:50:35.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.637+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117f0a0c0 2023-10-05T19:50:35.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117f0a0c0 2023-10-05T19:50:35.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117ed8460 2023-10-05T19:50:35.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x7fa7f8024c20 2023-10-05T19:50:35.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x7fa7f8024c20 2023-10-05T19:50:35.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117ed8460 2023-10-05T19:50:35.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x7fa7f8024c20 2023-10-05T19:50:35.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x7fa7f8024c20 2023-10-05T19:50:35.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117f0a0c0 2023-10-05T19:50:35.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.641+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13410 con 0x556117f0de70 2023-10-05T19:50:35.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117ed8460 2023-10-05T19:50:35.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117f0a0c0 2023-10-05T19:50:35.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117f0de70 2023-10-05T19:50:35.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117ed8460 2023-10-05T19:50:35.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0014040 con 0x556117ed8460 2023-10-05T19:50:35.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117ed8460 2023-10-05T19:50:35.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117ed8460 2023-10-05T19:50:35.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117f0de70 2023-10-05T19:50:35.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.645+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x7fa7f8024c20 2023-10-05T19:50:35.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117ed8460 2023-10-05T19:50:35.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x7fa7f8024c20 2023-10-05T19:50:35.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117f0de70 2023-10-05T19:50:35.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x7fa7f8024c20 2023-10-05T19:50:35.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117f0a0c0 2023-10-05T19:50:35.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117f0a0c0 2023-10-05T19:50:35.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.649+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117f0de70 2023-10-05T19:50:35.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117f0a0c0 2023-10-05T19:50:35.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa7e8028040 con 0x556117f0a0c0 2023-10-05T19:50:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13b70 con 0x556117f0a0c0 2023-10-05T19:50:35.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f13f20 con 0x556117ed8460 2023-10-05T19:50:35.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.653+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f147c0 con 0x556117f0a0c0 2023-10-05T19:50:35.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f147c0 con 0x556117f0a0c0 2023-10-05T19:50:35.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f147c0 con 0x7fa7f8024c20 2023-10-05T19:50:35.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 zone default found 2023-10-05T19:50:35.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 4 Realm: () 2023-10-05T19:50:35.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:35.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:35.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:35.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 zonegroup default 2023-10-05T19:50:35.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f147c0 con 0x7fa7f8024c20 2023-10-05T19:50:35.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f16140 con 0x556117f0de70 2023-10-05T19:50:35.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f164f0 con 0x556117f0de70 2023-10-05T19:50:35.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 started sync module instance, tier type = 2023-10-05T19:50:35.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:35.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.657+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f15850 con 0x556117f0a0c0 2023-10-05T19:50:35.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.661+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.661+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93875501880160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f15d70 con 0x556117f0a0c0 2023-10-05T19:50:35.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.661+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f17280 con 0x556117ed8460 2023-10-05T19:50:35.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.661+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.661+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93875501880160] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.665+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93875501886864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f15d70 con 0x556117ed8460 2023-10-05T19:50:35.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.665+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f168a0 con 0x556117f0a0c0 2023-10-05T19:50:35.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.665+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93875501886864] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.665+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.665+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93875501887968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f15d70 con 0x556117f0a0c0 2023-10-05T19:50:35.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.665+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f182b0 con 0x7fa7f8024c20 2023-10-05T19:50:35.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.669+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.669+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93875501891008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f18700 con 0x7fa7f8024c20 2023-10-05T19:50:35.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.669+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f18fa0 con 0x556117f0a0c0 2023-10-05T19:50:35.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.669+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93875501887968] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.669+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93875501891008] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.669+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.669+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93875501892112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f18b50 con 0x556117f0a0c0 2023-10-05T19:50:35.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.669+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f193f0 con 0x556117f0de70 2023-10-05T19:50:35.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93875501894768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f19c90 con 0x556117f0de70 2023-10-05T19:50:35.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f1a6a0 con 0x556117f0de70 2023-10-05T19:50:35.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93875501892112] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 93875501894768] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93875501900208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f1aa50 con 0x556117f0de70 2023-10-05T19:50:35.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f1b2f0 con 0x7fa7f8024c20 2023-10-05T19:50:35.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93875501902976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f1b5c0 con 0x7fa7f8024c20 2023-10-05T19:50:35.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 20 add_watcher() i=0 2023-10-05T19:50:35.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 20 add_watcher() i=1 2023-10-05T19:50:35.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93875501900208] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 20 add_watcher() i=2 2023-10-05T19:50:35.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 20 add_watcher() i=3 2023-10-05T19:50:35.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 20 add_watcher() i=4 2023-10-05T19:50:35.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 20 add_watcher() i=5 2023-10-05T19:50:35.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.673+0000 7fa7ff684e40 20 add_watcher() i=6 2023-10-05T19:50:35.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93875501902976] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7ff684e40 20 add_watcher() i=7 2023-10-05T19:50:35.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7ff684e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:35.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f18660 con 0x556117ed8460 2023-10-05T19:50:35.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93875501904080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f1ba80 con 0x556117ed8460 2023-10-05T19:50:35.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93875501904080] v30'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7ce7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7ff684e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:35.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7ff684e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:35.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7ff684e40 1 Processor -- start 2023-10-05T19:50:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.677+0000 7fa7ff684e40 1 -- start start 2023-10-05T19:50:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f28ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556117f29220 con 0x556117f28910 2023-10-05T19:50:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7fc9b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f28ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7fc9b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f28ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47604/0 (socket says 172.21.15.167:47604) 2023-10-05T19:50:35.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/3394672901 learned_addr learned my addr 172.21.15.167:0/3394672901 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/3394672901 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556117f29360 con 0x556117f28910 2023-10-05T19:50:35.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7fc9b8700 1 --2- 172.21.15.167:0/3394672901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f28ce0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x556117f0a000 tx=0x7fa7e8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc57a8876c976fc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7cdfe3700 1 -- 172.21.15.167:0/3394672901 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e803b070 con 0x556117f28910 2023-10-05T19:50:35.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7cdfe3700 1 -- 172.21.15.167:0/3394672901 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8022040 con 0x556117f28910 2023-10-05T19:50:35.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7cdfe3700 1 -- 172.21.15.167:0/3394672901 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e8021040 con 0x556117f28910 2023-10-05T19:50:35.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 -- 172.21.15.167:0/3394672901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 msgr2=0x556117f28ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/3394672901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f28ce0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x556117f0a000 tx=0x7fa7e8010000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 -- 172.21.15.167:0/3394672901 shutdown_connections 2023-10-05T19:50:35.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/3394672901 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f28ce0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 -- 172.21.15.167:0/3394672901 >> 172.21.15.167:0/3394672901 conn(0x556117f23cd0 msgr2=0x556117f21e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 -- 172.21.15.167:0/3394672901 shutdown_connections 2023-10-05T19:50:35.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 -- 172.21.15.167:0/3394672901 wait complete. 2023-10-05T19:50:35.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 Processor -- start 2023-10-05T19:50:35.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.681+0000 7fa7ff684e40 1 -- start start 2023-10-05T19:50:35.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7ff684e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f2e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7ff684e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556117f2f3c0 con 0x556117f28910 2023-10-05T19:50:35.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7fc9b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f2e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7fc9b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f2e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47612/0 (socket says 172.21.15.167:47612) 2023-10-05T19:50:35.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/542573072 learned_addr learned my addr 172.21.15.167:0/542573072 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/542573072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556117e22bd0 con 0x556117f28910 2023-10-05T19:50:35.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7fc9b8700 1 --2- 172.21.15.167:0/542573072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f2e3c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8001b00 tx=0x7fa7e8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa73ffff700 1 -- 172.21.15.167:0/542573072 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e8021070 con 0x556117f28910 2023-10-05T19:50:35.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7ff684e40 1 -- 172.21.15.167:0/542573072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556117f2e9c0 con 0x556117f28910 2023-10-05T19:50:35.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa73ffff700 1 -- 172.21.15.167:0/542573072 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8041420 con 0x556117f28910 2023-10-05T19:50:35.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa73ffff700 1 -- 172.21.15.167:0/542573072 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e8046070 con 0x556117f28910 2023-10-05T19:50:35.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7ff684e40 1 -- 172.21.15.167:0/542573072 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556117f2ee60 con 0x556117f28910 2023-10-05T19:50:35.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa73ffff700 1 -- 172.21.15.167:0/542573072 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fa7e803e020 con 0x556117f28910 2023-10-05T19:50:35.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa73ffff700 1 --2- 172.21.15.167:0/542573072 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa744030c00 0x7fa7440330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa73ffff700 1 -- 172.21.15.167:0/542573072 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fa7e802e040 con 0x556117f28910 2023-10-05T19:50:35.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7fd9ba700 1 --2- 172.21.15.167:0/542573072 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa744030c00 0x7fa7440330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.685+0000 7fa7ff684e40 5 note: GC not initialized 2023-10-05T19:50:35.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7fd9ba700 1 --2- 172.21.15.167:0/542573072 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa744030c00 0x7fa7440330b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x556117f1b820 tx=0x7fa7f000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa73d7fa700 20 reqs_thread_entry: start 2023-10-05T19:50:35.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa736ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:35.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7ff684e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:35.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7ff684e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:35.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7357fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:06 2023 2023-10-05T19:50:35.696 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:35.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7ff684e40 20 get_system_obj_state: rctx=0x7ffe65cfa458 obj=default.rgw.meta:users.uid:foo state=0x556117daf0b0 s->prefetch_data=0 2023-10-05T19:50:35.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f96cb0 con 0x556117ed8460 2023-10-05T19:50:35.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa734ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:35.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7ff684e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:35.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7ff684e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:35.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7ff684e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117f99740 con 0x556117ed8460 2023-10-05T19:50:35.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 273+0+744 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.689+0000 7fa7ff684e40 20 rados_obj.operate() r=0 bl.length=621 2023-10-05T19:50:35.699 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:35.699 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:35.699 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:35.699 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:35.699 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:35.699 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:35.699 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [ 2023-10-05T19:50:35.699 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.699 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo1", 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "full-control" 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo2", 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "" 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.700 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [ 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo1", 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL" 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.701 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo2", 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:35.702 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:35.703 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.703 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.703 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.703 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.703 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.703 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.703 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:35.703 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.703 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.704 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.704 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.704 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.704 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:35.704 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:35.704 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:35.704 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:35.704 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:35.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.693+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93875501880160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117eed440 con 0x556117f0a0c0 2023-10-05T19:50:35.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.693+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93875501880160] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.693+0000 7fa7ff684e40 20 remove_watcher() i=0 2023-10-05T19:50:35.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.693+0000 7fa7ff684e40 2 removed watcher, disabling cache 2023-10-05T19:50:35.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.693+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93875501886864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117eed440 con 0x556117ed8460 2023-10-05T19:50:35.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.697+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93875501886864] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.697+0000 7fa7ff684e40 20 remove_watcher() i=1 2023-10-05T19:50:35.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.697+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93875501887968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117eed440 con 0x556117f0a0c0 2023-10-05T19:50:35.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.697+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93875501887968] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.697+0000 7fa7ff684e40 20 remove_watcher() i=2 2023-10-05T19:50:35.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.697+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93875501891008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117eed440 con 0x7fa7f8024c20 2023-10-05T19:50:35.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.701+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93875501891008] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.701+0000 7fa7ff684e40 20 remove_watcher() i=3 2023-10-05T19:50:35.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.701+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93875501892112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117eed440 con 0x556117f0a0c0 2023-10-05T19:50:35.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.701+0000 7fa7fd1b9700 1 -- 172.21.15.167:0/2651265641 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93875501892112] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f8034070 con 0x556117f0a0c0 2023-10-05T19:50:35.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.701+0000 7fa7ff684e40 20 remove_watcher() i=4 2023-10-05T19:50:35.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.701+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93875501894768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117eed440 con 0x556117f0de70 2023-10-05T19:50:35.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.705+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93875501894768] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.705+0000 7fa7ff684e40 20 remove_watcher() i=5 2023-10-05T19:50:35.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.705+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93875501900208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117eed440 con 0x556117f0de70 2023-10-05T19:50:35.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.705+0000 7fa7fc9b8700 1 -- 172.21.15.167:0/2651265641 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93875501900208] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7e8024040 con 0x556117f0de70 2023-10-05T19:50:35.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.705+0000 7fa7ff684e40 20 remove_watcher() i=6 2023-10-05T19:50:35.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.705+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93875501902976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117eed440 con 0x7fa7f8024c20 2023-10-05T19:50:35.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.709+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93875501902976] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x7fa7f8024c20 2023-10-05T19:50:35.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.709+0000 7fa7ff684e40 20 remove_watcher() i=7 2023-10-05T19:50:35.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.709+0000 7fa7ce7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.709+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93875501904080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556117eed440 con 0x556117ed8460 2023-10-05T19:50:35.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 93875501904080] v30'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa7f0033040 con 0x556117ed8460 2023-10-05T19:50:35.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556117f0a0c0 msgr2=0x556117f0d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556117f0a0c0 0x556117f0d300 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556117ed8460 msgr2=0x556117f09280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556117ed8460 0x556117f09280 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa7f8024c20 msgr2=0x7fa7f801a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa7f8024c20 0x7fa7f801a5f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556117f0de70 msgr2=0x556117f120d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556117f0de70 0x556117f120d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa7e0030c50 msgr2=0x7fa7e0033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa7e0030c50 0x7fa7e0033100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8004170 tx=0x7fa7e8001380 comp rx=0 tx=0).stop 2023-10-05T19:50:35.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 msgr2=0x556117efd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/2651265641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117ed7b50 0x556117efd860 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x556117ef3240 tx=0x7fa7f801d000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7fd9ba700 1 -- 172.21.15.167:0/2651265641 reap_dead start 2023-10-05T19:50:35.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 shutdown_connections 2023-10-05T19:50:35.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 >> 172.21.15.167:0/2651265641 conn(0x556117e4b5c0 msgr2=0x556117ef11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 shutdown_connections 2023-10-05T19:50:35.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/2651265641 wait complete. 2023-10-05T19:50:35.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/542573072 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa744030c00 msgr2=0x7fa7440330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/542573072 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa744030c00 0x7fa7440330b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x556117f1b820 tx=0x7fa7f000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:35.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/542573072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 msgr2=0x556117f2e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/542573072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f2e3c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8001b00 tx=0x7fa7e8037000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/542573072 shutdown_connections 2023-10-05T19:50:35.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/542573072 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa744030c00 0x7fa7440330b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 --2- 172.21.15.167:0/542573072 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556117f28910 0x556117f2e3c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/542573072 >> 172.21.15.167:0/542573072 conn(0x556117f23cd0 msgr2=0x556117f21dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/542573072 shutdown_connections 2023-10-05T19:50:35.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.713+0000 7fa7ff684e40 1 -- 172.21.15.167:0/542573072 wait complete. 2023-10-05T19:50:35.725 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:35.725 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2023-10-05T19:50:35.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2023-10-05T19:50:35.725 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2023-10-05T19:50:35.767 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:35.767 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:35.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a44bc4e40 1 Processor -- start 2023-10-05T19:50:35.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a44bc4e40 1 -- start start 2023-10-05T19:50:35.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a44bc4e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c2bb0d0130 0x55c2bb0d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a44bc4e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c2bb016bd0 con 0x55c2bb0cbb60 2023-10-05T19:50:35.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a44bc4e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c2bafd3ee0 con 0x55c2bb0d0130 2023-10-05T19:50:35.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a41ef8700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c2bb0d0130 0x55c2bb0d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a426f9700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55c2bb0cbb60 0x55c2bb0cbf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:40020/0 (socket says 172.21.15.167:40020) 2023-10-05T19:50:35.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a426f9700 1 -- 172.21.15.167:0/3802177669 learned_addr learned my addr 172.21.15.167:0/3802177669 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:35.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a41ef8700 1 -- 172.21.15.167:0/3802177669 >> v1:172.21.15.118:6789/0 conn(0x55c2bb0cbb60 legacy=0x55c2bb0cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a41ef8700 1 -- 172.21.15.167:0/3802177669 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2bb0cc770 con 0x55c2bb0d0130 2023-10-05T19:50:35.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.761+0000 7f1a41ef8700 1 --2- 172.21.15.167:0/3802177669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0d0130 0x55c2bb0d2510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00a5d0 tx=0x7f1a2c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05a4e13f01233fd server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a416f7700 1 -- 172.21.15.167:0/3802177669 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c0086a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a416f7700 1 -- 172.21.15.167:0/3802177669 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c008800 con 0x55c2bb0d0130 2023-10-05T19:50:35.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a416f7700 1 -- 172.21.15.167:0/3802177669 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c008ad0 con 0x55c2bb0d0130 2023-10-05T19:50:35.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3802177669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0d0130 msgr2=0x55c2bb0d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/3802177669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0d0130 0x55c2bb0d2510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00a5d0 tx=0x7f1a2c005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:35.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3802177669 shutdown_connections 2023-10-05T19:50:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/3802177669 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0d0130 0x55c2bb0d2510 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3802177669 >> 172.21.15.167:0/3802177669 conn(0x55c2bb03f5d0 msgr2=0x55c2bb03f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3802177669 shutdown_connections 2023-10-05T19:50:35.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3802177669 wait complete. 2023-10-05T19:50:35.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 Processor -- start 2023-10-05T19:50:35.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 -- start start 2023-10-05T19:50:35.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0eab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a44bc4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2baf97e30 con 0x55c2bb0cbb60 2023-10-05T19:50:35.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a426f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0eab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a426f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0eab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47630/0 (socket says 172.21.15.167:47630) 2023-10-05T19:50:35.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a426f9700 1 -- 172.21.15.167:0/3350593189 learned_addr learned my addr 172.21.15.167:0/3350593189 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a426f9700 1 -- 172.21.15.167:0/3350593189 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c005cf0 con 0x55c2bb0cbb60 2023-10-05T19:50:35.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a426f9700 1 --2- 172.21.15.167:0/3350593189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0eab90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a34001bf0 tx=0x7f1a340017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e4f50f09993f3c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a3bfff700 1 -- 172.21.15.167:0/3350593189 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a3400bbf0 con 0x55c2bb0cbb60 2023-10-05T19:50:35.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a3bfff700 1 -- 172.21.15.167:0/3350593189 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3400bd50 con 0x55c2bb0cbb60 2023-10-05T19:50:35.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.765+0000 7f1a3bfff700 1 -- 172.21.15.167:0/3350593189 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a3400e470 con 0x55c2bb0cbb60 2023-10-05T19:50:35.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3350593189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 msgr2=0x55c2bb0eab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/3350593189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0eab90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a34001bf0 tx=0x7f1a340017a0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3350593189 shutdown_connections 2023-10-05T19:50:35.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/3350593189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0eab90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3350593189 >> 172.21.15.167:0/3350593189 conn(0x55c2bb03f5d0 msgr2=0x55c2bb0e6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3350593189 shutdown_connections 2023-10-05T19:50:35.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/3350593189 wait complete. 2023-10-05T19:50:35.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 Processor -- start 2023-10-05T19:50:35.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 -- start start 2023-10-05T19:50:35.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2baf6aed0 con 0x55c2bb0cbb60 2023-10-05T19:50:35.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a426f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a426f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0f1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47634/0 (socket says 172.21.15.167:47634) 2023-10-05T19:50:35.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 learned_addr learned my addr 172.21.15.167:0/1293543935 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2bb016bd0 con 0x55c2bb0cbb60 2023-10-05T19:50:35.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a426f9700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0f1930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55c2bb0e7270 tx=0x7f1a34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a3a7fc700 1 -- 172.21.15.167:0/1293543935 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a3401f070 con 0x55c2bb0cbb60 2023-10-05T19:50:35.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c2bb0f1e70 con 0x55c2bb0cbb60 2023-10-05T19:50:35.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a3a7fc700 1 -- 172.21.15.167:0/1293543935 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3401a2e0 con 0x55c2bb0cbb60 2023-10-05T19:50:35.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a3a7fc700 1 -- 172.21.15.167:0/1293543935 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a3400bec0 con 0x55c2bb0cbb60 2023-10-05T19:50:35.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.769+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2bb0f22b0 con 0x55c2bb0cbb60 2023-10-05T19:50:35.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a3a7fc700 1 -- 172.21.15.167:0/1293543935 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f1a3401a960 con 0x55c2bb0cbb60 2023-10-05T19:50:35.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a3a7fc700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1a28030c50 0x7f1a28033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a3a7fc700 1 -- 172.21.15.167:0/1293543935 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f1a340450c0 con 0x55c2bb0cbb60 2023-10-05T19:50:35.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a41ef8700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1a28030c50 0x7f1a28033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c2bb0d0130 0x55c2bb0fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb0fda60 con 0x55c2bb0d0130 2023-10-05T19:50:35.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a42efa700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c2bb0d0130 0x55c2bb0fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a41ef8700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1a28030c50 0x7f1a28033100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c005a90 tx=0x7f1a2c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a42efa700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c2bb0d0130 0x55c2bb0fd3f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a44bc4e40 20 realm 2023-10-05T19:50:35.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.773+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb0faa50 con 0x55c2bb0d0130 2023-10-05T19:50:35.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:35.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb0fe540 con 0x55c2bb0d0130 2023-10-05T19:50:35.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c2bb0ff370 0x55c2bb101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb101c90 con 0x55c2bb0ff370 2023-10-05T19:50:35.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a426f9700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c2bb0ff370 0x55c2bb101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a426f9700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c2bb0ff370 0x55c2bb101750 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb102530 con 0x55c2bb0d0130 2023-10-05T19:50:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 20 searching for the correct realm 2023-10-05T19:50:35.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c2bb1042f0 0x55c2bb1066d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb1042f0 2023-10-05T19:50:35.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.777+0000 7f1a41ef8700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c2bb1042f0 0x55c2bb1066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a41ef8700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c2bb1042f0 0x55c2bb1066d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0ff370 2023-10-05T19:50:35.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a426f9700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1a3402d020 0x7f1a3403d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x7f1a3402d020 2023-10-05T19:50:35.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a42efa700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1a3402d020 0x7f1a3403d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a42efa700 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1a3402d020 0x7f1a3403d8d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.781+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb1042f0 2023-10-05T19:50:35.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0ff370 2023-10-05T19:50:35.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0ff370 2023-10-05T19:50:35.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.785+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x7f1a3402d020 2023-10-05T19:50:35.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x7f1a3402d020 2023-10-05T19:50:35.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0ff370 2023-10-05T19:50:35.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb1042f0 2023-10-05T19:50:35.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0ff370 2023-10-05T19:50:35.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.789+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb1042f0 2023-10-05T19:50:35.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb1042f0 2023-10-05T19:50:35.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x7f1a3402d020 2023-10-05T19:50:35.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0d0130 2023-10-05T19:50:35.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.793+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x7f1a3402d020 2023-10-05T19:50:35.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb1042f0 2023-10-05T19:50:35.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x7f1a3402d020 2023-10-05T19:50:35.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0ff370 2023-10-05T19:50:35.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0ff370 2023-10-05T19:50:35.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb1042f0 2023-10-05T19:50:35.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.797+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0ff370 2023-10-05T19:50:35.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb106c10 con 0x55c2bb0ff370 2023-10-05T19:50:35.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb1030a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb1039f0 con 0x55c2bb0ff370 2023-10-05T19:50:35.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb107050 con 0x55c2bb0ff370 2023-10-05T19:50:35.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.801+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb107400 con 0x55c2bb1042f0 2023-10-05T19:50:35.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb1077b0 con 0x55c2bb0d0130 2023-10-05T19:50:35.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb103530 con 0x55c2bb0ff370 2023-10-05T19:50:35.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb1042f0 2023-10-05T19:50:35.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0ff370 2023-10-05T19:50:35.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x7f1a3402d020 2023-10-05T19:50:35.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.805+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb1042f0 2023-10-05T19:50:35.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0ff370 2023-10-05T19:50:35.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.809+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0ff370 2023-10-05T19:50:35.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x7f1a3402d020 2023-10-05T19:50:35.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x7f1a3402d020 2023-10-05T19:50:35.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.813+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0ff370 2023-10-05T19:50:35.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb1042f0 2023-10-05T19:50:35.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0ff370 2023-10-05T19:50:35.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb1042f0 2023-10-05T19:50:35.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.817+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb1042f0 2023-10-05T19:50:35.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x7f1a3402d020 2023-10-05T19:50:35.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0d0130 2023-10-05T19:50:35.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x7f1a3402d020 2023-10-05T19:50:35.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.821+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb1042f0 2023-10-05T19:50:35.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x7f1a3402d020 2023-10-05T19:50:35.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0ff370 2023-10-05T19:50:35.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0ff370 2023-10-05T19:50:35.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb1042f0 2023-10-05T19:50:35.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0ff370 2023-10-05T19:50:35.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.825+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109060 con 0x55c2bb0ff370 2023-10-05T19:50:35.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a34014070 con 0x55c2bb0ff370 2023-10-05T19:50:35.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:35.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:35.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:35.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:35.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb108050 con 0x55c2bb0ff370 2023-10-05T19:50:35.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb108400 con 0x55c2bb0d0130 2023-10-05T19:50:35.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:35.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109460 con 0x55c2bb0ff370 2023-10-05T19:50:35.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:35.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.829+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb107c80 con 0x55c2bb0ff370 2023-10-05T19:50:35.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:35.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109460 con 0x7f1a3402d020 2023-10-05T19:50:35.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 zone default found 2023-10-05T19:50:35.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 4 Realm: () 2023-10-05T19:50:35.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:35.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:35.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:35.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 zonegroup default 2023-10-05T19:50:35.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb109460 con 0x7f1a3402d020 2023-10-05T19:50:35.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10ad90 con 0x55c2bb1042f0 2023-10-05T19:50:35.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10b140 con 0x55c2bb1042f0 2023-10-05T19:50:35.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:35.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 started sync module instance, tier type = 2023-10-05T19:50:35.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:35.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.833+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10a450 con 0x55c2bb0ff370 2023-10-05T19:50:35.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.837+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.837+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94294850447440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10a450 con 0x55c2bb0ff370 2023-10-05T19:50:35.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.837+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10b9e0 con 0x55c2bb0d0130 2023-10-05T19:50:35.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.837+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.841+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94294850447440] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.841+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94294850450672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10a450 con 0x55c2bb0d0130 2023-10-05T19:50:35.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.841+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb108970 con 0x55c2bb0ff370 2023-10-05T19:50:35.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.841+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94294850450672] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.841+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.841+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94294850451776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10c430 con 0x55c2bb0ff370 2023-10-05T19:50:35.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.841+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10cd10 con 0x7f1a3402d020 2023-10-05T19:50:35.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94294850451776] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94294850454576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10c880 con 0x7f1a3402d020 2023-10-05T19:50:35.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10d600 con 0x55c2bb0ff370 2023-10-05T19:50:35.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94294850454576] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94294850453312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10d600 con 0x55c2bb0ff370 2023-10-05T19:50:35.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10e010 con 0x55c2bb1042f0 2023-10-05T19:50:35.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.845+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94294850460448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10e8b0 con 0x55c2bb1042f0 2023-10-05T19:50:35.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94294850453312] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10f150 con 0x55c2bb1042f0 2023-10-05T19:50:35.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94294850460448] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94294850464864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10f500 con 0x55c2bb1042f0 2023-10-05T19:50:35.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10ff10 con 0x7f1a3402d020 2023-10-05T19:50:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94294850464864] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a2c012450 con 0x55c2bb1042f0 2023-10-05T19:50:35.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94294850468384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb110360 con 0x7f1a3402d020 2023-10-05T19:50:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 20 add_watcher() i=0 2023-10-05T19:50:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 20 add_watcher() i=1 2023-10-05T19:50:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 20 add_watcher() i=2 2023-10-05T19:50:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 20 add_watcher() i=3 2023-10-05T19:50:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 20 add_watcher() i=4 2023-10-05T19:50:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 20 add_watcher() i=5 2023-10-05T19:50:35.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.849+0000 7f1a44bc4e40 20 add_watcher() i=6 2023-10-05T19:50:35.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94294850468384] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a44bc4e40 20 add_watcher() i=7 2023-10-05T19:50:35.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a44bc4e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:35.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb113430 con 0x55c2bb0d0130 2023-10-05T19:50:35.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94294850469488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb1107b0 con 0x55c2bb0d0130 2023-10-05T19:50:35.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94294850469488] v30'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a12fed700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a44bc4e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:35.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.853+0000 7f1a44bc4e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:35.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 Processor -- start 2023-10-05T19:50:35.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 -- start start 2023-10-05T19:50:35.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb11e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2bb11e570 con 0x55c2bb11dc60 2023-10-05T19:50:35.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a41ef8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb11e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a41ef8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb11e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47636/0 (socket says 172.21.15.167:47636) 2023-10-05T19:50:35.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1567036070 learned_addr learned my addr 172.21.15.167:0/1567036070 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1567036070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2bb11e6b0 con 0x55c2bb11dc60 2023-10-05T19:50:35.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a41ef8700 1 --2- 172.21.15.167:0/1567036070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb11e030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55c2bb0ccb90 tx=0x7f1a2c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4336f3668f39c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a127ec700 1 -- 172.21.15.167:0/1567036070 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c02d040 con 0x55c2bb11dc60 2023-10-05T19:50:35.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a127ec700 1 -- 172.21.15.167:0/1567036070 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c028890 con 0x55c2bb11dc60 2023-10-05T19:50:35.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a127ec700 1 -- 172.21.15.167:0/1567036070 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c012940 con 0x55c2bb11dc60 2023-10-05T19:50:35.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1567036070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 msgr2=0x55c2bb11e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1567036070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb11e030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55c2bb0ccb90 tx=0x7f1a2c012000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1567036070 shutdown_connections 2023-10-05T19:50:35.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1567036070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb11e030 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1567036070 >> 172.21.15.167:0/1567036070 conn(0x55c2bb119020 msgr2=0x55c2bb117170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1567036070 shutdown_connections 2023-10-05T19:50:35.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1567036070 wait complete. 2023-10-05T19:50:35.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 Processor -- start 2023-10-05T19:50:35.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.857+0000 7f1a44bc4e40 1 -- start start 2023-10-05T19:50:35.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a44bc4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb123690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a44bc4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2bb124690 con 0x55c2bb11dc60 2023-10-05T19:50:35.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a41ef8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb123690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a41ef8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb123690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47646/0 (socket says 172.21.15.167:47646) 2023-10-05T19:50:35.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a41ef8700 1 -- 172.21.15.167:0/16182205 learned_addr learned my addr 172.21.15.167:0/16182205 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a41ef8700 1 -- 172.21.15.167:0/16182205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2bb0cc770 con 0x55c2bb11dc60 2023-10-05T19:50:35.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a41ef8700 1 --2- 172.21.15.167:0/16182205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb123690 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c008d10 tx=0x7f1a2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a10fe9700 1 -- 172.21.15.167:0/16182205 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c0339f0 con 0x55c2bb11dc60 2023-10-05T19:50:35.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/16182205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c2bb123c90 con 0x55c2bb11dc60 2023-10-05T19:50:35.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a10fe9700 1 -- 172.21.15.167:0/16182205 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c03f070 con 0x55c2bb11dc60 2023-10-05T19:50:35.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a10fe9700 1 -- 172.21.15.167:0/16182205 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c033bb0 con 0x55c2bb11dc60 2023-10-05T19:50:35.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/16182205 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2bb1240d0 con 0x55c2bb11dc60 2023-10-05T19:50:35.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a10fe9700 1 -- 172.21.15.167:0/16182205 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f1a2c04d440 con 0x55c2bb11dc60 2023-10-05T19:50:35.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a10fe9700 1 --2- 172.21.15.167:0/16182205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1988030c00 0x7f19880330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a10fe9700 1 -- 172.21.15.167:0/16182205 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f1a2c041070 con 0x55c2bb11dc60 2023-10-05T19:50:35.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a42efa700 1 --2- 172.21.15.167:0/16182205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1988030c00 0x7f19880330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.861+0000 7f1a44bc4e40 5 note: GC not initialized 2023-10-05T19:50:35.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a42efa700 1 --2- 172.21.15.167:0/16182205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1988030c00 0x7f19880330b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55c2bb10e5c0 tx=0x7f1a3c00ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1981ffb700 20 reqs_thread_entry: start 2023-10-05T19:50:35.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f19737fe700 20 reqs_thread_entry: start 2023-10-05T19:50:35.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:35.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:35.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1971ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:06 2023 2023-10-05T19:50:35.873 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:35.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f19717fa700 20 reqs_thread_entry: start 2023-10-05T19:50:35.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 20 get_system_obj_state: rctx=0x7ffda06bb6d8 obj=default.rgw.meta:users.uid:foo state=0x55c2bafa30b0 s->prefetch_data=0 2023-10-05T19:50:35.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:35.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb18bf80 con 0x55c2bb0d0130 2023-10-05T19:50:35.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:35.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:35.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:35.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:35.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:35.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:35.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:35.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb18ea10 con 0x55c2bb0d0130 2023-10-05T19:50:35.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 273+0+744 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 20 rados_obj.operate() r=0 bl.length=621 2023-10-05T19:50:35.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:35.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:35.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:35.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.865+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~539 in=539b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb190540 con 0x55c2bb0d0130 2023-10-05T19:50:35.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~539] v30'9 uv9 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a44bc4e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:35.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a44bc4e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:35.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a44bc4e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:35.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94294850973920 in=727b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb18fa20 con 0x55c2bb0ff370 2023-10-05T19:50:35.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94294850453312 notify 128849018892 ret 0) v3 ==== 757+0+0 (crc 0 0 0) 0x55c2bb0f22b0 con 0x55c2bb0ff370 2023-10-05T19:50:35.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a3b7fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94294850453312 notifier 4379 bl.length()=715 2023-10-05T19:50:35.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a3b7fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:35.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a3b7fe700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:35.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a3b7fe700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1a1c003d90 con 0x55c2bb0ff370 2023-10-05T19:50:35.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.4 [notify cookie 94294850973920 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94294850973920 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c2bb0f1e70 con 0x55c2bb0ff370 2023-10-05T19:50:35.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a44bc4e40 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2023-10-05T19:50:35.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.869+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94294850973920 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb18fa20 con 0x55c2bb0ff370 2023-10-05T19:50:35.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.873+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== watch-notify(notify (1) cookie 94294850447440 notify 128849018893 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x55c2bb0f1e70 con 0x55c2bb0ff370 2023-10-05T19:50:35.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.873+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(107 notify.0 [notify cookie 94294850973920 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.873+0000 7f1a3bfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94294850447440 notifier 4379 bl.length()=159 2023-10-05T19:50:35.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.873+0000 7f1a3bfff700 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f19900032d0 con 0x55c2bb0ff370 2023-10-05T19:50:35.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.873+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== watch-notify(notify_complete (2) cookie 94294850973920 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c2bb016bd0 con 0x55c2bb0ff370 2023-10-05T19:50:35.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.873+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(108 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.873+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb18b0e0 con 0x55c2bb0d0130 2023-10-05T19:50:35.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.873+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(109 foo:foo1 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [ 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo1", 2023-10-05T19:50:35.882 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "full-control" 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo2", 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "" 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:35.883 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [ 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo2", 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:35.884 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:35.885 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:35.886 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:35.886 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:35.886 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:35.886 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:35.886 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:35.886 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:35.886 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:35.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.877+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94294850447440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb18b0b0 con 0x55c2bb0ff370 2023-10-05T19:50:35.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.877+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94294850447440] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.877+0000 7f1a44bc4e40 20 remove_watcher() i=0 2023-10-05T19:50:35.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.877+0000 7f1a44bc4e40 2 removed watcher, disabling cache 2023-10-05T19:50:35.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.877+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94294850450672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb18b0b0 con 0x55c2bb0d0130 2023-10-05T19:50:35.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.881+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94294850450672] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.881+0000 7f1a44bc4e40 20 remove_watcher() i=1 2023-10-05T19:50:35.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.881+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94294850451776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb18b0b0 con 0x55c2bb0ff370 2023-10-05T19:50:35.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.881+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94294850451776] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.881+0000 7f1a44bc4e40 20 remove_watcher() i=2 2023-10-05T19:50:35.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.881+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94294850454576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb10b9e0 con 0x7f1a3402d020 2023-10-05T19:50:35.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.885+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94294850454576] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.885+0000 7f1a44bc4e40 20 remove_watcher() i=3 2023-10-05T19:50:35.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.885+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94294850453312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb0e14f0 con 0x55c2bb0ff370 2023-10-05T19:50:35.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.885+0000 7f1a426f9700 1 -- 172.21.15.167:0/1293543935 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94294850453312] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a34059040 con 0x55c2bb0ff370 2023-10-05T19:50:35.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.885+0000 7f1a44bc4e40 20 remove_watcher() i=4 2023-10-05T19:50:35.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.885+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94294850460448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb0e14f0 con 0x55c2bb1042f0 2023-10-05T19:50:35.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.889+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94294850460448] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a2c039020 con 0x55c2bb1042f0 2023-10-05T19:50:35.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.889+0000 7f1a44bc4e40 20 remove_watcher() i=5 2023-10-05T19:50:35.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.889+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94294850464864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb0e14f0 con 0x55c2bb1042f0 2023-10-05T19:50:35.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.889+0000 7f1a41ef8700 1 -- 172.21.15.167:0/1293543935 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94294850464864] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a2c039020 con 0x55c2bb1042f0 2023-10-05T19:50:35.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.889+0000 7f1a44bc4e40 20 remove_watcher() i=6 2023-10-05T19:50:35.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.889+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94294850468384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb0e14f0 con 0x7f1a3402d020 2023-10-05T19:50:35.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.893+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94294850468384] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x7f1a3402d020 2023-10-05T19:50:35.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.893+0000 7f1a44bc4e40 20 remove_watcher() i=7 2023-10-05T19:50:35.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.893+0000 7f1a12fed700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:35.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.893+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94294850469488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c2bb0e14f0 con 0x55c2bb0d0130 2023-10-05T19:50:35.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94294850469488] v30'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a3c00a5a0 con 0x55c2bb0d0130 2023-10-05T19:50:35.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c2bb0ff370 msgr2=0x55c2bb101750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c2bb0ff370 0x55c2bb101750 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c2bb0d0130 msgr2=0x55c2bb0fd3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c2bb0d0130 0x55c2bb0fd3f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1a3402d020 msgr2=0x7f1a3403d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1a3402d020 0x7f1a3403d8d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c2bb1042f0 msgr2=0x55c2bb1066d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c2bb1042f0 0x55c2bb1066d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1a28030c50 msgr2=0x7f1a28033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1a28030c50 0x7f1a28033100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c005a90 tx=0x7f1a2c015000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a42efa700 1 -- 172.21.15.167:0/1293543935 reap_dead start 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 msgr2=0x55c2bb0f1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0f1930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55c2bb0e7270 tx=0x7f1a34016000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 shutdown_connections 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/1293543935 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb0cbb60 0x55c2bb0f1930 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 >> 172.21.15.167:0/1293543935 conn(0x55c2bb03f5d0 msgr2=0x55c2bb0e51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 shutdown_connections 2023-10-05T19:50:35.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/1293543935 wait complete. 2023-10-05T19:50:35.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/16182205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1988030c00 msgr2=0x7f19880330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/16182205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1988030c00 0x7f19880330b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55c2bb10e5c0 tx=0x7f1a3c00ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:35.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/16182205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 msgr2=0x55c2bb123690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/16182205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb123690 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c008d10 tx=0x7f1a2c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/16182205 shutdown_connections 2023-10-05T19:50:35.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/16182205 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1988030c00 0x7f19880330b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 --2- 172.21.15.167:0/16182205 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c2bb11dc60 0x55c2bb123690 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/16182205 >> 172.21.15.167:0/16182205 conn(0x55c2bb119020 msgr2=0x55c2bb1170c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/16182205 shutdown_connections 2023-10-05T19:50:35.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.897+0000 7f1a44bc4e40 1 -- 172.21.15.167:0/16182205 wait complete. 2023-10-05T19:50:35.909 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:35.909 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2023-10-05T19:50:35.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2023-10-05T19:50:35.910 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2023-10-05T19:50:35.988 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:35.988 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:35.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.981+0000 7fde9a8a7e40 1 Processor -- start 2023-10-05T19:50:35.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.981+0000 7fde9a8a7e40 1 -- start start 2023-10-05T19:50:35.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.981+0000 7fde9a8a7e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x558e0761c920 0x558e0761ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.981+0000 7fde9a8a7e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558e07569bd0 con 0x558e0761d230 2023-10-05T19:50:35.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.981+0000 7fde9a8a7e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x558e07526ee0 con 0x558e0761c920 2023-10-05T19:50:35.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.981+0000 7fde97bdb700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x558e0761d230 0x558e0761dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:40028/0 (socket says 172.21.15.167:40028) 2023-10-05T19:50:35.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.981+0000 7fde97bdb700 1 -- 172.21.15.167:0/1604111750 learned_addr learned my addr 172.21.15.167:0/1604111750 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:35.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.981+0000 7fde983dc700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x558e0761c920 0x558e0761ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde973da700 1 -- 172.21.15.167:0/1604111750 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412585645 0 0) 0x558e07569bd0 con 0x558e0761d230 2023-10-05T19:50:35.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde973da700 1 -- 172.21.15.167:0/1604111750 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde78001e10 con 0x558e0761d230 2023-10-05T19:50:35.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde983dc700 1 -- 172.21.15.167:0/1604111750 >> v1:172.21.15.118:6789/0 conn(0x558e0761d230 legacy=0x558e0761dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde983dc700 1 -- 172.21.15.167:0/1604111750 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e0761e3e0 con 0x558e0761c920 2023-10-05T19:50:35.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde983dc700 1 --2- 172.21.15.167:0/1604111750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e0761ccf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fde9000a5d0 tx=0x7fde90005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593973fab0f659ad server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde973da700 1 -- 172.21.15.167:0/1604111750 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde90007610 con 0x558e0761c920 2023-10-05T19:50:35.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde973da700 1 -- 172.21.15.167:0/1604111750 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90007770 con 0x558e0761c920 2023-10-05T19:50:35.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde973da700 1 -- 172.21.15.167:0/1604111750 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde90007a40 con 0x558e0761c920 2023-10-05T19:50:35.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/1604111750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 msgr2=0x558e0761ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/1604111750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e0761ccf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fde9000a5d0 tx=0x7fde90005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:35.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/1604111750 shutdown_connections 2023-10-05T19:50:35.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/1604111750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e0761ccf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/1604111750 >> 172.21.15.167:0/1604111750 conn(0x558e07618340 msgr2=0x558e0761a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/1604111750 shutdown_connections 2023-10-05T19:50:35.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/1604111750 wait complete. 2023-10-05T19:50:35.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 Processor -- start 2023-10-05T19:50:35.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 -- start start 2023-10-05T19:50:35.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e07640260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde9a8a7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e074eae30 con 0x558e0761c920 2023-10-05T19:50:35.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde983dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e07640260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde983dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e07640260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47666/0 (socket says 172.21.15.167:47666) 2023-10-05T19:50:35.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.985+0000 7fde983dc700 1 -- 172.21.15.167:0/2447133586 learned_addr learned my addr 172.21.15.167:0/2447133586 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde983dc700 1 -- 172.21.15.167:0/2447133586 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde90005cf0 con 0x558e0761c920 2023-10-05T19:50:35.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde983dc700 1 --2- 172.21.15.167:0/2447133586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e07640260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde90000c00 tx=0x7fde90014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f83bb0d44ee988 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde963d8700 1 -- 172.21.15.167:0/2447133586 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde900078e0 con 0x558e0761c920 2023-10-05T19:50:35.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde963d8700 1 -- 172.21.15.167:0/2447133586 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90007a40 con 0x558e0761c920 2023-10-05T19:50:35.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde963d8700 1 -- 172.21.15.167:0/2447133586 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde90007bd0 con 0x558e0761c920 2023-10-05T19:50:35.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/2447133586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 msgr2=0x558e07640260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/2447133586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e07640260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde90000c00 tx=0x7fde90014000 comp rx=0 tx=0).stop 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/2447133586 shutdown_connections 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/2447133586 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e07640260 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/2447133586 >> 172.21.15.167:0/2447133586 conn(0x558e07618340 msgr2=0x558e07590b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/2447133586 shutdown_connections 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/2447133586 wait complete. 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 Processor -- start 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 -- start start 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e076446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:35.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde9a8a7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e074bded0 con 0x558e0761c920 2023-10-05T19:50:35.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde983dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e076446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:35.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde983dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e076446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47670/0 (socket says 172.21.15.167:47670) 2023-10-05T19:50:35.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 learned_addr learned my addr 172.21.15.167:0/430026013 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:35.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e0761e3e0 con 0x558e0761c920 2023-10-05T19:50:35.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.989+0000 7fde983dc700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e076446b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde9001f040 tx=0x7fde9001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:35.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde94bd5700 1 -- 172.21.15.167:0/430026013 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde90007bb0 con 0x558e0761c920 2023-10-05T19:50:35.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde94bd5700 1 -- 172.21.15.167:0/430026013 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde90029070 con 0x558e0761c920 2023-10-05T19:50:35.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde94bd5700 1 -- 172.21.15.167:0/430026013 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde90012610 con 0x558e0761c920 2023-10-05T19:50:35.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e07644bf0 con 0x558e0761c920 2023-10-05T19:50:35.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e07645030 con 0x558e0761c920 2023-10-05T19:50:36.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde94bd5700 1 -- 172.21.15.167:0/430026013 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fde90012770 con 0x558e0761c920 2023-10-05T19:50:36.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde94bd5700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fde7c030ca0 0x7fde7c033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde94bd5700 1 -- 172.21.15.167:0/430026013 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fde9002b070 con 0x558e0761c920 2023-10-05T19:50:36.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558e0761d230 0x558e07650170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07650820 con 0x558e0761d230 2023-10-05T19:50:36.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde97bdb700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fde7c030ca0 0x7fde7c033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde98bdd700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558e0761d230 0x558e07650170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.993+0000 7fde98bdd700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558e0761d230 0x558e07650170 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde97bdb700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fde7c030ca0 0x7fde7c033150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde800044f0 tx=0x7fde80006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde8800a500 con 0x558e0761d230 2023-10-05T19:50:36.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 20 realm 2023-10-05T19:50:36.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0764d7d0 con 0x558e0761d230 2023-10-05T19:50:36.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde8800a500 con 0x558e0761d230 2023-10-05T19:50:36.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:36.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07651300 con 0x558e0761d230 2023-10-05T19:50:36.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde8800a500 con 0x558e0761d230 2023-10-05T19:50:36.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558e07652130 0x558e07654510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07654a50 con 0x558e07652130 2023-10-05T19:50:36.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde983dc700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558e07652130 0x558e07654510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde983dc700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558e07652130 0x558e07654510 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:35.997+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076552f0 con 0x558e0761d230 2023-10-05T19:50:36.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fde8800a500 con 0x558e0761d230 2023-10-05T19:50:36.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde9a8a7e40 20 searching for the correct realm 2023-10-05T19:50:36.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558e076570b0 0x558e07659490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e076570b0 2023-10-05T19:50:36.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde97bdb700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558e076570b0 0x558e07659490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde97bdb700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558e076570b0 0x558e07659490 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde80004520 con 0x558e076570b0 2023-10-05T19:50:36.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e07652130 2023-10-05T19:50:36.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde983dc700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fde90007030 0x7fde9001e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x7fde90007030 2023-10-05T19:50:36.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde98bdd700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fde90007030 0x7fde9001e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.001+0000 7fde98bdd700 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fde90007030 0x7fde9001e780 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x7fde90007030 2023-10-05T19:50:36.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e076570b0 2023-10-05T19:50:36.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde80004520 con 0x558e076570b0 2023-10-05T19:50:36.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e07652130 2023-10-05T19:50:36.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.005+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e07652130 2023-10-05T19:50:36.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x7fde90007030 2023-10-05T19:50:36.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x7fde90007030 2023-10-05T19:50:36.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x7fde90007030 2023-10-05T19:50:36.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x7fde90007030 2023-10-05T19:50:36.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e07652130 2023-10-05T19:50:36.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.009+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e076570b0 2023-10-05T19:50:36.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde80004520 con 0x558e076570b0 2023-10-05T19:50:36.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e07652130 2023-10-05T19:50:36.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e076570b0 2023-10-05T19:50:36.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.013+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e076570b0 2023-10-05T19:50:36.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x7fde90007030 2023-10-05T19:50:36.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x7fde90007030 2023-10-05T19:50:36.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e0761d230 2023-10-05T19:50:36.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x7fde90007030 2023-10-05T19:50:36.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x7fde90007030 2023-10-05T19:50:36.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e076570b0 2023-10-05T19:50:36.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x7fde90007030 2023-10-05T19:50:36.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x7fde90007030 2023-10-05T19:50:36.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.017+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e07652130 2023-10-05T19:50:36.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e07652130 2023-10-05T19:50:36.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e076570b0 2023-10-05T19:50:36.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e07652130 2023-10-05T19:50:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076599d0 con 0x558e07652130 2023-10-05T19:50:36.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde9a8a7e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde9a8a7e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde9a8a7e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde9a8a7e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07655e60 con 0x558e0761d230 2023-10-05T19:50:36.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.021+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076567b0 con 0x558e07652130 2023-10-05T19:50:36.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07659d80 con 0x558e07652130 2023-10-05T19:50:36.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a130 con 0x558e076570b0 2023-10-05T19:50:36.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07656350 con 0x558e07652130 2023-10-05T19:50:36.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.025+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765bde0 con 0x558e076570b0 2023-10-05T19:50:36.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765bde0 con 0x558e07652130 2023-10-05T19:50:36.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765bde0 con 0x7fde90007030 2023-10-05T19:50:36.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x7fde90007030 2023-10-05T19:50:36.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e076570b0 2023-10-05T19:50:36.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.029+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e07652130 2023-10-05T19:50:36.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e07652130 2023-10-05T19:50:36.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x7fde90007030 2023-10-05T19:50:36.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x7fde90007030 2023-10-05T19:50:36.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.033+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x7fde90007030 2023-10-05T19:50:36.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x7fde90007030 2023-10-05T19:50:36.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e07652130 2023-10-05T19:50:36.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e076570b0 2023-10-05T19:50:36.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e07652130 2023-10-05T19:50:36.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e076570b0 2023-10-05T19:50:36.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.037+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88014040 con 0x558e0761d230 2023-10-05T19:50:36.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e076570b0 2023-10-05T19:50:36.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x7fde90007030 2023-10-05T19:50:36.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e0761d230 2023-10-05T19:50:36.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x7fde90007030 2023-10-05T19:50:36.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.041+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e076570b0 2023-10-05T19:50:36.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x7fde90007030 2023-10-05T19:50:36.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e07652130 2023-10-05T19:50:36.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e07652130 2023-10-05T19:50:36.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e076570b0 2023-10-05T19:50:36.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e07652130 2023-10-05T19:50:36.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.045+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765a4e0 con 0x558e07652130 2023-10-05T19:50:36.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765add0 con 0x558e07652130 2023-10-05T19:50:36.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765add0 con 0x558e0761d230 2023-10-05T19:50:36.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765b670 con 0x558e07652130 2023-10-05T19:50:36.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.049+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765b670 con 0x558e07652130 2023-10-05T19:50:36.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765b770 con 0x7fde90007030 2023-10-05T19:50:36.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 zone default found 2023-10-05T19:50:36.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 4 Realm: () 2023-10-05T19:50:36.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:36.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:36.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:36.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 zonegroup default 2023-10-05T19:50:36.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765b770 con 0x7fde90007030 2023-10-05T19:50:36.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765d0f0 con 0x558e076570b0 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765d4a0 con 0x558e076570b0 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 started sync module instance, tier type = 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:36.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.053+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765c7b0 con 0x558e07652130 2023-10-05T19:50:36.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.057+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.057+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94068497826496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765ccd0 con 0x558e07652130 2023-10-05T19:50:36.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.057+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765c710 con 0x558e0761d230 2023-10-05T19:50:36.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.057+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.057+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94068497833280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765ccd0 con 0x558e0761d230 2023-10-05T19:50:36.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.057+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94068497826496] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.057+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765e7f0 con 0x558e07652130 2023-10-05T19:50:36.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.061+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94068497833280] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.061+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.061+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94068497832016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765e7f0 con 0x558e07652130 2023-10-05T19:50:36.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.061+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765f090 con 0x7fde90007030 2023-10-05T19:50:36.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.061+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.061+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94068497836304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765f250 con 0x7fde90007030 2023-10-05T19:50:36.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.061+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765fd40 con 0x558e07652130 2023-10-05T19:50:36.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.061+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94068497832016] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.065+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.065+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94068497834384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765fd40 con 0x558e07652130 2023-10-05T19:50:36.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.065+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94068497836304] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.065+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07660630 con 0x558e076570b0 2023-10-05T19:50:36.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.065+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.065+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94068497834384] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.065+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94068497842496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e0765fd40 con 0x558e076570b0 2023-10-05T19:50:36.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.065+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076613c0 con 0x558e076570b0 2023-10-05T19:50:36.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94068497842496] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94068497844704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07661770 con 0x558e076570b0 2023-10-05T19:50:36.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07662180 con 0x7fde90007030 2023-10-05T19:50:36.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94068497844704] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94068497849488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076625d0 con 0x7fde90007030 2023-10-05T19:50:36.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 20 add_watcher() i=0 2023-10-05T19:50:36.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 20 add_watcher() i=1 2023-10-05T19:50:36.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 20 add_watcher() i=2 2023-10-05T19:50:36.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 20 add_watcher() i=3 2023-10-05T19:50:36.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 20 add_watcher() i=4 2023-10-05T19:50:36.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 20 add_watcher() i=5 2023-10-05T19:50:36.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.069+0000 7fde9a8a7e40 20 add_watcher() i=6 2023-10-05T19:50:36.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94068497849488] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 20 add_watcher() i=7 2023-10-05T19:50:36.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:36.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07665640 con 0x558e0761d230 2023-10-05T19:50:36.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94068497850592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07662c30 con 0x558e0761d230 2023-10-05T19:50:36.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94068497850592] v30'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde68ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:36.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:36.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 1 Processor -- start 2023-10-05T19:50:36.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 1 -- start start 2023-10-05T19:50:36.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e07670290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde9a8a7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e076707d0 con 0x558e0766fec0 2023-10-05T19:50:36.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde97bdb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e07670290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde97bdb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e07670290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47676/0 (socket says 172.21.15.167:47676) 2023-10-05T19:50:36.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.073+0000 7fde97bdb700 1 -- 172.21.15.167:0/3899558215 learned_addr learned my addr 172.21.15.167:0/3899558215 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde97bdb700 1 -- 172.21.15.167:0/3899558215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e07670910 con 0x558e0766fec0 2023-10-05T19:50:36.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde97bdb700 1 --2- 172.21.15.167:0/3899558215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e07670290 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde80001330 tx=0x7fde80006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176720d1899b0ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fdde3fff700 1 -- 172.21.15.167:0/3899558215 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde8001a040 con 0x558e0766fec0 2023-10-05T19:50:36.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fdde3fff700 1 -- 172.21.15.167:0/3899558215 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8001b040 con 0x558e0766fec0 2023-10-05T19:50:36.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fdde3fff700 1 -- 172.21.15.167:0/3899558215 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde80004910 con 0x558e0766fec0 2023-10-05T19:50:36.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/3899558215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 msgr2=0x558e07670290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/3899558215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e07670290 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde80001330 tx=0x7fde80006000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/3899558215 shutdown_connections 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/3899558215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e07670290 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/3899558215 >> 172.21.15.167:0/3899558215 conn(0x558e0766b280 msgr2=0x558e076693d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/3899558215 shutdown_connections 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/3899558215 wait complete. 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 Processor -- start 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 -- start start 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e076759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde9a8a7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e076769e0 con 0x558e0766fec0 2023-10-05T19:50:36.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde97bdb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e076759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde97bdb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e076759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47688/0 (socket says 172.21.15.167:47688) 2023-10-05T19:50:36.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde97bdb700 1 -- 172.21.15.167:0/802468478 learned_addr learned my addr 172.21.15.167:0/802468478 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde97bdb700 1 -- 172.21.15.167:0/802468478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78001e10 con 0x558e0766fec0 2023-10-05T19:50:36.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.077+0000 7fde97bdb700 1 --2- 172.21.15.167:0/802468478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e076759e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fde80001330 tx=0x7fde80030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fdde27fc700 1 -- 172.21.15.167:0/802468478 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde8001a070 con 0x558e0766fec0 2023-10-05T19:50:36.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/802468478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e07675fe0 con 0x558e0766fec0 2023-10-05T19:50:36.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fdde27fc700 1 -- 172.21.15.167:0/802468478 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80004330 con 0x558e0766fec0 2023-10-05T19:50:36.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fdde27fc700 1 -- 172.21.15.167:0/802468478 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde8002c750 con 0x558e0766fec0 2023-10-05T19:50:36.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/802468478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e07676420 con 0x558e0766fec0 2023-10-05T19:50:36.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fdde27fc700 1 -- 172.21.15.167:0/802468478 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fde8002c980 con 0x558e0766fec0 2023-10-05T19:50:36.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fdde27fc700 1 --2- 172.21.15.167:0/802468478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fddd8030bb0 0x7fddd8033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fdde27fc700 1 -- 172.21.15.167:0/802468478 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fde80027040 con 0x558e0766fec0 2023-10-05T19:50:36.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fde9a8a7e40 5 note: GC not initialized 2023-10-05T19:50:36.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fde98bdd700 1 --2- 172.21.15.167:0/802468478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fddd8030bb0 0x7fddd8033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.081+0000 7fde98bdd700 1 --2- 172.21.15.167:0/802468478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fddd8030bb0 0x7fddd8033060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x558e07662b90 tx=0x7fde8800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fddd77fe700 20 reqs_thread_entry: start 2023-10-05T19:50:36.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fddd57fa700 20 reqs_thread_entry: start 2023-10-05T19:50:36.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:36.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:36.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fddc37fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:06 2023 2023-10-05T19:50:36.092 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:36.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fddc2ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:36.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 20 get_system_obj_state: rctx=0x7ffca0c403d8 obj=default.rgw.meta:users.uid:foo state=0x558e074f60b0 s->prefetch_data=0 2023-10-05T19:50:36.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:36.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076de2d0 con 0x558e0761d230 2023-10-05T19:50:36.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:36.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076e0d60 con 0x558e0761d230 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~539 out=539b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 273+0+662 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 20 rados_obj.operate() r=0 bl.length=539 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:36.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:36.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.085+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076e2050 con 0x558e0761d230 2023-10-05T19:50:36.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~513] v30'10 uv10 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde9a8a7e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:36.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde9a8a7e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:36.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde9a8a7e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:36.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94068498373360 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e076e0d60 con 0x558e07652130 2023-10-05T19:50:36.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94068497834384 notify 128849018894 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x558e07645030 con 0x558e07652130 2023-10-05T19:50:36.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde95bd7700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94068497834384 notifier 4385 bl.length()=689 2023-10-05T19:50:36.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde95bd7700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:36.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde95bd7700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:36.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.4 [notify cookie 94068498373360 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde95bd7700 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fde70003d90 con 0x558e07652130 2023-10-05T19:50:36.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94068498373360 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558e07644bf0 con 0x558e07652130 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [ 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "foo:foo2", 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: "permissions": "" 2023-10-05T19:50:36.098 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [ 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo:foo2", 2023-10-05T19:50:36.099 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy" 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:36.100 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:36.102 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:36.102 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:36.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.089+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94068497826496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07632060 con 0x558e07652130 2023-10-05T19:50:36.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.093+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94068497826496] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.093+0000 7fde9a8a7e40 20 remove_watcher() i=0 2023-10-05T19:50:36.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.093+0000 7fde9a8a7e40 2 removed watcher, disabling cache 2023-10-05T19:50:36.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.093+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94068497833280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07632060 con 0x558e0761d230 2023-10-05T19:50:36.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.093+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94068497833280] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.093+0000 7fde9a8a7e40 20 remove_watcher() i=1 2023-10-05T19:50:36.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.093+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94068497832016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07632060 con 0x558e07652130 2023-10-05T19:50:36.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.097+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94068497832016] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.097+0000 7fde9a8a7e40 20 remove_watcher() i=2 2023-10-05T19:50:36.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.097+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94068497836304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07632060 con 0x7fde90007030 2023-10-05T19:50:36.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.097+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94068497836304] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.097+0000 7fde9a8a7e40 20 remove_watcher() i=3 2023-10-05T19:50:36.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.097+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94068497834384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07632060 con 0x558e07652130 2023-10-05T19:50:36.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.101+0000 7fde983dc700 1 -- 172.21.15.167:0/430026013 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94068497834384] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde90041040 con 0x558e07652130 2023-10-05T19:50:36.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.101+0000 7fde9a8a7e40 20 remove_watcher() i=4 2023-10-05T19:50:36.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.101+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94068497842496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07632060 con 0x558e076570b0 2023-10-05T19:50:36.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.101+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94068497842496] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.101+0000 7fde9a8a7e40 20 remove_watcher() i=5 2023-10-05T19:50:36.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.101+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94068497844704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07632060 con 0x558e076570b0 2023-10-05T19:50:36.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.105+0000 7fde97bdb700 1 -- 172.21.15.167:0/430026013 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94068497844704] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde8001d040 con 0x558e076570b0 2023-10-05T19:50:36.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.105+0000 7fde9a8a7e40 20 remove_watcher() i=6 2023-10-05T19:50:36.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.105+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94068497849488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07632060 con 0x7fde90007030 2023-10-05T19:50:36.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.105+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94068497849488] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde88033040 con 0x7fde90007030 2023-10-05T19:50:36.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.105+0000 7fde9a8a7e40 20 remove_watcher() i=7 2023-10-05T19:50:36.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde68ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94068497850592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558e07632060 con 0x558e0761d230 2023-10-05T19:50:36.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94068497850592] v30'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fde88033040 con 0x558e0761d230 2023-10-05T19:50:36.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558e07652130 msgr2=0x558e07654510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558e07652130 0x558e07654510 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558e0761d230 msgr2=0x558e07650170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558e0761d230 0x558e07650170 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fde90007030 msgr2=0x7fde9001e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fde90007030 0x7fde9001e780 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558e076570b0 msgr2=0x558e07659490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558e076570b0 0x558e07659490 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fde7c030ca0 msgr2=0x7fde7c033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fde7c030ca0 0x7fde7c033150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fde800044f0 tx=0x7fde80006690 comp rx=0 tx=0).stop 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde98bdd700 1 -- 172.21.15.167:0/430026013 reap_dead start 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 msgr2=0x558e076446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e076446b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde9001f040 tx=0x7fde9001c000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 shutdown_connections 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/430026013 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0761c920 0x558e076446b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 >> 172.21.15.167:0/430026013 conn(0x558e07618340 msgr2=0x558e07635e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 shutdown_connections 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.109+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/430026013 wait complete. 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/802468478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fddd8030bb0 msgr2=0x7fddd8033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/802468478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fddd8030bb0 0x7fddd8033060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x558e07662b90 tx=0x7fde8800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/802468478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 msgr2=0x558e076759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/802468478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e076759e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fde80001330 tx=0x7fde80030000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/802468478 shutdown_connections 2023-10-05T19:50:36.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/802468478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fddd8030bb0 0x7fddd8033060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 --2- 172.21.15.167:0/802468478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558e0766fec0 0x558e076759e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/802468478 >> 172.21.15.167:0/802468478 conn(0x558e0766b280 msgr2=0x558e07669320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/802468478 shutdown_connections 2023-10-05T19:50:36.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.113+0000 7fde9a8a7e40 1 -- 172.21.15.167:0/802468478 wait complete. 2023-10-05T19:50:36.124 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:36.124 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2023-10-05T19:50:36.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2023-10-05T19:50:36.124 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2023-10-05T19:50:36.167 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:36.167 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:36.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb6952e40 1 Processor -- start 2023-10-05T19:50:36.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb6952e40 1 -- start start 2023-10-05T19:50:36.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb6952e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ca9c58dea0 0x55ca9c590280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb6952e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ca9c4d6bd0 con 0x55ca9c5898c0 2023-10-05T19:50:36.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb6952e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ca9c493ee0 con 0x55ca9c58dea0 2023-10-05T19:50:36.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb3c86700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ca9c58dea0 0x55ca9c590280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb4487700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55ca9c5898c0 0x55ca9c589c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:40032/0 (socket says 172.21.15.167:40032) 2023-10-05T19:50:36.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb3c86700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ca9c58dea0 0x55ca9c590280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47694/0 (socket says 172.21.15.167:47694) 2023-10-05T19:50:36.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb4487700 1 -- 172.21.15.167:0/1025795661 learned_addr learned my addr 172.21.15.167:0/1025795661 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:36.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb3c86700 1 -- 172.21.15.167:0/1025795661 >> v1:172.21.15.118:6789/0 conn(0x55ca9c5898c0 legacy=0x55ca9c589c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb3c86700 1 -- 172.21.15.167:0/1025795661 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9c58a4d0 con 0x55ca9c58dea0 2023-10-05T19:50:36.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb3c86700 1 --2- 172.21.15.167:0/1025795661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 0x55ca9c590280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00a5d0 tx=0x7fec9c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368753f083131040 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb3485700 1 -- 172.21.15.167:0/1025795661 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec9c0086a0 con 0x55ca9c58dea0 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb3485700 1 -- 172.21.15.167:0/1025795661 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c008800 con 0x55ca9c58dea0 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.161+0000 7fecb3485700 1 -- 172.21.15.167:0/1025795661 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec9c008ad0 con 0x55ca9c58dea0 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 -- 172.21.15.167:0/1025795661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 msgr2=0x55ca9c590280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 --2- 172.21.15.167:0/1025795661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 0x55ca9c590280 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00a5d0 tx=0x7fec9c005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 -- 172.21.15.167:0/1025795661 shutdown_connections 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 --2- 172.21.15.167:0/1025795661 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 0x55ca9c590280 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 -- 172.21.15.167:0/1025795661 >> 172.21.15.167:0/1025795661 conn(0x55ca9c5852e0 msgr2=0x55ca9c5876f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 -- 172.21.15.167:0/1025795661 shutdown_connections 2023-10-05T19:50:36.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 -- 172.21.15.167:0/1025795661 wait complete. 2023-10-05T19:50:36.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 Processor -- start 2023-10-05T19:50:36.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 -- start start 2023-10-05T19:50:36.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5898c0 0x55ca9c5a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9c457e30 con 0x55ca9c5898c0 2023-10-05T19:50:36.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb4487700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5898c0 0x55ca9c5a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb4487700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5898c0 0x55ca9c5a8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47708/0 (socket says 172.21.15.167:47708) 2023-10-05T19:50:36.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb4487700 1 -- 172.21.15.167:0/1710521995 learned_addr learned my addr 172.21.15.167:0/1710521995 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb4487700 1 -- 172.21.15.167:0/1710521995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c005cf0 con 0x55ca9c5898c0 2023-10-05T19:50:36.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb4487700 1 --2- 172.21.15.167:0/1710521995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5898c0 0x55ca9c5a8a40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feca40014a0 tx=0x7feca4006b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8114f1d807d1c063 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb2483700 1 -- 172.21.15.167:0/1710521995 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feca4006110 con 0x55ca9c5898c0 2023-10-05T19:50:36.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb2483700 1 -- 172.21.15.167:0/1710521995 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4006270 con 0x55ca9c5898c0 2023-10-05T19:50:36.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb2483700 1 -- 172.21.15.167:0/1710521995 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feca4004520 con 0x55ca9c5898c0 2023-10-05T19:50:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 -- 172.21.15.167:0/1710521995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5898c0 msgr2=0x55ca9c5a8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.165+0000 7fecb6952e40 1 --2- 172.21.15.167:0/1710521995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5898c0 0x55ca9c5a8a40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feca40014a0 tx=0x7feca4006b90 comp rx=0 tx=0).stop 2023-10-05T19:50:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 -- 172.21.15.167:0/1710521995 shutdown_connections 2023-10-05T19:50:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 --2- 172.21.15.167:0/1710521995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5898c0 0x55ca9c5a8a40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 -- 172.21.15.167:0/1710521995 >> 172.21.15.167:0/1710521995 conn(0x55ca9c5852e0 msgr2=0x55ca9c5a4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 -- 172.21.15.167:0/1710521995 shutdown_connections 2023-10-05T19:50:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 -- 172.21.15.167:0/1710521995 wait complete. 2023-10-05T19:50:36.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 Processor -- start 2023-10-05T19:50:36.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 -- start start 2023-10-05T19:50:36.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 0x55ca9c4ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9c42aed0 con 0x55ca9c58dea0 2023-10-05T19:50:36.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb4487700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 0x55ca9c4ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb4487700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 0x55ca9c4ff3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47716/0 (socket says 172.21.15.167:47716) 2023-10-05T19:50:36.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 learned_addr learned my addr 172.21.15.167:0/2899448702 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9c4d6bd0 con 0x55ca9c58dea0 2023-10-05T19:50:36.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb4487700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 0x55ca9c4ff3e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feca4006bd0 tx=0x7feca4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb0c80700 1 -- 172.21.15.167:0/2899448702 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feca4006110 con 0x55ca9c58dea0 2023-10-05T19:50:36.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb0c80700 1 -- 172.21.15.167:0/2899448702 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca40063e0 con 0x55ca9c58dea0 2023-10-05T19:50:36.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca9c4ff920 con 0x55ca9c58dea0 2023-10-05T19:50:36.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb0c80700 1 -- 172.21.15.167:0/2899448702 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feca4013d00 con 0x55ca9c58dea0 2023-10-05T19:50:36.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.169+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca9c4fdce0 con 0x55ca9c58dea0 2023-10-05T19:50:36.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb0c80700 1 -- 172.21.15.167:0/2899448702 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7feca4004030 con 0x55ca9c58dea0 2023-10-05T19:50:36.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb0c80700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fec94030c50 0x7fec94033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb0c80700 1 -- 172.21.15.167:0/2899448702 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7feca4044350 con 0x55ca9c58dea0 2023-10-05T19:50:36.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb3c86700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fec94030c50 0x7fec94033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca9c5bb700 0x55ca9c5bdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5be0f0 con 0x55ca9c5bb700 2023-10-05T19:50:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb4c88700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca9c5bb700 0x55ca9c5bdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb3c86700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fec94030c50 0x7fec94033100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fec9c005a90 tx=0x7fec9c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb4c88700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca9c5bb700 0x55ca9c5bdae0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecac00a500 con 0x55ca9c5bb700 2023-10-05T19:50:36.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 20 realm 2023-10-05T19:50:36.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5bad70 con 0x55ca9c5bb700 2023-10-05T19:50:36.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecac00a500 con 0x55ca9c5bb700 2023-10-05T19:50:36.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.173+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5bebd0 con 0x55ca9c5bb700 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecac00a500 con 0x55ca9c5bb700 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca9c5bfa00 0x55ca9c5c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c2320 con 0x55ca9c5bfa00 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb4487700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca9c5bfa00 0x55ca9c5c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb4487700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca9c5bfa00 0x55ca9c5c1de0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feca40042e0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c2bc0 con 0x55ca9c5bb700 2023-10-05T19:50:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fecac00a500 con 0x55ca9c5bb700 2023-10-05T19:50:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 20 searching for the correct realm 2023-10-05T19:50:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca9c5c4980 0x55ca9c5c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5c4980 2023-10-05T19:50:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb3c86700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca9c5c4980 0x55ca9c5c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.177+0000 7fecb3c86700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca9c5c4980 0x55ca9c5c6d60 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca40042e0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4487700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55ca9c5898c0 0x7feca40123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5898c0 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55ca9c5898c0 0x7feca40123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55ca9c5898c0 0x7feca40123c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5898c0 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5c4980 2023-10-05T19:50:36.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.181+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca40042e0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca40042e0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5898c0 2023-10-05T19:50:36.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5898c0 2023-10-05T19:50:36.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5898c0 2023-10-05T19:50:36.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5898c0 2023-10-05T19:50:36.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca40042e0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.185+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5c4980 2023-10-05T19:50:36.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca40042e0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5c4980 2023-10-05T19:50:36.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5c4980 2023-10-05T19:50:36.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.189+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5898c0 2023-10-05T19:50:36.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5898c0 2023-10-05T19:50:36.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bb700 2023-10-05T19:50:36.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5898c0 2023-10-05T19:50:36.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5898c0 2023-10-05T19:50:36.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5c4980 2023-10-05T19:50:36.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5898c0 2023-10-05T19:50:36.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5898c0 2023-10-05T19:50:36.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca40042e0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca40042e0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.193+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5c4980 2023-10-05T19:50:36.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7feca40042e0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c72a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c3700 con 0x55ca9c5bb700 2023-10-05T19:50:36.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c3ff0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.197+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7650 con 0x55ca9c5bfa00 2023-10-05T19:50:36.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7a00 con 0x55ca9c5c4980 2023-10-05T19:50:36.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c3bf0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c96b0 con 0x55ca9c5c4980 2023-10-05T19:50:36.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c96b0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.201+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c96b0 con 0x55ca9c5898c0 2023-10-05T19:50:36.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5898c0 2023-10-05T19:50:36.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5c4980 2023-10-05T19:50:36.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.205+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5898c0 2023-10-05T19:50:36.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5898c0 2023-10-05T19:50:36.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5898c0 2023-10-05T19:50:36.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5898c0 2023-10-05T19:50:36.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5c4980 2023-10-05T19:50:36.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.209+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5c4980 2023-10-05T19:50:36.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac014040 con 0x55ca9c5bb700 2023-10-05T19:50:36.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.213+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5c4980 2023-10-05T19:50:36.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5898c0 2023-10-05T19:50:36.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bb700 2023-10-05T19:50:36.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5898c0 2023-10-05T19:50:36.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5c4980 2023-10-05T19:50:36.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5898c0 2023-10-05T19:50:36.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.217+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5c4980 2023-10-05T19:50:36.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c7db0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb6952e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb6952e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb6952e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb6952e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c86a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.221+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c8a50 con 0x55ca9c5bb700 2023-10-05T19:50:36.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c92f0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c92f0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c92f0 con 0x55ca9c5898c0 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 zone default found 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 4 Realm: () 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 zonegroup default 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5c92f0 con 0x55ca9c5898c0 2023-10-05T19:50:36.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.225+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5cac70 con 0x55ca9c5c4980 2023-10-05T19:50:36.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5cb020 con 0x55ca9c5c4980 2023-10-05T19:50:36.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb6952e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb6952e40 20 started sync module instance, tier type = 2023-10-05T19:50:36.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb6952e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:36.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5ca380 con 0x55ca9c5bfa00 2023-10-05T19:50:36.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94328695070352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5ca8a0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.229+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5ca370 con 0x55ca9c5bb700 2023-10-05T19:50:36.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.233+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.233+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94328695077056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5cc2f0 con 0x55ca9c5bb700 2023-10-05T19:50:36.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.233+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5ccd00 con 0x55ca9c5bfa00 2023-10-05T19:50:36.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.233+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94328695070352] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.233+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.233+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94328695077056] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.233+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94328695075792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5cc810 con 0x55ca9c5bfa00 2023-10-05T19:50:36.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.233+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5cd0b0 con 0x55ca9c5898c0 2023-10-05T19:50:36.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.237+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94328695075792] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.237+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.237+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94328695078224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5ccd00 con 0x55ca9c5898c0 2023-10-05T19:50:36.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.237+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5cd750 con 0x55ca9c5bfa00 2023-10-05T19:50:36.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.237+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94328695078224] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.237+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.241+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94328695083552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5ccd00 con 0x55ca9c5bfa00 2023-10-05T19:50:36.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.241+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5ccd00 con 0x55ca9c5c4980 2023-10-05T19:50:36.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.241+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.241+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94328695086832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5ce8b0 con 0x55ca9c5c4980 2023-10-05T19:50:36.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.241+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94328695083552] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.241+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5cf1d0 con 0x55ca9c5c4980 2023-10-05T19:50:36.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.241+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94328695086832] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94328695090400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5cf580 con 0x55ca9c5c4980 2023-10-05T19:50:36.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5d0020 con 0x55ca9c5898c0 2023-10-05T19:50:36.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94328695090400] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec9c008a80 con 0x55ca9c5c4980 2023-10-05T19:50:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94328695094064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5cff80 con 0x55ca9c5898c0 2023-10-05T19:50:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 20 add_watcher() i=0 2023-10-05T19:50:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 20 add_watcher() i=1 2023-10-05T19:50:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 20 add_watcher() i=2 2023-10-05T19:50:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 20 add_watcher() i=3 2023-10-05T19:50:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 20 add_watcher() i=4 2023-10-05T19:50:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 20 add_watcher() i=5 2023-10-05T19:50:36.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 20 add_watcher() i=6 2023-10-05T19:50:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94328695094064] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 20 add_watcher() i=7 2023-10-05T19:50:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.245+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5d3940 con 0x55ca9c5bb700 2023-10-05T19:50:36.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94328695096272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c5d0d10 con 0x55ca9c5bb700 2023-10-05T19:50:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94328695096272] v30'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fec85fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb6952e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:36.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb6952e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:36.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb6952e40 1 Processor -- start 2023-10-05T19:50:36.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb6952e40 1 -- start start 2023-10-05T19:50:36.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb6952e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5de230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb6952e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9c5de770 con 0x55ca9c5dde60 2023-10-05T19:50:36.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb3c86700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5de230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb3c86700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5de230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47720/0 (socket says 172.21.15.167:47720) 2023-10-05T19:50:36.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb3c86700 1 -- 172.21.15.167:0/2853149027 learned_addr learned my addr 172.21.15.167:0/2853149027 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.249+0000 7fecb3c86700 1 -- 172.21.15.167:0/2853149027 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9c5de8b0 con 0x55ca9c5dde60 2023-10-05T19:50:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb3c86700 1 --2- 172.21.15.167:0/2853149027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5de230 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55ca9c58a940 tx=0x7fec9c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cec19430d2f75d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fec857e2700 1 -- 172.21.15.167:0/2853149027 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec9c02d040 con 0x55ca9c5dde60 2023-10-05T19:50:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fec857e2700 1 -- 172.21.15.167:0/2853149027 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c028890 con 0x55ca9c5dde60 2023-10-05T19:50:36.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fec857e2700 1 -- 172.21.15.167:0/2853149027 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec9c012900 con 0x55ca9c5dde60 2023-10-05T19:50:36.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 -- 172.21.15.167:0/2853149027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 msgr2=0x55ca9c5de230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2853149027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5de230 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55ca9c58a940 tx=0x7fec9c012000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 -- 172.21.15.167:0/2853149027 shutdown_connections 2023-10-05T19:50:36.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2853149027 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5de230 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 -- 172.21.15.167:0/2853149027 >> 172.21.15.167:0/2853149027 conn(0x55ca9c5d9220 msgr2=0x55ca9c5d7370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 -- 172.21.15.167:0/2853149027 shutdown_connections 2023-10-05T19:50:36.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 -- 172.21.15.167:0/2853149027 wait complete. 2023-10-05T19:50:36.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 Processor -- start 2023-10-05T19:50:36.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 -- start start 2023-10-05T19:50:36.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5e3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb6952e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9c5e4870 con 0x55ca9c5dde60 2023-10-05T19:50:36.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb3c86700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb3c86700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5e3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47724/0 (socket says 172.21.15.167:47724) 2023-10-05T19:50:36.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb3c86700 1 -- 172.21.15.167:0/2803690046 learned_addr learned my addr 172.21.15.167:0/2803690046 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.253+0000 7fecb3c86700 1 -- 172.21.15.167:0/2803690046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9c58a4d0 con 0x55ca9c5dde60 2023-10-05T19:50:36.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7fecb3c86700 1 --2- 172.21.15.167:0/2803690046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5e3870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ca9c5d7ee0 tx=0x7fec9c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7febff7fe700 1 -- 172.21.15.167:0/2803690046 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec9c0337c0 con 0x55ca9c5dde60 2023-10-05T19:50:36.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7febff7fe700 1 -- 172.21.15.167:0/2803690046 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c03f070 con 0x55ca9c5dde60 2023-10-05T19:50:36.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7fecb6952e40 1 -- 172.21.15.167:0/2803690046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca9c5e3e70 con 0x55ca9c5dde60 2023-10-05T19:50:36.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7febff7fe700 1 -- 172.21.15.167:0/2803690046 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec9c033960 con 0x55ca9c5dde60 2023-10-05T19:50:36.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7fecb6952e40 1 -- 172.21.15.167:0/2803690046 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca9c5e4250 con 0x55ca9c5dde60 2023-10-05T19:50:36.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7febff7fe700 1 -- 172.21.15.167:0/2803690046 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fec9c033ac0 con 0x55ca9c5dde60 2023-10-05T19:50:36.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7febff7fe700 1 --2- 172.21.15.167:0/2803690046 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7febf4030ca0 0x7febf4033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7febff7fe700 1 -- 172.21.15.167:0/2803690046 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fec9c041070 con 0x55ca9c5dde60 2023-10-05T19:50:36.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7fecb4c88700 1 --2- 172.21.15.167:0/2803690046 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7febf4030ca0 0x7febf4033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7fecb6952e40 5 note: GC not initialized 2023-10-05T19:50:36.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.257+0000 7fecb4c88700 1 --2- 172.21.15.167:0/2803690046 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7febf4030ca0 0x7febf4033150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55ca9c5d01c0 tx=0x7fecac00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7febfcff9700 20 reqs_thread_entry: start 2023-10-05T19:50:36.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7febf27fc700 20 reqs_thread_entry: start 2023-10-05T19:50:36.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:36.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:36.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7febf0ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:06 2023 2023-10-05T19:50:36.268 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:36.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7febd7fff700 20 reqs_thread_entry: start 2023-10-05T19:50:36.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 20 get_system_obj_state: rctx=0x7ffeb52fb438 obj=default.rgw.meta:users.uid:foo state=0x55ca9c4630b0 s->prefetch_data=0 2023-10-05T19:50:36.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:36.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64c100 con 0x55ca9c5bb700 2023-10-05T19:50:36.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:36.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:36.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:36.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:36.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:36.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:36.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64eb90 con 0x55ca9c5bb700 2023-10-05T19:50:36.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 273+0+636 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 20 rados_obj.operate() r=0 bl.length=513 2023-10-05T19:50:36.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:36.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:36.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:36.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.261+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5bb700 2023-10-05T19:50:36.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~357] v30'11 uv11 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb6952e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:36.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb6952e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:36.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb6952e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:36.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94328695598240 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5bfa00 2023-10-05T19:50:36.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94328695083552 notify 128849018895 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55ca9c4fdce0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.4 [notify cookie 94328695598240 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb2483700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94328695083552 notifier 4391 bl.length()=533 2023-10-05T19:50:36.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb2483700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:36.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb2483700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:36.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb2483700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fec98003d90 con 0x55ca9c5bfa00 2023-10-05T19:50:36.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94328695598240 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ca9c4ff920 con 0x55ca9c5bfa00 2023-10-05T19:50:36.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb6952e40 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2023-10-05T19:50:36.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94328695598240 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b0f0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== watch-notify(notify (1) cookie 94328695070352 notify 128849018896 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x55ca9c4ff920 con 0x55ca9c5bfa00 2023-10-05T19:50:36.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb2483700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94328695070352 notifier 4391 bl.length()=159 2023-10-05T19:50:36.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(107 notify.0 [notify cookie 94328695598240 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.265+0000 7fecb2483700 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fec98003d90 con 0x55ca9c5bfa00 2023-10-05T19:50:36.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.269+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== watch-notify(notify_complete (2) cookie 94328695598240 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ca9c4d6bd0 con 0x55ca9c5bfa00 2023-10-05T19:50:36.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.269+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(108 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.269+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5898c0 2023-10-05T19:50:36.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.269+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(109 foo:foo2 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.276 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:36.278 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:36.279 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:36.280 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:36.280 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:36.280 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:36.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.269+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94328695070352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5bfa00 2023-10-05T19:50:36.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.273+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94328695070352] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.273+0000 7fecb6952e40 20 remove_watcher() i=0 2023-10-05T19:50:36.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.273+0000 7fecb6952e40 2 removed watcher, disabling cache 2023-10-05T19:50:36.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.273+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94328695077056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5bb700 2023-10-05T19:50:36.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.273+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94328695077056] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.273+0000 7fecb6952e40 20 remove_watcher() i=1 2023-10-05T19:50:36.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.273+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94328695075792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5bfa00 2023-10-05T19:50:36.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.277+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94328695075792] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.277+0000 7fecb6952e40 20 remove_watcher() i=2 2023-10-05T19:50:36.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.277+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94328695078224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5898c0 2023-10-05T19:50:36.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.277+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94328695078224] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.277+0000 7fecb6952e40 20 remove_watcher() i=3 2023-10-05T19:50:36.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.277+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94328695083552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5bfa00 2023-10-05T19:50:36.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.281+0000 7fecb4487700 1 -- 172.21.15.167:0/2899448702 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94328695083552] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feca403c040 con 0x55ca9c5bfa00 2023-10-05T19:50:36.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.281+0000 7fecb6952e40 20 remove_watcher() i=4 2023-10-05T19:50:36.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.281+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94328695086832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5c4980 2023-10-05T19:50:36.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.281+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94328695086832] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec9c039020 con 0x55ca9c5c4980 2023-10-05T19:50:36.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.281+0000 7fecb6952e40 20 remove_watcher() i=5 2023-10-05T19:50:36.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.281+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94328695090400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5c4980 2023-10-05T19:50:36.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.285+0000 7fecb3c86700 1 -- 172.21.15.167:0/2899448702 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94328695090400] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fec9c039020 con 0x55ca9c5c4980 2023-10-05T19:50:36.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.285+0000 7fecb6952e40 20 remove_watcher() i=6 2023-10-05T19:50:36.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.285+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94328695094064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c64b190 con 0x55ca9c5898c0 2023-10-05T19:50:36.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.285+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94328695094064] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5898c0 2023-10-05T19:50:36.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.285+0000 7fecb6952e40 20 remove_watcher() i=7 2023-10-05T19:50:36.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fec85fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94328695096272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ca9c59f260 con 0x55ca9c5bb700 2023-10-05T19:50:36.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94328695096272] v30'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fecac033040 con 0x55ca9c5bb700 2023-10-05T19:50:36.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca9c5bfa00 msgr2=0x55ca9c5c1de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ca9c5bfa00 0x55ca9c5c1de0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca9c5bb700 msgr2=0x55ca9c5bdae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ca9c5bb700 0x55ca9c5bdae0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55ca9c5898c0 msgr2=0x7feca40123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55ca9c5898c0 0x7feca40123c0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca9c5c4980 msgr2=0x55ca9c5c6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ca9c5c4980 0x55ca9c5c6d60 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fec94030c50 msgr2=0x7fec94033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fec94030c50 0x7fec94033100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fec9c005a90 tx=0x7fec9c015000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb4c88700 1 -- 172.21.15.167:0/2899448702 reap_dead start 2023-10-05T19:50:36.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 msgr2=0x55ca9c4ff3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 0x55ca9c4ff3e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feca4006bd0 tx=0x7feca4014000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 shutdown_connections 2023-10-05T19:50:36.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2899448702 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c58dea0 0x55ca9c4ff3e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 >> 172.21.15.167:0/2899448702 conn(0x55ca9c5852e0 msgr2=0x55ca9c5a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 shutdown_connections 2023-10-05T19:50:36.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.289+0000 7fecb6952e40 1 -- 172.21.15.167:0/2899448702 wait complete. 2023-10-05T19:50:36.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 -- 172.21.15.167:0/2803690046 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7febf4030ca0 msgr2=0x7febf4033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2803690046 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7febf4030ca0 0x7febf4033150 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55ca9c5d01c0 tx=0x7fecac00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:36.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 -- 172.21.15.167:0/2803690046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 msgr2=0x55ca9c5e3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2803690046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5e3870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55ca9c5d7ee0 tx=0x7fec9c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 -- 172.21.15.167:0/2803690046 shutdown_connections 2023-10-05T19:50:36.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2803690046 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7febf4030ca0 0x7febf4033150 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 --2- 172.21.15.167:0/2803690046 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ca9c5dde60 0x55ca9c5e3870 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 -- 172.21.15.167:0/2803690046 >> 172.21.15.167:0/2803690046 conn(0x55ca9c5d9220 msgr2=0x55ca9c5d72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 -- 172.21.15.167:0/2803690046 shutdown_connections 2023-10-05T19:50:36.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.293+0000 7fecb6952e40 1 -- 172.21.15.167:0/2803690046 wait complete. 2023-10-05T19:50:36.304 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:36.305 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2023-10-05T19:50:36.305 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2023-10-05T19:50:36.305 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2023-10-05T19:50:36.344 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:36.344 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:36.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.337+0000 7f73f2ce5e40 1 Processor -- start 2023-10-05T19:50:36.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.337+0000 7f73f2ce5e40 1 -- start start 2023-10-05T19:50:36.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.337+0000 7f73f2ce5e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ec3f952570 0x55ec3f950b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.337+0000 7f73f2ce5e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ec3f929bd0 con 0x55ec3f951090 2023-10-05T19:50:36.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.337+0000 7f73f2ce5e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ec3f8e6ee0 con 0x55ec3f952570 2023-10-05T19:50:36.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.337+0000 7f73f0019700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55ec3f951090 0x55ec3f9e4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:40044/0 (socket says 172.21.15.167:40044) 2023-10-05T19:50:36.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.337+0000 7f73f081a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ec3f952570 0x55ec3f950b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.337+0000 7f73f0019700 1 -- 172.21.15.167:0/1990173666 learned_addr learned my addr 172.21.15.167:0/1990173666 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:36.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.337+0000 7f73ef818700 1 -- 172.21.15.167:0/1990173666 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997304174 0 0) 0x55ec3f929bd0 con 0x55ec3f951090 2023-10-05T19:50:36.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73ef818700 1 -- 172.21.15.167:0/1990173666 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73dc001e10 con 0x55ec3f951090 2023-10-05T19:50:36.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f081a700 1 -- 172.21.15.167:0/1990173666 >> v1:172.21.15.118:6789/0 conn(0x55ec3f951090 legacy=0x55ec3f9e4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f081a700 1 -- 172.21.15.167:0/1990173666 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec3f952a00 con 0x55ec3f952570 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f081a700 1 --2- 172.21.15.167:0/1990173666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f952570 0x55ec3f950b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f73e000a5d0 tx=0x7f73e0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76165d299424ebde server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73ef818700 1 -- 172.21.15.167:0/1990173666 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73e0007610 con 0x55ec3f952570 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73ef818700 1 -- 172.21.15.167:0/1990173666 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e0007770 con 0x55ec3f952570 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73ef818700 1 -- 172.21.15.167:0/1990173666 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73e0007a40 con 0x55ec3f952570 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/1990173666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f952570 msgr2=0x55ec3f950b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/1990173666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f952570 0x55ec3f950b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f73e000a5d0 tx=0x7f73e0005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/1990173666 shutdown_connections 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/1990173666 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f952570 0x55ec3f950b50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/1990173666 >> 172.21.15.167:0/1990173666 conn(0x55ec3f9d8340 msgr2=0x55ec3f9da750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/1990173666 shutdown_connections 2023-10-05T19:50:36.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/1990173666 wait complete. 2023-10-05T19:50:36.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 Processor -- start 2023-10-05T19:50:36.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 -- start start 2023-10-05T19:50:36.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3f9fda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f2ce5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3f8aae30 con 0x55ec3f951090 2023-10-05T19:50:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f081a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3f9fda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f081a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3f9fda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47746/0 (socket says 172.21.15.167:47746) 2023-10-05T19:50:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f081a700 1 -- 172.21.15.167:0/3362846060 learned_addr learned my addr 172.21.15.167:0/3362846060 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.341+0000 7f73f081a700 1 -- 172.21.15.167:0/3362846060 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0005cf0 con 0x55ec3f951090 2023-10-05T19:50:36.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.345+0000 7f73f081a700 1 --2- 172.21.15.167:0/3362846060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3f9fda10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f73e0000c00 tx=0x7f73e0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fd517587ec6876 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73ee816700 1 -- 172.21.15.167:0/3362846060 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73e0021070 con 0x55ec3f951090 2023-10-05T19:50:36.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73ee816700 1 -- 172.21.15.167:0/3362846060 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e00078e0 con 0x55ec3f951090 2023-10-05T19:50:36.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73ee816700 1 -- 172.21.15.167:0/3362846060 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73e0007bd0 con 0x55ec3f951090 2023-10-05T19:50:36.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3362846060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 msgr2=0x55ec3f9fda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/3362846060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3f9fda10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f73e0000c00 tx=0x7f73e0014000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3362846060 shutdown_connections 2023-10-05T19:50:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/3362846060 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3f9fda10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3362846060 >> 172.21.15.167:0/3362846060 conn(0x55ec3f9d8340 msgr2=0x55ec3f9f95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3362846060 shutdown_connections 2023-10-05T19:50:36.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3362846060 wait complete. 2023-10-05T19:50:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 Processor -- start 2023-10-05T19:50:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 -- start start 2023-10-05T19:50:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3fa04710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3f87ded0 con 0x55ec3f951090 2023-10-05T19:50:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f081a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3fa04710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f081a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3fa04710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47756/0 (socket says 172.21.15.167:47756) 2023-10-05T19:50:36.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 learned_addr learned my addr 172.21.15.167:0/2940679895 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec3f952a00 con 0x55ec3f951090 2023-10-05T19:50:36.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f081a700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3fa04710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f73e001f040 tx=0x7f73e0003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73ed013700 1 -- 172.21.15.167:0/2940679895 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73e0021040 con 0x55ec3f951090 2023-10-05T19:50:36.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73ed013700 1 -- 172.21.15.167:0/2940679895 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e0026400 con 0x55ec3f951090 2023-10-05T19:50:36.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ec3fa04c50 con 0x55ec3f951090 2023-10-05T19:50:36.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.349+0000 7f73ed013700 1 -- 172.21.15.167:0/2940679895 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73e0007610 con 0x55ec3f951090 2023-10-05T19:50:36.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec3fa05090 con 0x55ec3f951090 2023-10-05T19:50:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73ed013700 1 -- 172.21.15.167:0/2940679895 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f73e0024040 con 0x55ec3f951090 2023-10-05T19:50:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73ed013700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f73d0030ca0 0x7f73d0033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73ed013700 1 -- 172.21.15.167:0/2940679895 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f73e0045f10 con 0x55ec3f951090 2023-10-05T19:50:36.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73f0019700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f73d0030ca0 0x7f73d0033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ec3f952570 0x55ec3fa10120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa107d0 con 0x55ec3f952570 2023-10-05T19:50:36.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73f101b700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ec3f952570 0x55ec3fa10120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73f0019700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f73d0030ca0 0x7f73d0033150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73d8004170 tx=0x7f73d8001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.353+0000 7f73f101b700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ec3f952570 0x55ec3fa10120 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 20 realm 2023-10-05T19:50:36.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa0d780 con 0x55ec3f952570 2023-10-05T19:50:36.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:36.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa112b0 con 0x55ec3f952570 2023-10-05T19:50:36.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ec3fa10ee0 0x55ec3fa14120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa14850 con 0x55ec3fa10ee0 2023-10-05T19:50:36.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f081a700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ec3fa10ee0 0x55ec3fa14120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f081a700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ec3fa10ee0 0x55ec3fa14120 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.357+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa15120 con 0x55ec3f952570 2023-10-05T19:50:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f2ce5e40 20 searching for the correct realm 2023-10-05T19:50:36.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ec3fa14cc0 0x55ec3fa18ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3fa14cc0 2023-10-05T19:50:36.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f0019700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ec3fa14cc0 0x55ec3fa18ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f0019700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ec3fa14cc0 0x55ec3fa18ef0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8006070 con 0x55ec3fa14cc0 2023-10-05T19:50:36.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3fa10ee0 2023-10-05T19:50:36.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f081a700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f73e0007030 0x7f73e0043a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x7f73e0007030 2023-10-05T19:50:36.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f101b700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f73e0007030 0x7f73e0043a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f101b700 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f73e0007030 0x7f73e0043a30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.361+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3f952570 2023-10-05T19:50:36.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3f952570 2023-10-05T19:50:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3fa14cc0 2023-10-05T19:50:36.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8006070 con 0x55ec3fa14cc0 2023-10-05T19:50:36.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3f952570 2023-10-05T19:50:36.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3fa10ee0 2023-10-05T19:50:36.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3fa10ee0 2023-10-05T19:50:36.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.365+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3f952570 2023-10-05T19:50:36.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x7f73e0007030 2023-10-05T19:50:36.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3f952570 2023-10-05T19:50:36.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x7f73e0007030 2023-10-05T19:50:36.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3fa10ee0 2023-10-05T19:50:36.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3fa14cc0 2023-10-05T19:50:36.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8006070 con 0x55ec3fa14cc0 2023-10-05T19:50:36.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3f952570 2023-10-05T19:50:36.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.369+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19520 con 0x55ec3fa10ee0 2023-10-05T19:50:36.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8006070 con 0x55ec3fa14cc0 2023-10-05T19:50:36.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3f952570 2023-10-05T19:50:36.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3f952570 2023-10-05T19:50:36.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3f952570 2023-10-05T19:50:36.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8006070 con 0x55ec3fa14cc0 2023-10-05T19:50:36.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.373+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x7f73e0007030 2023-10-05T19:50:36.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3f952570 2023-10-05T19:50:36.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x7f73e0007030 2023-10-05T19:50:36.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8006070 con 0x55ec3fa14cc0 2023-10-05T19:50:36.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x7f73e0007030 2023-10-05T19:50:36.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3fa10ee0 2023-10-05T19:50:36.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3fa10ee0 2023-10-05T19:50:36.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.377+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8006070 con 0x55ec3fa14cc0 2023-10-05T19:50:36.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3fa10ee0 2023-10-05T19:50:36.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73e004a040 con 0x55ec3fa10ee0 2023-10-05T19:50:36.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f2ce5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f2ce5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f2ce5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f2ce5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa15c90 con 0x55ec3f952570 2023-10-05T19:50:36.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.381+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa165e0 con 0x55ec3fa10ee0 2023-10-05T19:50:36.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa15820 con 0x55ec3fa10ee0 2023-10-05T19:50:36.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19e80 con 0x55ec3fa14cc0 2023-10-05T19:50:36.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f73d8006070 con 0x55ec3fa14cc0 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1a230 con 0x55ec3f952570 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1a5e0 con 0x55ec3fa10ee0 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3fa14cc0 2023-10-05T19:50:36.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.385+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3fa10ee0 2023-10-05T19:50:36.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x7f73e0007030 2023-10-05T19:50:36.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3f952570 2023-10-05T19:50:36.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3f952570 2023-10-05T19:50:36.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3fa14cc0 2023-10-05T19:50:36.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3f952570 2023-10-05T19:50:36.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.389+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3fa10ee0 2023-10-05T19:50:36.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3fa10ee0 2023-10-05T19:50:36.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3f952570 2023-10-05T19:50:36.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x7f73e0007030 2023-10-05T19:50:36.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3f952570 2023-10-05T19:50:36.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x7f73e0007030 2023-10-05T19:50:36.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.393+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3fa10ee0 2023-10-05T19:50:36.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b9a0 con 0x55ec3fa14cc0 2023-10-05T19:50:36.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3f952570 2023-10-05T19:50:36.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3fa10ee0 2023-10-05T19:50:36.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3f952570 2023-10-05T19:50:36.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.397+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3f952570 2023-10-05T19:50:36.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3f952570 2023-10-05T19:50:36.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x7f73e0007030 2023-10-05T19:50:36.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3f952570 2023-10-05T19:50:36.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x7f73e0007030 2023-10-05T19:50:36.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.401+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x7f73e0007030 2023-10-05T19:50:36.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3fa10ee0 2023-10-05T19:50:36.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3fa10ee0 2023-10-05T19:50:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3fa10ee0 2023-10-05T19:50:36.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f73d8028040 con 0x55ec3fa10ee0 2023-10-05T19:50:36.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f2ce5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f2ce5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f2ce5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f2ce5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.405+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1a990 con 0x55ec3fa10ee0 2023-10-05T19:50:36.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1a990 con 0x55ec3f952570 2023-10-05T19:50:36.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19ab0 con 0x55ec3fa10ee0 2023-10-05T19:50:36.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa19a80 con 0x55ec3fa10ee0 2023-10-05T19:50:36.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.409+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b300 con 0x7f73e0007030 2023-10-05T19:50:36.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 zone default found 2023-10-05T19:50:36.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 4 Realm: () 2023-10-05T19:50:36.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:36.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:36.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:36.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 zonegroup default 2023-10-05T19:50:36.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b300 con 0x7f73e0007030 2023-10-05T19:50:36.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1b300 con 0x55ec3fa14cc0 2023-10-05T19:50:36.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1d6d0 con 0x55ec3fa14cc0 2023-10-05T19:50:36.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 started sync module instance, tier type = 2023-10-05T19:50:36.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:36.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.413+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1cd90 con 0x55ec3fa10ee0 2023-10-05T19:50:36.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.417+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.417+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94473168203072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1cd90 con 0x55ec3fa10ee0 2023-10-05T19:50:36.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.417+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1df70 con 0x55ec3f952570 2023-10-05T19:50:36.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.417+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94473168203072] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.417+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.417+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94473168212368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1cd90 con 0x55ec3f952570 2023-10-05T19:50:36.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.417+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1e630 con 0x55ec3fa10ee0 2023-10-05T19:50:36.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.421+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94473168212368] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.421+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.421+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94473168214656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1e630 con 0x55ec3fa10ee0 2023-10-05T19:50:36.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.421+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1ef20 con 0x7f73e0007030 2023-10-05T19:50:36.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.421+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.421+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94473168218672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1ee80 con 0x7f73e0007030 2023-10-05T19:50:36.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.421+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1fe70 con 0x55ec3fa10ee0 2023-10-05T19:50:36.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.421+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94473168214656] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.425+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94473168218672] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.425+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.425+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94473168220960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1f980 con 0x55ec3fa10ee0 2023-10-05T19:50:36.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.425+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa20220 con 0x55ec3fa14cc0 2023-10-05T19:50:36.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.425+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94473168220960] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.425+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.425+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94473168222592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1fdd0 con 0x55ec3fa14cc0 2023-10-05T19:50:36.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.425+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa20fb0 con 0x55ec3fa14cc0 2023-10-05T19:50:36.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94473168222592] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94473168226304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa21850 con 0x55ec3fa14cc0 2023-10-05T19:50:36.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa220f0 con 0x7f73e0007030 2023-10-05T19:50:36.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94473168226304] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73d8024040 con 0x55ec3fa14cc0 2023-10-05T19:50:36.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94473168229776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa21ed0 con 0x7f73e0007030 2023-10-05T19:50:36.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 20 add_watcher() i=0 2023-10-05T19:50:36.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 20 add_watcher() i=1 2023-10-05T19:50:36.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 20 add_watcher() i=2 2023-10-05T19:50:36.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 20 add_watcher() i=3 2023-10-05T19:50:36.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 20 add_watcher() i=4 2023-10-05T19:50:36.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 20 add_watcher() i=5 2023-10-05T19:50:36.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.429+0000 7f73f2ce5e40 20 add_watcher() i=6 2023-10-05T19:50:36.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94473168229776] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x7f73e0007030 2023-10-05T19:50:36.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 20 add_watcher() i=7 2023-10-05T19:50:36.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:36.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa25520 con 0x55ec3f952570 2023-10-05T19:50:36.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94473168231344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa22910 con 0x55ec3f952570 2023-10-05T19:50:36.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94473168231344] v30'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f73e800a5a0 con 0x55ec3f952570 2023-10-05T19:50:36.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73c27e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:36.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:36.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 1 Processor -- start 2023-10-05T19:50:36.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 1 -- start start 2023-10-05T19:50:36.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa2fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.433+0000 7f73f2ce5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3fa30110 con 0x55ec3fa2f800 2023-10-05T19:50:36.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f0019700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa2fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f0019700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa2fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45074/0 (socket says 172.21.15.167:45074) 2023-10-05T19:50:36.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f0019700 1 -- 172.21.15.167:0/3245943421 learned_addr learned my addr 172.21.15.167:0/3245943421 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f0019700 1 -- 172.21.15.167:0/3245943421 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec3fa30250 con 0x55ec3fa2f800 2023-10-05T19:50:36.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f0019700 1 --2- 172.21.15.167:0/3245943421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa2fbd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55ec3fa14c00 tx=0x7f73d8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254d88fa75827179 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73c1fe3700 1 -- 172.21.15.167:0/3245943421 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73d803b070 con 0x55ec3fa2f800 2023-10-05T19:50:36.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73c1fe3700 1 -- 172.21.15.167:0/3245943421 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8022040 con 0x55ec3fa2f800 2023-10-05T19:50:36.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73c1fe3700 1 -- 172.21.15.167:0/3245943421 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73d8021040 con 0x55ec3fa2f800 2023-10-05T19:50:36.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3245943421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 msgr2=0x55ec3fa2fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/3245943421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa2fbd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55ec3fa14c00 tx=0x7f73d8010000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3245943421 shutdown_connections 2023-10-05T19:50:36.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/3245943421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa2fbd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3245943421 >> 172.21.15.167:0/3245943421 conn(0x55ec3fa2abc0 msgr2=0x55ec3fa28d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3245943421 shutdown_connections 2023-10-05T19:50:36.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/3245943421 wait complete. 2023-10-05T19:50:36.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 Processor -- start 2023-10-05T19:50:36.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 -- start start 2023-10-05T19:50:36.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa35280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f2ce5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec3fa36280 con 0x55ec3fa2f800 2023-10-05T19:50:36.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f0019700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa35280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f0019700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa35280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45080/0 (socket says 172.21.15.167:45080) 2023-10-05T19:50:36.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.437+0000 7f73f0019700 1 -- 172.21.15.167:0/2544204243 learned_addr learned my addr 172.21.15.167:0/2544204243 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f73f0019700 1 -- 172.21.15.167:0/2544204243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc001e10 con 0x55ec3fa2f800 2023-10-05T19:50:36.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f73f0019700 1 --2- 172.21.15.167:0/2544204243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa35280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55ec3fa298e0 tx=0x7f73d8036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f7333fff700 1 -- 172.21.15.167:0/2544204243 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73d8021050 con 0x55ec3fa2f800 2023-10-05T19:50:36.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2544204243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ec3fa35880 con 0x55ec3fa2f800 2023-10-05T19:50:36.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f7333fff700 1 -- 172.21.15.167:0/2544204243 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8036e60 con 0x55ec3fa2f800 2023-10-05T19:50:36.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f7333fff700 1 -- 172.21.15.167:0/2544204243 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73d8045070 con 0x55ec3fa2f800 2023-10-05T19:50:36.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2544204243 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec3fa35d20 con 0x55ec3fa2f800 2023-10-05T19:50:36.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f7333fff700 1 -- 172.21.15.167:0/2544204243 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f73d803e070 con 0x55ec3fa2f800 2023-10-05T19:50:36.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f7333fff700 1 --2- 172.21.15.167:0/2544204243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7338030b20 0x7f7338032fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f7333fff700 1 -- 172.21.15.167:0/2544204243 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f73d802e040 con 0x55ec3fa2f800 2023-10-05T19:50:36.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f73f101b700 1 --2- 172.21.15.167:0/2544204243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7338030b20 0x7f7338032fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f73f2ce5e40 5 note: GC not initialized 2023-10-05T19:50:36.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.441+0000 7f73f101b700 1 --2- 172.21.15.167:0/2544204243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7338030b20 0x7f7338032fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55ec3fa22100 tx=0x7f73e800ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73317fa700 20 reqs_thread_entry: start 2023-10-05T19:50:36.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f732affd700 20 reqs_thread_entry: start 2023-10-05T19:50:36.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:36.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:36.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 20 get_system_obj_state: rctx=0x7ffcf117ed28 obj=default.rgw.meta:users.uid:foo state=0x55ec3f8b60b0 s->prefetch_data=0 2023-10-05T19:50:36.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73297fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:06 2023 2023-10-05T19:50:36.452 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:36.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa9dad0 con 0x55ec3f952570 2023-10-05T19:50:36.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f7328ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:36.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f73e803c050 con 0x55ec3f952570 2023-10-05T19:50:36.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:36.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:36.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3faa0560 con 0x55ec3f952570 2023-10-05T19:50:36.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f73e803c050 con 0x55ec3f952570 2023-10-05T19:50:36.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:36.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa9f550 con 0x7f73e0007030 2023-10-05T19:50:36.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.445+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f73e803c050 con 0x7f73e0007030 2023-10-05T19:50:36.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.449+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94473168203072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa5bec0 con 0x55ec3fa10ee0 2023-10-05T19:50:36.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.449+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94473168203072] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.449+0000 7f73f2ce5e40 20 remove_watcher() i=0 2023-10-05T19:50:36.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.449+0000 7f73f2ce5e40 2 removed watcher, disabling cache 2023-10-05T19:50:36.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.449+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94473168212368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1ad40 con 0x55ec3f952570 2023-10-05T19:50:36.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.453+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94473168212368] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e803c050 con 0x55ec3f952570 2023-10-05T19:50:36.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.453+0000 7f73f2ce5e40 20 remove_watcher() i=1 2023-10-05T19:50:36.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.453+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94473168214656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1ad40 con 0x55ec3fa10ee0 2023-10-05T19:50:36.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.453+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94473168214656] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.453+0000 7f73f2ce5e40 20 remove_watcher() i=2 2023-10-05T19:50:36.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.453+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94473168218672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1da80 con 0x7f73e0007030 2023-10-05T19:50:36.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.457+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94473168218672] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e803c050 con 0x7f73e0007030 2023-10-05T19:50:36.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.457+0000 7f73f2ce5e40 20 remove_watcher() i=3 2023-10-05T19:50:36.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.457+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94473168220960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1ea30 con 0x55ec3fa10ee0 2023-10-05T19:50:36.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.457+0000 7f73f081a700 1 -- 172.21.15.167:0/2940679895 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94473168220960] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e0026710 con 0x55ec3fa10ee0 2023-10-05T19:50:36.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.457+0000 7f73f2ce5e40 20 remove_watcher() i=4 2023-10-05T19:50:36.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.457+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94473168222592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1ea30 con 0x55ec3fa14cc0 2023-10-05T19:50:36.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.461+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94473168222592] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73d803d030 con 0x55ec3fa14cc0 2023-10-05T19:50:36.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.461+0000 7f73f2ce5e40 20 remove_watcher() i=5 2023-10-05T19:50:36.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.461+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94473168226304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1f980 con 0x55ec3fa14cc0 2023-10-05T19:50:36.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.461+0000 7f73f0019700 1 -- 172.21.15.167:0/2940679895 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94473168226304] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73d803d030 con 0x55ec3fa14cc0 2023-10-05T19:50:36.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.461+0000 7f73f2ce5e40 20 remove_watcher() i=6 2023-10-05T19:50:36.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.461+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94473168229776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1ea30 con 0x7f73e0007030 2023-10-05T19:50:36.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.461+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94473168229776] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f73e803c050 con 0x7f73e0007030 2023-10-05T19:50:36.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.461+0000 7f73f2ce5e40 20 remove_watcher() i=7 2023-10-05T19:50:36.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.465+0000 7f73c27e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.465+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94473168231344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ec3fa1ea30 con 0x55ec3f952570 2023-10-05T19:50:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94473168231344] v30'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f73e803c050 con 0x55ec3f952570 2023-10-05T19:50:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ec3fa10ee0 msgr2=0x55ec3fa14120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ec3fa10ee0 0x55ec3fa14120 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ec3f952570 msgr2=0x55ec3fa10120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ec3f952570 0x55ec3fa10120 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f73e0007030 msgr2=0x7f73e0043a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f73e0007030 0x7f73e0043a30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ec3fa14cc0 msgr2=0x55ec3fa18ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ec3fa14cc0 0x55ec3fa18ef0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f73d0030ca0 msgr2=0x7f73d0033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f73d0030ca0 0x7f73d0033150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73d8004170 tx=0x7f73d8001400 comp rx=0 tx=0).stop 2023-10-05T19:50:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 msgr2=0x55ec3fa04710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3fa04710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f73e001f040 tx=0x7f73e0003050 comp rx=0 tx=0).stop 2023-10-05T19:50:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f101b700 1 -- 172.21.15.167:0/2940679895 reap_dead start 2023-10-05T19:50:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 shutdown_connections 2023-10-05T19:50:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2940679895 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3f951090 0x55ec3fa04710 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f73e001f040 tx=0x7f73e0003050 comp rx=0 tx=0).stop 2023-10-05T19:50:36.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 >> 172.21.15.167:0/2940679895 conn(0x55ec3f9d8340 msgr2=0x55ec3f9f8050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 shutdown_connections 2023-10-05T19:50:36.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2940679895 wait complete. 2023-10-05T19:50:36.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2544204243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7338030b20 msgr2=0x7f7338032fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2544204243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7338030b20 0x7f7338032fd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55ec3fa22100 tx=0x7f73e800ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:36.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2544204243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 msgr2=0x55ec3fa35280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2544204243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa35280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55ec3fa298e0 tx=0x7f73d8036000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2544204243 shutdown_connections 2023-10-05T19:50:36.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2544204243 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7338030b20 0x7f7338032fd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 --2- 172.21.15.167:0/2544204243 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ec3fa2f800 0x55ec3fa35280 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2544204243 >> 172.21.15.167:0/2544204243 conn(0x55ec3fa2abc0 msgr2=0x55ec3fa28cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2544204243 shutdown_connections 2023-10-05T19:50:36.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.469+0000 7f73f2ce5e40 1 -- 172.21.15.167:0/2544204243 wait complete. 2023-10-05T19:50:36.479 INFO:teuthology.orchestra.run.smithi167.stdout:[] 2023-10-05T19:50:36.482 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T19:50:36.482 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2023-10-05T19:50:36.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2023-10-05T19:50:36.483 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2023-10-05T19:50:36.522 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:36.523 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:36.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cfeafe40 1 Processor -- start 2023-10-05T19:50:36.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cfeafe40 1 -- start start 2023-10-05T19:50:36.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cfeafe40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e6a0915260 0x55e6a09a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cfeafe40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e6a08edbd0 con 0x55e6a0916570 2023-10-05T19:50:36.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cfeafe40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e6a08aaee0 con 0x55e6a0915260 2023-10-05T19:50:36.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cd1e3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e6a0915260 0x55e6a09a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cd9e4700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55e6a0916570 0x55e6a0914b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51598/0 (socket says 172.21.15.167:51598) 2023-10-05T19:50:36.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/2992883078 learned_addr learned my addr 172.21.15.167:0/2992883078 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:36.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cd1e3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e6a0915260 0x55e6a09a9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45082/0 (socket says 172.21.15.167:45082) 2023-10-05T19:50:36.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/2992883078 >> v1:172.21.15.118:6789/0 conn(0x55e6a0916570 legacy=0x55e6a0914b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cc9e2700 1 -- 172.21.15.167:0/2992883078 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050883314 0 0) 0x55e6a08edbd0 con 0x55e6a0916570 2023-10-05T19:50:36.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/2992883078 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6a0916a00 con 0x55e6a0915260 2023-10-05T19:50:36.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cd1e3700 1 --2- 172.21.15.167:0/2992883078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09a9a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800a5d0 tx=0x7fe1b8005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281359fe7ca5eb79 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cc9e2700 1 -- 172.21.15.167:0/2992883078 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b80086a0 con 0x55e6a0915260 2023-10-05T19:50:36.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cc9e2700 1 -- 172.21.15.167:0/2992883078 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b8008800 con 0x55e6a0915260 2023-10-05T19:50:36.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.517+0000 7fe1cc9e2700 1 -- 172.21.15.167:0/2992883078 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b8008ad0 con 0x55e6a0915260 2023-10-05T19:50:36.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/2992883078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 msgr2=0x55e6a09a9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/2992883078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09a9a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800a5d0 tx=0x7fe1b8005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:36.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/2992883078 shutdown_connections 2023-10-05T19:50:36.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/2992883078 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09a9a50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/2992883078 >> 172.21.15.167:0/2992883078 conn(0x55e6a099c340 msgr2=0x55e6a099e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/2992883078 shutdown_connections 2023-10-05T19:50:36.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/2992883078 wait complete. 2023-10-05T19:50:36.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 Processor -- start 2023-10-05T19:50:36.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 -- start start 2023-10-05T19:50:36.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cfeafe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a086ee30 con 0x55e6a0915260 2023-10-05T19:50:36.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cd9e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cd9e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45098/0 (socket says 172.21.15.167:45098) 2023-10-05T19:50:36.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.521+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/381042616 learned_addr learned my addr 172.21.15.167:0/381042616 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/381042616 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8005cf0 con 0x55e6a0915260 2023-10-05T19:50:36.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cd9e4700 1 --2- 172.21.15.167:0/381042616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c1970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8001630 tx=0x7fe1c80069b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b965c7e2acd3f15 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1c77fe700 1 -- 172.21.15.167:0/381042616 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1c8006320 con 0x55e6a0915260 2023-10-05T19:50:36.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1c77fe700 1 -- 172.21.15.167:0/381042616 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c80044c0 con 0x55e6a0915260 2023-10-05T19:50:36.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1c77fe700 1 -- 172.21.15.167:0/381042616 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1c8004650 con 0x55e6a0915260 2023-10-05T19:50:36.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/381042616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 msgr2=0x55e6a09c1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/381042616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c1970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8001630 tx=0x7fe1c80069b0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/381042616 shutdown_connections 2023-10-05T19:50:36.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/381042616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c1970 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/381042616 >> 172.21.15.167:0/381042616 conn(0x55e6a099c340 msgr2=0x55e6a09bd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/381042616 shutdown_connections 2023-10-05T19:50:36.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/381042616 wait complete. 2023-10-05T19:50:36.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 Processor -- start 2023-10-05T19:50:36.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 -- start start 2023-10-05T19:50:36.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cfeafe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a0841ed0 con 0x55e6a0915260 2023-10-05T19:50:36.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cd9e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cd9e4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45114/0 (socket says 172.21.15.167:45114) 2023-10-05T19:50:36.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.525+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 learned_addr learned my addr 172.21.15.167:0/1883585839 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8006c90 con 0x55e6a0915260 2023-10-05T19:50:36.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1cd9e4700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c8750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8000f80 tx=0x7fe1c8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1c5ffb700 1 -- 172.21.15.167:0/1883585839 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1c80136c0 con 0x55e6a0915260 2023-10-05T19:50:36.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1c5ffb700 1 -- 172.21.15.167:0/1883585839 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8013820 con 0x55e6a0915260 2023-10-05T19:50:36.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e6a09c8c90 con 0x55e6a0915260 2023-10-05T19:50:36.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1c5ffb700 1 -- 172.21.15.167:0/1883585839 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1c8013ad0 con 0x55e6a0915260 2023-10-05T19:50:36.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6a09c90d0 con 0x55e6a0915260 2023-10-05T19:50:36.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1c5ffb700 1 -- 172.21.15.167:0/1883585839 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fe1c801a070 con 0x55e6a0915260 2023-10-05T19:50:36.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1c5ffb700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe1b0030c50 0x7fe1b0033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1c5ffb700 1 -- 172.21.15.167:0/1883585839 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fe1c8044f00 con 0x55e6a0915260 2023-10-05T19:50:36.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1cd1e3700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe1b0030c50 0x7fe1b0033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e6a0916570 0x55e6a09d41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09d48e0 con 0x55e6a0916570 2023-10-05T19:50:36.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.529+0000 7fe1ce1e5700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e6a0916570 0x55e6a09d41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cd1e3700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe1b0030c50 0x7fe1b0033100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8005a90 tx=0x7fe1b8015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1ce1e5700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e6a0916570 0x55e6a09d41e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1c000a500 con 0x55e6a0916570 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 20 realm 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09d1840 con 0x55e6a0916570 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1c000a500 con 0x55e6a0916570 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09d53c0 con 0x55e6a0916570 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1c000a500 con 0x55e6a0916570 2023-10-05T19:50:36.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e6a09d4ff0 0x55e6a09d8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09d8960 con 0x55e6a09d4ff0 2023-10-05T19:50:36.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cd9e4700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e6a09d4ff0 0x55e6a09d8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.533+0000 7fe1cd9e4700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e6a09d4ff0 0x55e6a09d8230 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09d9230 con 0x55e6a0916570 2023-10-05T19:50:36.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe1c000a500 con 0x55e6a0916570 2023-10-05T19:50:36.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cfeafe40 20 searching for the correct realm 2023-10-05T19:50:36.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e6a09d8da0 0x55e6a09dd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d8da0 2023-10-05T19:50:36.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cd1e3700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e6a09d8da0 0x55e6a09dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cd1e3700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e6a09d8da0 0x55e6a09dd000 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cd9e4700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe1c80106e0 0x7fe1c802a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x7fe1c80106e0 2023-10-05T19:50:36.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.537+0000 7fe1ce1e5700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe1c80106e0 0x7fe1c802a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1ce1e5700 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe1c80106e0 0x7fe1c802a000 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x7fe1c80106e0 2023-10-05T19:50:36.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d8da0 2023-10-05T19:50:36.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.541+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x7fe1c80106e0 2023-10-05T19:50:36.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x7fe1c80106e0 2023-10-05T19:50:36.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x7fe1c80106e0 2023-10-05T19:50:36.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x7fe1c80106e0 2023-10-05T19:50:36.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d8da0 2023-10-05T19:50:36.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.545+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d8da0 2023-10-05T19:50:36.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d8da0 2023-10-05T19:50:36.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x7fe1c80106e0 2023-10-05T19:50:36.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x7fe1c80106e0 2023-10-05T19:50:36.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a0916570 2023-10-05T19:50:36.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.549+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x7fe1c80106e0 2023-10-05T19:50:36.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x7fe1c80106e0 2023-10-05T19:50:36.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d8da0 2023-10-05T19:50:36.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x7fe1c80106e0 2023-10-05T19:50:36.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x7fe1c80106e0 2023-10-05T19:50:36.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d8da0 2023-10-05T19:50:36.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.553+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dd5e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09d9da0 con 0x55e6a0916570 2023-10-05T19:50:36.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09da720 con 0x55e6a09d4ff0 2023-10-05T19:50:36.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09d9990 con 0x55e6a09d4ff0 2023-10-05T19:50:36.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09ddf90 con 0x55e6a09d8da0 2023-10-05T19:50:36.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.557+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de6f0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dfab0 con 0x55e6a09d8da0 2023-10-05T19:50:36.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dfab0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dfab0 con 0x7fe1c80106e0 2023-10-05T19:50:36.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x7fe1c80106e0 2023-10-05T19:50:36.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.561+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d8da0 2023-10-05T19:50:36.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d4ff0 2023-10-05T19:50:36.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d4ff0 2023-10-05T19:50:36.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x7fe1c80106e0 2023-10-05T19:50:36.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.565+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x7fe1c80106e0 2023-10-05T19:50:36.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x7fe1c80106e0 2023-10-05T19:50:36.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x7fe1c80106e0 2023-10-05T19:50:36.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d4ff0 2023-10-05T19:50:36.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d8da0 2023-10-05T19:50:36.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.569+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d4ff0 2023-10-05T19:50:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d8da0 2023-10-05T19:50:36.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0014040 con 0x55e6a0916570 2023-10-05T19:50:36.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d8da0 2023-10-05T19:50:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x7fe1c80106e0 2023-10-05T19:50:36.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.573+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a0916570 2023-10-05T19:50:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x7fe1c80106e0 2023-10-05T19:50:36.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d8da0 2023-10-05T19:50:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x7fe1c80106e0 2023-10-05T19:50:36.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d4ff0 2023-10-05T19:50:36.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d4ff0 2023-10-05T19:50:36.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.577+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d8da0 2023-10-05T19:50:36.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d4ff0 2023-10-05T19:50:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09de340 con 0x55e6a09d4ff0 2023-10-05T19:50:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09deaa0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09dee50 con 0x55e6a0916570 2023-10-05T19:50:36.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09ddb90 con 0x55e6a09d4ff0 2023-10-05T19:50:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.581+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09ddbb0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09df7d0 con 0x7fe1c80106e0 2023-10-05T19:50:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 zone default found 2023-10-05T19:50:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 4 Realm: () 2023-10-05T19:50:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 zonegroup default 2023-10-05T19:50:36.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09df7d0 con 0x7fe1c80106e0 2023-10-05T19:50:36.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e1150 con 0x55e6a09d8da0 2023-10-05T19:50:36.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e1500 con 0x55e6a09d8da0 2023-10-05T19:50:36.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 started sync module instance, tier type = 2023-10-05T19:50:36.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:36.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.585+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e0810 con 0x55e6a09d4ff0 2023-10-05T19:50:36.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.589+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.589+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94449025544704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e0810 con 0x55e6a09d4ff0 2023-10-05T19:50:36.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.589+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e1dd0 con 0x55e6a0916570 2023-10-05T19:50:36.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.593+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94449025544704] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.593+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.593+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94449025551376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e1dd0 con 0x55e6a0916570 2023-10-05T19:50:36.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.593+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e27e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.593+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94449025551376] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.593+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.593+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94449025554944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e27e0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.593+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e3080 con 0x7fe1c80106e0 2023-10-05T19:50:36.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.597+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94449025554944] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.597+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.597+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94449025557520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e2d50 con 0x7fe1c80106e0 2023-10-05T19:50:36.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.597+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e3970 con 0x55e6a09d4ff0 2023-10-05T19:50:36.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.597+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94449025557520] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.597+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.597+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94449025562288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e2d50 con 0x55e6a09d4ff0 2023-10-05T19:50:36.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.597+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e43d0 con 0x55e6a09d8da0 2023-10-05T19:50:36.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.601+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.601+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94449025564384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e4c70 con 0x55e6a09d8da0 2023-10-05T19:50:36.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.601+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e5680 con 0x55e6a09d8da0 2023-10-05T19:50:36.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.601+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94449025562288] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.601+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94449025564384] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.601+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.601+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94449025569168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e5a80 con 0x55e6a09d8da0 2023-10-05T19:50:36.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.601+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e6320 con 0x7fe1c80106e0 2023-10-05T19:50:36.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94449025569168] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b8012450 con 0x55e6a09d8da0 2023-10-05T19:50:36.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94449025572960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e69a0 con 0x7fe1c80106e0 2023-10-05T19:50:36.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 add_watcher() i=0 2023-10-05T19:50:36.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 add_watcher() i=1 2023-10-05T19:50:36.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 add_watcher() i=2 2023-10-05T19:50:36.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 add_watcher() i=3 2023-10-05T19:50:36.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 add_watcher() i=4 2023-10-05T19:50:36.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 add_watcher() i=5 2023-10-05T19:50:36.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 add_watcher() i=6 2023-10-05T19:50:36.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94449025572960] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 add_watcher() i=7 2023-10-05T19:50:36.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:36.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e69a0 con 0x55e6a0916570 2023-10-05T19:50:36.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94449025574064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e6900 con 0x55e6a0916570 2023-10-05T19:50:36.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94449025574064] v30'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe19efe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:36.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.605+0000 7fe1cfeafe40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:36.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 Processor -- start 2023-10-05T19:50:36.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 -- start start 2023-10-05T19:50:36.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a09f4600 con 0x55e6a09f3cf0 2023-10-05T19:50:36.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cd1e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cd1e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45124/0 (socket says 172.21.15.167:45124) 2023-10-05T19:50:36.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/4159091283 learned_addr learned my addr 172.21.15.167:0/4159091283 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/4159091283 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6a09f4740 con 0x55e6a09f3cf0 2023-10-05T19:50:36.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cd1e3700 1 --2- 172.21.15.167:0/4159091283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f40c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8002000 tx=0x7fe1b8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08543ae982a8dc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe19e7e4700 1 -- 172.21.15.167:0/4159091283 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b802d040 con 0x55e6a09f3cf0 2023-10-05T19:50:36.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe19e7e4700 1 -- 172.21.15.167:0/4159091283 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b8028890 con 0x55e6a09f3cf0 2023-10-05T19:50:36.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe19e7e4700 1 -- 172.21.15.167:0/4159091283 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b8028a60 con 0x55e6a09f3cf0 2023-10-05T19:50:36.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/4159091283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 msgr2=0x55e6a09f40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/4159091283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f40c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8002000 tx=0x7fe1b8012000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/4159091283 shutdown_connections 2023-10-05T19:50:36.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/4159091283 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f40c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/4159091283 >> 172.21.15.167:0/4159091283 conn(0x55e6a09ef0b0 msgr2=0x55e6a09ed260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/4159091283 shutdown_connections 2023-10-05T19:50:36.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.609+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/4159091283 wait complete. 2023-10-05T19:50:36.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cfeafe40 1 Processor -- start 2023-10-05T19:50:36.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cfeafe40 1 -- start start 2023-10-05T19:50:36.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cfeafe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cfeafe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a09fa6b0 con 0x55e6a09f3cf0 2023-10-05T19:50:36.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cd1e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cd1e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45130/0 (socket says 172.21.15.167:45130) 2023-10-05T19:50:36.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1804066593 learned_addr learned my addr 172.21.15.167:0/1804066593 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1804066593 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6a0916a00 con 0x55e6a09f3cf0 2023-10-05T19:50:36.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cd1e3700 1 --2- 172.21.15.167:0/1804066593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f96b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55e6a09eddd0 tx=0x7fe1b802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe19cfe1700 1 -- 172.21.15.167:0/1804066593 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b8033b50 con 0x55e6a09f3cf0 2023-10-05T19:50:36.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe19cfe1700 1 -- 172.21.15.167:0/1804066593 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b803f070 con 0x55e6a09f3cf0 2023-10-05T19:50:36.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1804066593 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e6a09f9cb0 con 0x55e6a09f3cf0 2023-10-05T19:50:36.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe19cfe1700 1 -- 172.21.15.167:0/1804066593 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe1b8033d10 con 0x55e6a09f3cf0 2023-10-05T19:50:36.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1804066593 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6a09fa0f0 con 0x55e6a09f3cf0 2023-10-05T19:50:36.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.613+0000 7fe19cfe1700 1 -- 172.21.15.167:0/1804066593 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fe1b804d440 con 0x55e6a09f3cf0 2023-10-05T19:50:36.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe19cfe1700 1 --2- 172.21.15.167:0/1804066593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe114030c00 0x7fe1140330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe19cfe1700 1 -- 172.21.15.167:0/1804066593 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fe1b8041070 con 0x55e6a09f3cf0 2023-10-05T19:50:36.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe1ce1e5700 1 --2- 172.21.15.167:0/1804066593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe114030c00 0x7fe1140330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe1cfeafe40 5 note: GC not initialized 2023-10-05T19:50:36.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe1ce1e5700 1 --2- 172.21.15.167:0/1804066593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe114030c00 0x7fe1140330b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55e6a09e2bd0 tx=0x7fe1c000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe10dffb700 20 reqs_thread_entry: start 2023-10-05T19:50:36.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe0ff7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:36.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe1cfeafe40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:36.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe1cfeafe40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:36.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe0fd7fa700 20 reqs_thread_entry: start 2023-10-05T19:50:36.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe1cfeafe40 20 get_system_obj_state: rctx=0x7ffe2bb735c8 obj=default.rgw.meta:users.uid:foo state=0x55e6a087a0b0 s->prefetch_data=0 2023-10-05T19:50:36.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a0a61ee0 con 0x55e6a0916570 2023-10-05T19:50:36.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.617+0000 7fe0fdffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:07 2023 2023-10-05T19:50:36.626 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:36.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:36.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:36.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a0a64970 con 0x55e6a0916570 2023-10-05T19:50:36.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:36.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a0a63960 con 0x7fe1c80106e0 2023-10-05T19:50:36.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94449025544704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a0a202d0 con 0x55e6a09d4ff0 2023-10-05T19:50:36.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94449025544704] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 20 remove_watcher() i=0 2023-10-05T19:50:36.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 2 removed watcher, disabling cache 2023-10-05T19:50:36.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.621+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94449025551376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09df200 con 0x55e6a0916570 2023-10-05T19:50:36.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.625+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94449025551376] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.625+0000 7fe1cfeafe40 20 remove_watcher() i=1 2023-10-05T19:50:36.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.625+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94449025554944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09df200 con 0x55e6a09d4ff0 2023-10-05T19:50:36.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.625+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94449025554944] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.625+0000 7fe1cfeafe40 20 remove_watcher() i=2 2023-10-05T19:50:36.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.625+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94449025557520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e1a00 con 0x7fe1c80106e0 2023-10-05T19:50:36.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.629+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94449025557520] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.629+0000 7fe1cfeafe40 20 remove_watcher() i=3 2023-10-05T19:50:36.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.629+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94449025562288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09df200 con 0x55e6a09d4ff0 2023-10-05T19:50:36.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.629+0000 7fe1cd9e4700 1 -- 172.21.15.167:0/1883585839 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94449025562288] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c8025020 con 0x55e6a09d4ff0 2023-10-05T19:50:36.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.629+0000 7fe1cfeafe40 20 remove_watcher() i=4 2023-10-05T19:50:36.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.629+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94449025564384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e1a00 con 0x55e6a09d8da0 2023-10-05T19:50:36.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.633+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94449025564384] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b8039020 con 0x55e6a09d8da0 2023-10-05T19:50:36.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.633+0000 7fe1cfeafe40 20 remove_watcher() i=5 2023-10-05T19:50:36.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.633+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94449025569168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09df200 con 0x55e6a09d8da0 2023-10-05T19:50:36.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.633+0000 7fe1cd1e3700 1 -- 172.21.15.167:0/1883585839 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94449025569168] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1b8039020 con 0x55e6a09d8da0 2023-10-05T19:50:36.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.633+0000 7fe1cfeafe40 20 remove_watcher() i=6 2023-10-05T19:50:36.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.633+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94449025572960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e3ee0 con 0x7fe1c80106e0 2023-10-05T19:50:36.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.637+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94449025572960] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x7fe1c80106e0 2023-10-05T19:50:36.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.637+0000 7fe1cfeafe40 20 remove_watcher() i=7 2023-10-05T19:50:36.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.637+0000 7fe19efe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.637+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94449025574064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e6a09e3ee0 con 0x55e6a0916570 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94449025574064] v30'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe1c0033040 con 0x55e6a0916570 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e6a09d4ff0 msgr2=0x55e6a09d8230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e6a09d4ff0 0x55e6a09d8230 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e6a0916570 msgr2=0x55e6a09d41e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e6a0916570 0x55e6a09d41e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe1c80106e0 msgr2=0x7fe1c802a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe1c80106e0 0x7fe1c802a000 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e6a09d8da0 msgr2=0x55e6a09dd000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e6a09d8da0 0x55e6a09dd000 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe1b0030c50 msgr2=0x7fe1b0033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe1b0030c50 0x7fe1b0033100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8005a90 tx=0x7fe1b8015000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 msgr2=0x55e6a09c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1883585839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a0915260 0x55e6a09c8750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8000f80 tx=0x7fe1c8014000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1ce1e5700 1 -- 172.21.15.167:0/1883585839 reap_dead start 2023-10-05T19:50:36.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 shutdown_connections 2023-10-05T19:50:36.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 >> 172.21.15.167:0/1883585839 conn(0x55e6a099c340 msgr2=0x55e6a09bbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 shutdown_connections 2023-10-05T19:50:36.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1883585839 wait complete. 2023-10-05T19:50:36.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1804066593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe114030c00 msgr2=0x7fe1140330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1804066593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe114030c00 0x7fe1140330b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55e6a09e2bd0 tx=0x7fe1c000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:36.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1804066593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 msgr2=0x55e6a09f96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1804066593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f96b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55e6a09eddd0 tx=0x7fe1b802c000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1804066593 shutdown_connections 2023-10-05T19:50:36.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1804066593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe114030c00 0x7fe1140330b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 --2- 172.21.15.167:0/1804066593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e6a09f3cf0 0x55e6a09f96b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1804066593 >> 172.21.15.167:0/1804066593 conn(0x55e6a09ef0b0 msgr2=0x55e6a09ed1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1804066593 shutdown_connections 2023-10-05T19:50:36.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.641+0000 7fe1cfeafe40 1 -- 172.21.15.167:0/1804066593 wait complete. 2023-10-05T19:50:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:[] 2023-10-05T19:50:36.654 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T19:50:36.677 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:36.677 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2023-10-05T19:50:36.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2023-10-05T19:50:36.678 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2023-10-05T19:50:36.714 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:36.714 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:36.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 Processor -- start 2023-10-05T19:50:36.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 -- start start 2023-10-05T19:50:36.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557452448120 0x55745244a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55745238ebd0 con 0x557452443b50 2023-10-05T19:50:36.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55745234bee0 con 0x557452448120 2023-10-05T19:50:36.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab3898700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557452448120 0x55745244a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab3898700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557452448120 0x55745244a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45140/0 (socket says 172.21.15.167:45140) 2023-10-05T19:50:36.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab4099700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x557452443b50 0x557452443f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51612/0 (socket says 172.21.15.167:51612) 2023-10-05T19:50:36.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab3898700 1 -- 172.21.15.167:0/262538146 learned_addr learned my addr 172.21.15.167:0/262538146 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab3898700 1 -- 172.21.15.167:0/262538146 >> v1:172.21.15.118:6789/0 conn(0x557452443b50 legacy=0x557452443f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab3898700 1 -- 172.21.15.167:0/262538146 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557452444760 con 0x557452448120 2023-10-05T19:50:36.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab3898700 1 --2- 172.21.15.167:0/262538146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452448120 0x55745244a500 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00a5c0 tx=0x7f7a9c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da37f87d38597d1b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab3097700 1 -- 172.21.15.167:0/262538146 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a9c00e510 con 0x557452448120 2023-10-05T19:50:36.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab3097700 1 -- 172.21.15.167:0/262538146 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c00e670 con 0x557452448120 2023-10-05T19:50:36.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab3097700 1 -- 172.21.15.167:0/262538146 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a9c00e920 con 0x557452448120 2023-10-05T19:50:36.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 -- 172.21.15.167:0/262538146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452448120 msgr2=0x55745244a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/262538146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452448120 0x55745244a500 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00a5c0 tx=0x7f7a9c005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:36.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 -- 172.21.15.167:0/262538146 shutdown_connections 2023-10-05T19:50:36.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/262538146 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452448120 0x55745244a500 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 -- 172.21.15.167:0/262538146 >> 172.21.15.167:0/262538146 conn(0x5574523b75c0 msgr2=0x5574523b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 -- 172.21.15.167:0/262538146 shutdown_connections 2023-10-05T19:50:36.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 -- 172.21.15.167:0/262538146 wait complete. 2023-10-05T19:50:36.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.709+0000 7f7ab6564e40 1 Processor -- start 2023-10-05T19:50:36.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 -- start start 2023-10-05T19:50:36.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452462bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745230fe30 con 0x557452443b50 2023-10-05T19:50:36.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab4099700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452462bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab4099700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452462bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45142/0 (socket says 172.21.15.167:45142) 2023-10-05T19:50:36.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab4099700 1 -- 172.21.15.167:0/1805525774 learned_addr learned my addr 172.21.15.167:0/1805525774 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab4099700 1 -- 172.21.15.167:0/1805525774 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c00a180 con 0x557452443b50 2023-10-05T19:50:36.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab4099700 1 --2- 172.21.15.167:0/1805525774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452462bd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4001cf0 tx=0x7f7aa40018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80732de011c980f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab2095700 1 -- 172.21.15.167:0/1805525774 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7aa4014070 con 0x557452443b50 2023-10-05T19:50:36.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab2095700 1 -- 172.21.15.167:0/1805525774 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa400be10 con 0x557452443b50 2023-10-05T19:50:36.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab2095700 1 -- 172.21.15.167:0/1805525774 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7aa400f590 con 0x557452443b50 2023-10-05T19:50:36.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1805525774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 msgr2=0x557452462bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1805525774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452462bd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4001cf0 tx=0x7f7aa40018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1805525774 shutdown_connections 2023-10-05T19:50:36.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1805525774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452462bd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1805525774 >> 172.21.15.167:0/1805525774 conn(0x5574523b75c0 msgr2=0x55745245e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1805525774 shutdown_connections 2023-10-05T19:50:36.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1805525774 wait complete. 2023-10-05T19:50:36.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 Processor -- start 2023-10-05T19:50:36.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.713+0000 7f7ab6564e40 1 -- start start 2023-10-05T19:50:36.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab6564e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452469970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab6564e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574522e2ed0 con 0x557452443b50 2023-10-05T19:50:36.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab4099700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452469970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab4099700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452469970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45146/0 (socket says 172.21.15.167:45146) 2023-10-05T19:50:36.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 learned_addr learned my addr 172.21.15.167:0/1371498010 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55745238ebd0 con 0x557452443b50 2023-10-05T19:50:36.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab4099700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452469970 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40018e0 tx=0x7f7aa4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab0892700 1 -- 172.21.15.167:0/1371498010 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7aa401c740 con 0x557452443b50 2023-10-05T19:50:36.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab0892700 1 -- 172.21.15.167:0/1371498010 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa401c8a0 con 0x557452443b50 2023-10-05T19:50:36.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557452469eb0 con 0x557452443b50 2023-10-05T19:50:36.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab0892700 1 -- 172.21.15.167:0/1371498010 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7aa401cb90 con 0x557452443b50 2023-10-05T19:50:36.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55745246a2f0 con 0x557452443b50 2023-10-05T19:50:36.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.717+0000 7f7ab0892700 1 -- 172.21.15.167:0/1371498010 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7aa4023020 con 0x557452443b50 2023-10-05T19:50:36.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab0892700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a98030c50 0x7f7a98033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab0892700 1 -- 172.21.15.167:0/1371498010 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f7aa4008030 con 0x557452443b50 2023-10-05T19:50:36.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab3898700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a98030c50 0x7f7a98033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557452448120 0x557452475430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452475b30 con 0x557452448120 2023-10-05T19:50:36.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab489a700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557452448120 0x557452475430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab3898700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a98030c50 0x7f7a98033100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c000f80 tx=0x7f7a9c013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab489a700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557452448120 0x557452475430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7aac00a500 con 0x557452448120 2023-10-05T19:50:36.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 20 realm 2023-10-05T19:50:36.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452472a90 con 0x557452448120 2023-10-05T19:50:36.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7aac00a500 con 0x557452448120 2023-10-05T19:50:36.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:36.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452476610 con 0x557452448120 2023-10-05T19:50:36.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7aac00a500 con 0x557452448120 2023-10-05T19:50:36.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557452476240 0x557452479480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.721+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452479bb0 con 0x557452476240 2023-10-05T19:50:36.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab4099700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557452476240 0x557452479480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab4099700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557452476240 0x557452479480 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247a480 con 0x557452448120 2023-10-05T19:50:36.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7aac00a500 con 0x557452448120 2023-10-05T19:50:36.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab6564e40 20 searching for the correct realm 2023-10-05T19:50:36.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557452479ff0 0x55745247e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452479ff0 2023-10-05T19:50:36.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab3898700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557452479ff0 0x55745247e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab3898700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557452479ff0 0x55745247e250 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.725+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452476240 2023-10-05T19:50:36.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab4099700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7aa401a070 0x7f7aa4042270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x7f7aa401a070 2023-10-05T19:50:36.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab489a700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7aa401a070 0x7f7aa4042270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab489a700 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7aa401a070 0x7f7aa4042270 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x7f7aa401a070 2023-10-05T19:50:36.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452479ff0 2023-10-05T19:50:36.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.729+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452476240 2023-10-05T19:50:36.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452476240 2023-10-05T19:50:36.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x7f7aa401a070 2023-10-05T19:50:36.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x7f7aa401a070 2023-10-05T19:50:36.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x7f7aa401a070 2023-10-05T19:50:36.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x7f7aa401a070 2023-10-05T19:50:36.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.733+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452476240 2023-10-05T19:50:36.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452479ff0 2023-10-05T19:50:36.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452476240 2023-10-05T19:50:36.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452479ff0 2023-10-05T19:50:36.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.737+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452479ff0 2023-10-05T19:50:36.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x7f7aa401a070 2023-10-05T19:50:36.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x7f7aa401a070 2023-10-05T19:50:36.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452448120 2023-10-05T19:50:36.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x7f7aa401a070 2023-10-05T19:50:36.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x7f7aa401a070 2023-10-05T19:50:36.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452479ff0 2023-10-05T19:50:36.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x7f7aa401a070 2023-10-05T19:50:36.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x7f7aa401a070 2023-10-05T19:50:36.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.741+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452476240 2023-10-05T19:50:36.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452476240 2023-10-05T19:50:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452479ff0 2023-10-05T19:50:36.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452476240 2023-10-05T19:50:36.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247e830 con 0x557452476240 2023-10-05T19:50:36.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab6564e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab6564e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab6564e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab6564e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.745+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247aff0 con 0x557452448120 2023-10-05T19:50:36.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247b480 con 0x557452476240 2023-10-05T19:50:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247b8b0 con 0x557452476240 2023-10-05T19:50:36.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f190 con 0x557452479ff0 2023-10-05T19:50:36.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.749+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f8f0 con 0x557452476240 2023-10-05T19:50:36.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452480cb0 con 0x557452479ff0 2023-10-05T19:50:36.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452480cb0 con 0x557452476240 2023-10-05T19:50:36.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452480cb0 con 0x7f7aa401a070 2023-10-05T19:50:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x7f7aa401a070 2023-10-05T19:50:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.753+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452479ff0 2023-10-05T19:50:36.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452476240 2023-10-05T19:50:36.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452476240 2023-10-05T19:50:36.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.757+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x7f7aa401a070 2023-10-05T19:50:36.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x7f7aa401a070 2023-10-05T19:50:36.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x7f7aa401a070 2023-10-05T19:50:36.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x7f7aa401a070 2023-10-05T19:50:36.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452476240 2023-10-05T19:50:36.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452479ff0 2023-10-05T19:50:36.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.761+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452476240 2023-10-05T19:50:36.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452479ff0 2023-10-05T19:50:36.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac014040 con 0x557452448120 2023-10-05T19:50:36.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452479ff0 2023-10-05T19:50:36.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x7f7aa401a070 2023-10-05T19:50:36.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452448120 2023-10-05T19:50:36.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.765+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x7f7aa401a070 2023-10-05T19:50:36.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452479ff0 2023-10-05T19:50:36.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x7f7aa401a070 2023-10-05T19:50:36.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452476240 2023-10-05T19:50:36.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452476240 2023-10-05T19:50:36.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.769+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452479ff0 2023-10-05T19:50:36.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452476240 2023-10-05T19:50:36.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247f540 con 0x557452476240 2023-10-05T19:50:36.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55745247fca0 con 0x557452476240 2023-10-05T19:50:36.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452480050 con 0x557452448120 2023-10-05T19:50:36.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.773+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5574524808f0 con 0x557452476240 2023-10-05T19:50:36.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5574524808f0 con 0x557452476240 2023-10-05T19:50:36.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452480920 con 0x7f7aa401a070 2023-10-05T19:50:36.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 zone default found 2023-10-05T19:50:36.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 4 Realm: () 2023-10-05T19:50:36.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:36.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:36.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:36.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 zonegroup default 2023-10-05T19:50:36.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452480920 con 0x7f7aa401a070 2023-10-05T19:50:36.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5574524822a0 con 0x557452479ff0 2023-10-05T19:50:36.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.777+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452482650 con 0x557452479ff0 2023-10-05T19:50:36.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.781+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.781+0000 7f7ab6564e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.781+0000 7f7ab6564e40 20 started sync module instance, tier type = 2023-10-05T19:50:36.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.781+0000 7f7ab6564e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:36.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.781+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452481960 con 0x557452476240 2023-10-05T19:50:36.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.781+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.781+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93958085022832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452481e80 con 0x557452476240 2023-10-05T19:50:36.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.781+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5574524833e0 con 0x557452448120 2023-10-05T19:50:36.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.785+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93958085022832] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.785+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.785+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93958085028352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452481e80 con 0x557452448120 2023-10-05T19:50:36.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.785+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5574524839a0 con 0x557452476240 2023-10-05T19:50:36.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.785+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93958085028352] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.785+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.785+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93958085029456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5574524839a0 con 0x557452476240 2023-10-05T19:50:36.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.785+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452484240 con 0x7f7aa401a070 2023-10-05T19:50:36.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.789+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93958085029456] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.789+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.789+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93958085031376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452483f10 con 0x7f7aa401a070 2023-10-05T19:50:36.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.789+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452484a70 con 0x557452476240 2023-10-05T19:50:36.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.789+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93958085031376] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93958085035328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452483f10 con 0x557452476240 2023-10-05T19:50:36.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5574524854d0 con 0x557452479ff0 2023-10-05T19:50:36.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93958085038048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452485d70 con 0x557452479ff0 2023-10-05T19:50:36.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452486780 con 0x557452479ff0 2023-10-05T19:50:36.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93958085035328] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 93958085038048] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.793+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93958085042832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452486b80 con 0x557452479ff0 2023-10-05T19:50:36.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452487420 con 0x7f7aa401a070 2023-10-05T19:50:36.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93958085046624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452487ae0 con 0x7f7aa401a070 2023-10-05T19:50:36.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 20 add_watcher() i=0 2023-10-05T19:50:36.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 20 add_watcher() i=1 2023-10-05T19:50:36.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 20 add_watcher() i=2 2023-10-05T19:50:36.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 20 add_watcher() i=3 2023-10-05T19:50:36.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 20 add_watcher() i=4 2023-10-05T19:50:36.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 20 add_watcher() i=5 2023-10-05T19:50:36.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93958085042832] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a9c017050 con 0x557452479ff0 2023-10-05T19:50:36.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 20 add_watcher() i=6 2023-10-05T19:50:36.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93958085046624] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 20 add_watcher() i=7 2023-10-05T19:50:36.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:36.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452483a20 con 0x557452448120 2023-10-05T19:50:36.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.797+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93958085047728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452487fa0 con 0x557452448120 2023-10-05T19:50:36.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93958085047728] v30'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7a84ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab6564e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:36.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab6564e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:36.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab6564e40 1 Processor -- start 2023-10-05T19:50:36.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab6564e40 1 -- start start 2023-10-05T19:50:36.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab6564e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x5574524951c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab6564e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557452495700 con 0x557452494df0 2023-10-05T19:50:36.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab3898700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x5574524951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab3898700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x5574524951c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45160/0 (socket says 172.21.15.167:45160) 2023-10-05T19:50:36.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab3898700 1 -- 172.21.15.167:0/3385111258 learned_addr learned my addr 172.21.15.167:0/3385111258 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab3898700 1 -- 172.21.15.167:0/3385111258 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557452495840 con 0x557452494df0 2023-10-05T19:50:36.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f7ab3898700 1 --2- 172.21.15.167:0/3385111258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x5574524951c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c003000 tx=0x7f7a9c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3034eb85048140 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f79fffff700 1 -- 172.21.15.167:0/3385111258 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a9c02d040 con 0x557452494df0 2023-10-05T19:50:36.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f79fffff700 1 -- 172.21.15.167:0/3385111258 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c010b30 con 0x557452494df0 2023-10-05T19:50:36.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.801+0000 7f79fffff700 1 -- 172.21.15.167:0/3385111258 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a9c010cc0 con 0x557452494df0 2023-10-05T19:50:36.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 -- 172.21.15.167:0/3385111258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 msgr2=0x5574524951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/3385111258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x5574524951c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c003000 tx=0x7f7a9c010000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 -- 172.21.15.167:0/3385111258 shutdown_connections 2023-10-05T19:50:36.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/3385111258 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x5574524951c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 -- 172.21.15.167:0/3385111258 >> 172.21.15.167:0/3385111258 conn(0x5574524901b0 msgr2=0x55745248e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 -- 172.21.15.167:0/3385111258 shutdown_connections 2023-10-05T19:50:36.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 -- 172.21.15.167:0/3385111258 wait complete. 2023-10-05T19:50:36.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 Processor -- start 2023-10-05T19:50:36.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 -- start start 2023-10-05T19:50:36.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x55745249a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745249b7b0 con 0x557452494df0 2023-10-05T19:50:36.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab3898700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x55745249a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab3898700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x55745249a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45166/0 (socket says 172.21.15.167:45166) 2023-10-05T19:50:36.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab3898700 1 -- 172.21.15.167:0/978105164 learned_addr learned my addr 172.21.15.167:0/978105164 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab3898700 1 -- 172.21.15.167:0/978105164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557452444760 con 0x557452494df0 2023-10-05T19:50:36.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab3898700 1 --2- 172.21.15.167:0/978105164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x55745249a7b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00ea70 tx=0x7f7a9c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f79fe7fc700 1 -- 172.21.15.167:0/978105164 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a9c033430 con 0x557452494df0 2023-10-05T19:50:36.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f79fe7fc700 1 -- 172.21.15.167:0/978105164 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c0335b0 con 0x557452494df0 2023-10-05T19:50:36.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 -- 172.21.15.167:0/978105164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55745249adb0 con 0x557452494df0 2023-10-05T19:50:36.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f79fe7fc700 1 -- 172.21.15.167:0/978105164 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a9c033760 con 0x557452494df0 2023-10-05T19:50:36.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.805+0000 7f7ab6564e40 1 -- 172.21.15.167:0/978105164 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55745249b1f0 con 0x557452494df0 2023-10-05T19:50:36.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.809+0000 7f79fe7fc700 1 -- 172.21.15.167:0/978105164 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7a9c033a20 con 0x557452494df0 2023-10-05T19:50:36.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.809+0000 7f79fe7fc700 1 --2- 172.21.15.167:0/978105164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79f4030bb0 0x7f79f4033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.809+0000 7f79fe7fc700 1 -- 172.21.15.167:0/978105164 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f7a9c046c20 con 0x557452494df0 2023-10-05T19:50:36.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.809+0000 7f7ab489a700 1 --2- 172.21.15.167:0/978105164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79f4030bb0 0x7f79f4033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.809+0000 7f7ab6564e40 5 note: GC not initialized 2023-10-05T19:50:36.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.809+0000 7f7ab489a700 1 --2- 172.21.15.167:0/978105164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79f4030bb0 0x7f79f4033060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x557452487a30 tx=0x7f7aac00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f79f37fe700 20 reqs_thread_entry: start 2023-10-05T19:50:36.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:36.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f79f17fa700 20 reqs_thread_entry: start 2023-10-05T19:50:36.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:36.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f79deffd700 20 reqs_thread_entry: start 2023-10-05T19:50:36.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 20 get_system_obj_state: rctx=0x7ffd862c8788 obj=default.rgw.meta:users.uid:foo state=0x55745231b0b0 s->prefetch_data=0 2023-10-05T19:50:36.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452503040 con 0x557452448120 2023-10-05T19:50:36.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f79df7fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:07 2023 2023-10-05T19:50:36.820 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:36.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:36.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:36.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452505ad0 con 0x557452448120 2023-10-05T19:50:36.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:36.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452504ac0 con 0x7f7aa401a070 2023-10-05T19:50:36.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.813+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.817+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93958085022832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5574524c1430 con 0x557452476240 2023-10-05T19:50:36.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.817+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 93958085022832] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.817+0000 7f7ab6564e40 20 remove_watcher() i=0 2023-10-05T19:50:36.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.817+0000 7f7ab6564e40 2 removed watcher, disabling cache 2023-10-05T19:50:36.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.817+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93958085028352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452481470 con 0x557452448120 2023-10-05T19:50:36.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.821+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 93958085028352] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.821+0000 7f7ab6564e40 20 remove_watcher() i=1 2023-10-05T19:50:36.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.821+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93958085029456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452481470 con 0x557452476240 2023-10-05T19:50:36.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.821+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 93958085029456] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.821+0000 7f7ab6564e40 20 remove_watcher() i=2 2023-10-05T19:50:36.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.821+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93958085031376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452482ef0 con 0x7f7aa401a070 2023-10-05T19:50:36.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.825+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 93958085031376] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.825+0000 7f7ab6564e40 20 remove_watcher() i=3 2023-10-05T19:50:36.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.825+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93958085035328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452482ef0 con 0x557452476240 2023-10-05T19:50:36.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.825+0000 7f7ab4099700 1 -- 172.21.15.167:0/1371498010 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 93958085035328] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aa4016070 con 0x557452476240 2023-10-05T19:50:36.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.825+0000 7f7ab6564e40 20 remove_watcher() i=4 2023-10-05T19:50:36.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.825+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93958085038048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452482ef0 con 0x557452479ff0 2023-10-05T19:50:36.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.829+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 93958085038048] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a9c042070 con 0x557452479ff0 2023-10-05T19:50:36.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.829+0000 7f7ab6564e40 20 remove_watcher() i=5 2023-10-05T19:50:36.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.829+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93958085042832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452482ef0 con 0x557452479ff0 2023-10-05T19:50:36.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.829+0000 7f7ab3898700 1 -- 172.21.15.167:0/1371498010 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 93958085042832] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a9c042070 con 0x557452479ff0 2023-10-05T19:50:36.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.829+0000 7f7ab6564e40 20 remove_watcher() i=6 2023-10-05T19:50:36.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.829+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93958085046624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557452482ef0 con 0x7f7aa401a070 2023-10-05T19:50:36.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.833+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 93958085046624] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x7f7aa401a070 2023-10-05T19:50:36.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.833+0000 7f7ab6564e40 20 remove_watcher() i=7 2023-10-05T19:50:36.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.833+0000 7f7a84ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:36.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.833+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93958085047728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5574524c23c0 con 0x557452448120 2023-10-05T19:50:36.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 93958085047728] v30'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7aac033040 con 0x557452448120 2023-10-05T19:50:36.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557452476240 msgr2=0x557452479480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557452476240 0x557452479480 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557452448120 msgr2=0x557452475430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557452448120 0x557452475430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7aa401a070 msgr2=0x7f7aa4042270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7aa401a070 0x7f7aa4042270 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557452479ff0 msgr2=0x55745247e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557452479ff0 0x55745247e250 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a98030c50 msgr2=0x7f7a98033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a98030c50 0x7f7a98033100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c000f80 tx=0x7f7a9c013000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab489a700 1 -- 172.21.15.167:0/1371498010 reap_dead start 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 msgr2=0x557452469970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452469970 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40018e0 tx=0x7f7aa4016000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 shutdown_connections 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/1371498010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452443b50 0x557452469970 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 >> 172.21.15.167:0/1371498010 conn(0x5574523b75c0 msgr2=0x55745245d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 shutdown_connections 2023-10-05T19:50:36.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/1371498010 wait complete. 2023-10-05T19:50:36.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/978105164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79f4030bb0 msgr2=0x7f79f4033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/978105164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79f4030bb0 0x7f79f4033060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x557452487a30 tx=0x7f7aac00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:36.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/978105164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 msgr2=0x55745249a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/978105164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x55745249a7b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00ea70 tx=0x7f7a9c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:36.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/978105164 shutdown_connections 2023-10-05T19:50:36.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/978105164 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79f4030bb0 0x7f79f4033060 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 --2- 172.21.15.167:0/978105164 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557452494df0 0x55745249a7b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/978105164 >> 172.21.15.167:0/978105164 conn(0x5574524901b0 msgr2=0x55745248e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/978105164 shutdown_connections 2023-10-05T19:50:36.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.837+0000 7f7ab6564e40 1 -- 172.21.15.167:0/978105164 wait complete. 2023-10-05T19:50:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:[ 2023-10-05T19:50:36.848 INFO:teuthology.orchestra.run.smithi167.stdout: "myfoo" 2023-10-05T19:50:36.848 INFO:teuthology.orchestra.run.smithi167.stdout:] 2023-10-05T19:50:36.850 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2023-10-05T19:50:36.854 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:36.854 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2023-10-05T19:50:36.855 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2023-10-05T19:50:36.855 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2023-10-05T19:50:36.932 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:36.932 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:36.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.925+0000 7f5d12aa7e40 1 Processor -- start 2023-10-05T19:50:36.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.925+0000 7f5d12aa7e40 1 -- start start 2023-10-05T19:50:36.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.925+0000 7f5d12aa7e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x556019fab0e0 0x556019fad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.925+0000 7f5d12aa7e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556019ef1c00 con 0x556019fa6b60 2023-10-05T19:50:36.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.925+0000 7f5d12aa7e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x556019eaeee0 con 0x556019fab0e0 2023-10-05T19:50:36.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.925+0000 7f5d105dc700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x556019fa6b60 0x556019fa6f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51624/0 (socket says 172.21.15.167:51624) 2023-10-05T19:50:36.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.925+0000 7f5d0fddb700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x556019fab0e0 0x556019fad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d105dc700 1 -- 172.21.15.167:0/702934015 learned_addr learned my addr 172.21.15.167:0/702934015 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:36.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d0f5da700 1 -- 172.21.15.167:0/702934015 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181508630 0 0) 0x556019ef1c00 con 0x556019fa6b60 2023-10-05T19:50:36.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d0f5da700 1 -- 172.21.15.167:0/702934015 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf0001e10 con 0x556019fa6b60 2023-10-05T19:50:36.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d0fddb700 1 -- 172.21.15.167:0/702934015 >> v1:172.21.15.118:6789/0 conn(0x556019fa6b60 legacy=0x556019fa6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d0fddb700 1 -- 172.21.15.167:0/702934015 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556019fa7770 con 0x556019fab0e0 2023-10-05T19:50:36.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d0fddb700 1 --2- 172.21.15.167:0/702934015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 0x556019fad4c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800a5d0 tx=0x7f5cf8005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f27ea0c6e86562 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d0f5da700 1 -- 172.21.15.167:0/702934015 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf8007610 con 0x556019fab0e0 2023-10-05T19:50:36.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d0f5da700 1 -- 172.21.15.167:0/702934015 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8007770 con 0x556019fab0e0 2023-10-05T19:50:36.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d0f5da700 1 -- 172.21.15.167:0/702934015 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf8007a20 con 0x556019fab0e0 2023-10-05T19:50:36.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/702934015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 msgr2=0x556019fad4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/702934015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 0x556019fad4c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800a5d0 tx=0x7f5cf8005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:36.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/702934015 shutdown_connections 2023-10-05T19:50:36.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/702934015 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 0x556019fad4c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/702934015 >> 172.21.15.167:0/702934015 conn(0x556019f1a510 msgr2=0x556019fa4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/702934015 shutdown_connections 2023-10-05T19:50:36.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/702934015 wait complete. 2023-10-05T19:50:36.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 Processor -- start 2023-10-05T19:50:36.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 -- start start 2023-10-05T19:50:36.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fa6b60 0x556019fc5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d12aa7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556019e72e30 con 0x556019fa6b60 2023-10-05T19:50:36.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d105dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fa6b60 0x556019fc5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.929+0000 7f5d105dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fa6b60 0x556019fc5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45188/0 (socket says 172.21.15.167:45188) 2023-10-05T19:50:36.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d105dc700 1 -- 172.21.15.167:0/2855874297 learned_addr learned my addr 172.21.15.167:0/2855874297 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d105dc700 1 -- 172.21.15.167:0/2855874297 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8005cf0 con 0x556019fa6b60 2023-10-05T19:50:36.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d105dc700 1 --2- 172.21.15.167:0/2855874297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fa6b60 0x556019fc5a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5d00001c30 tx=0x7f5d00001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24463efa6e88cac5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d0e5d8700 1 -- 172.21.15.167:0/2855874297 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d0000bbf0 con 0x556019fa6b60 2023-10-05T19:50:36.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d0e5d8700 1 -- 172.21.15.167:0/2855874297 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0000bd50 con 0x556019fa6b60 2023-10-05T19:50:36.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d0e5d8700 1 -- 172.21.15.167:0/2855874297 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d0000e470 con 0x556019fa6b60 2023-10-05T19:50:36.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2855874297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fa6b60 msgr2=0x556019fc5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:36.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/2855874297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fa6b60 0x556019fc5a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5d00001c30 tx=0x7f5d00001810 comp rx=0 tx=0).stop 2023-10-05T19:50:36.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2855874297 shutdown_connections 2023-10-05T19:50:36.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/2855874297 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fa6b60 0x556019fc5a20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:36.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2855874297 >> 172.21.15.167:0/2855874297 conn(0x556019f1a510 msgr2=0x556019fc15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:36.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2855874297 shutdown_connections 2023-10-05T19:50:36.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2855874297 wait complete. 2023-10-05T19:50:36.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 Processor -- start 2023-10-05T19:50:36.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 -- start start 2023-10-05T19:50:36.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 0x556019fd0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d12aa7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556019e45ed0 con 0x556019fab0e0 2023-10-05T19:50:36.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d105dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 0x556019fd0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d105dc700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 0x556019fd0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45190/0 (socket says 172.21.15.167:45190) 2023-10-05T19:50:36.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 learned_addr learned my addr 172.21.15.167:0/1668907887 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:36.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.933+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf0001e10 con 0x556019fab0e0 2023-10-05T19:50:36.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d105dc700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 0x556019fd0d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x556019fc2100 tx=0x7f5d00014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d0cdd5700 1 -- 172.21.15.167:0/1668907887 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d0001f070 con 0x556019fab0e0 2023-10-05T19:50:36.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d0cdd5700 1 -- 172.21.15.167:0/1668907887 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0001a2e0 con 0x556019fab0e0 2023-10-05T19:50:36.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d0cdd5700 1 -- 172.21.15.167:0/1668907887 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d0000bec0 con 0x556019fab0e0 2023-10-05T19:50:36.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556019fd12c0 con 0x556019fab0e0 2023-10-05T19:50:36.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556019fd1700 con 0x556019fab0e0 2023-10-05T19:50:36.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d0cdd5700 1 -- 172.21.15.167:0/1668907887 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5d0001a9e0 con 0x556019fab0e0 2023-10-05T19:50:36.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d0cdd5700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5cf4030c00 0x7f5cf40330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d0cdd5700 1 -- 172.21.15.167:0/1668907887 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f5d00044f50 con 0x556019fab0e0 2023-10-05T19:50:36.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556019fda800 0x556019fdcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d0fddb700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5cf4030c00 0x7f5cf40330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fdd290 con 0x556019fda800 2023-10-05T19:50:36.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d10ddd700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556019fda800 0x556019fdcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d10ddd700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556019fda800 0x556019fdcbe0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.937+0000 7f5d0fddb700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5cf4030c00 0x7f5cf40330b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80030c0 tx=0x7f5cf8014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 realm 2023-10-05T19:50:36.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fd9e30 con 0x556019fda800 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fddd70 con 0x556019fda800 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556019fdd970 0x556019fe0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe1280 con 0x556019fdd970 2023-10-05T19:50:36.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d105dc700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556019fdd970 0x556019fe0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d105dc700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556019fdd970 0x556019fe0b80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe1b50 con 0x556019fda800 2023-10-05T19:50:36.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:36.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 20 searching for the correct realm 2023-10-05T19:50:36.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556019fe16c0 0x556019fe5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fe16c0 2023-10-05T19:50:36.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.941+0000 7f5d0fddb700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556019fe16c0 0x556019fe5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d0fddb700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556019fe16c0 0x556019fe5920 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf80079f0 con 0x556019fe16c0 2023-10-05T19:50:36.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fdd970 2023-10-05T19:50:36.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d105dc700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x556019fa6b60 0x7f5d000167e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:36.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fa6b60 2023-10-05T19:50:36.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d10ddd700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x556019fa6b60 0x7f5d000167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:36.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d10ddd700 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x556019fa6b60 0x7f5d000167e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:36.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.945+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fe16c0 2023-10-05T19:50:36.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fdd970 2023-10-05T19:50:36.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fdd970 2023-10-05T19:50:36.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fa6b60 2023-10-05T19:50:36.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.949+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fa6b60 2023-10-05T19:50:36.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fdd970 2023-10-05T19:50:36.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fe16c0 2023-10-05T19:50:36.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fdd970 2023-10-05T19:50:36.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fe16c0 2023-10-05T19:50:36.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.953+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fe16c0 2023-10-05T19:50:36.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fa6b60 2023-10-05T19:50:36.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fda800 2023-10-05T19:50:36.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fa6b60 2023-10-05T19:50:36.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.957+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fe16c0 2023-10-05T19:50:36.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fa6b60 2023-10-05T19:50:36.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fdd970 2023-10-05T19:50:36.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fdd970 2023-10-05T19:50:36.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fe16c0 2023-10-05T19:50:36.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fdd970 2023-10-05T19:50:36.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.961+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe5f00 con 0x556019fdd970 2023-10-05T19:50:36.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe26c0 con 0x556019fda800 2023-10-05T19:50:36.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe3010 con 0x556019fdd970 2023-10-05T19:50:36.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe2280 con 0x556019fdd970 2023-10-05T19:50:36.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:36.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe6860 con 0x556019fe16c0 2023-10-05T19:50:36.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.965+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe6c10 con 0x556019fda800 2023-10-05T19:50:36.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:36.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe6fc0 con 0x556019fdd970 2023-10-05T19:50:36.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d12aa7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fe16c0 2023-10-05T19:50:36.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fdd970 2023-10-05T19:50:36.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fa6b60 2023-10-05T19:50:36.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.969+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fe16c0 2023-10-05T19:50:36.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fdd970 2023-10-05T19:50:36.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fdd970 2023-10-05T19:50:36.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.973+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fa6b60 2023-10-05T19:50:36.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fa6b60 2023-10-05T19:50:36.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fdd970 2023-10-05T19:50:36.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fe16c0 2023-10-05T19:50:36.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.977+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fdd970 2023-10-05T19:50:36.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fe16c0 2023-10-05T19:50:36.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.981+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fe16c0 2023-10-05T19:50:36.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fa6b60 2023-10-05T19:50:36.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fda800 2023-10-05T19:50:36.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:36.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fa6b60 2023-10-05T19:50:36.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fe16c0 2023-10-05T19:50:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fa6b60 2023-10-05T19:50:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:36.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fdd970 2023-10-05T19:50:36.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.985+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fdd970 2023-10-05T19:50:36.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fe16c0 2023-10-05T19:50:36.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:36.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fdd970 2023-10-05T19:50:36.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe8380 con 0x556019fdd970 2023-10-05T19:50:36.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:36.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:36.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:36.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:36.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.989+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7370 con 0x556019fdd970 2023-10-05T19:50:36.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:36.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:36.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:36.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fda800 2023-10-05T19:50:36.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:37.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:37.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe63d0 con 0x556019fdd970 2023-10-05T19:50:37.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe63d0 con 0x556019fdd970 2023-10-05T19:50:37.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:37.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe63d0 con 0x556019fa6b60 2023-10-05T19:50:37.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:37.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 zone default found 2023-10-05T19:50:37.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 4 Realm: () 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 zonegroup default 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe63d0 con 0x556019fa6b60 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.993+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe63d0 con 0x556019fe16c0 2023-10-05T19:50:37.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:37.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d12aa7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fea0b0 con 0x556019fe16c0 2023-10-05T19:50:37.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:37.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d12aa7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d12aa7e40 20 started sync module instance, tier type = 2023-10-05T19:50:37.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d12aa7e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:37.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe9770 con 0x556019fdd970 2023-10-05T19:50:37.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:36.997+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.001+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93871241329440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fea460 con 0x556019fdd970 2023-10-05T19:50:37.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.001+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fead00 con 0x556019fda800 2023-10-05T19:50:37.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.001+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:37.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.001+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93871241329440] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.001+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93871241337712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fea950 con 0x556019fda800 2023-10-05T19:50:37.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.001+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019feb3a0 con 0x556019fdd970 2023-10-05T19:50:37.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.005+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93871241337712] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:37.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.005+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.005+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93871241342576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fea950 con 0x556019fdd970 2023-10-05T19:50:37.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.005+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019febc90 con 0x556019fa6b60 2023-10-05T19:50:37.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.005+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:37.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.005+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93871241342576] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.005+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93871241344928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fec0e0 con 0x556019fa6b60 2023-10-05T19:50:37.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.005+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fec980 con 0x556019fdd970 2023-10-05T19:50:37.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.009+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.009+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93871241347296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019feca20 con 0x556019fdd970 2023-10-05T19:50:37.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.009+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93871241344928] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:37.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.009+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fed430 con 0x556019fe16c0 2023-10-05T19:50:37.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.009+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93871241347296] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.009+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:37.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.009+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93871241346032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019feca20 con 0x556019fe16c0 2023-10-05T19:50:37.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.009+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fedcd0 con 0x556019fe16c0 2023-10-05T19:50:37.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:37.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 93871241346032] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:37.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93871241355392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fee9c0 con 0x556019fe16c0 2023-10-05T19:50:37.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fef260 con 0x556019fa6b60 2023-10-05T19:50:37.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93871241355392] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:37.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:37.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93871241356496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fef260 con 0x556019fa6b60 2023-10-05T19:50:37.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 20 add_watcher() i=0 2023-10-05T19:50:37.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 20 add_watcher() i=1 2023-10-05T19:50:37.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 20 add_watcher() i=2 2023-10-05T19:50:37.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 20 add_watcher() i=3 2023-10-05T19:50:37.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 20 add_watcher() i=4 2023-10-05T19:50:37.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 20 add_watcher() i=5 2023-10-05T19:50:37.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 20 add_watcher() i=6 2023-10-05T19:50:37.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93871241356496] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fa6b60 2023-10-05T19:50:37.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 20 add_watcher() i=7 2023-10-05T19:50:37.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:37.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.013+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019ff2330 con 0x556019fda800 2023-10-05T19:50:37.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:37.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93871241358704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fef6b0 con 0x556019fda800 2023-10-05T19:50:37.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93871241358704] v30'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5d0800a5a0 con 0x556019fda800 2023-10-05T19:50:37.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5ce0ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:37.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d12aa7e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:37.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d12aa7e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:37.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d12aa7e40 1 Processor -- start 2023-10-05T19:50:37.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d12aa7e40 1 -- start start 2023-10-05T19:50:37.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d12aa7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x556019ffcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d12aa7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556019ffd160 con 0x556019ffc850 2023-10-05T19:50:37.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d0fddb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x556019ffcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d0fddb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x556019ffcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45196/0 (socket says 172.21.15.167:45196) 2023-10-05T19:50:37.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.017+0000 7f5d0fddb700 1 -- 172.21.15.167:0/2441334949 learned_addr learned my addr 172.21.15.167:0/2441334949 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d0fddb700 1 -- 172.21.15.167:0/2441334949 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556019ffd2a0 con 0x556019ffc850 2023-10-05T19:50:37.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d0fddb700 1 --2- 172.21.15.167:0/2441334949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x556019ffcc20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8002000 tx=0x7f5cf802d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721218033b8678c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5c5bfff700 1 -- 172.21.15.167:0/2441334949 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf8025040 con 0x556019ffc850 2023-10-05T19:50:37.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5c5bfff700 1 -- 172.21.15.167:0/2441334949 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8031050 con 0x556019ffc850 2023-10-05T19:50:37.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5c5bfff700 1 -- 172.21.15.167:0/2441334949 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf801f950 con 0x556019ffc850 2023-10-05T19:50:37.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2441334949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 msgr2=0x556019ffcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/2441334949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x556019ffcc20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8002000 tx=0x7f5cf802d040 comp rx=0 tx=0).stop 2023-10-05T19:50:37.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2441334949 shutdown_connections 2023-10-05T19:50:37.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/2441334949 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x556019ffcc20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2441334949 >> 172.21.15.167:0/2441334949 conn(0x556019ff7c10 msgr2=0x556019ff5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2441334949 shutdown_connections 2023-10-05T19:50:37.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2441334949 wait complete. 2023-10-05T19:50:37.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 Processor -- start 2023-10-05T19:50:37.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 -- start start 2023-10-05T19:50:37.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x55601a002290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d12aa7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601a003290 con 0x556019ffc850 2023-10-05T19:50:37.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d0fddb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x55601a002290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d0fddb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x55601a002290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45208/0 (socket says 172.21.15.167:45208) 2023-10-05T19:50:37.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.021+0000 7f5d0fddb700 1 -- 172.21.15.167:0/2393093804 learned_addr learned my addr 172.21.15.167:0/2393093804 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5d0fddb700 1 -- 172.21.15.167:0/2393093804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556019fa7770 con 0x556019ffc850 2023-10-05T19:50:37.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5d0fddb700 1 --2- 172.21.15.167:0/2393093804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x55601a002290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007fd0 tx=0x7f5cf8035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5c5a7fc700 1 -- 172.21.15.167:0/2393093804 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf8025040 con 0x556019ffc850 2023-10-05T19:50:37.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5c5a7fc700 1 -- 172.21.15.167:0/2393093804 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8020240 con 0x556019ffc850 2023-10-05T19:50:37.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2393093804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55601a002890 con 0x556019ffc850 2023-10-05T19:50:37.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5c5a7fc700 1 -- 172.21.15.167:0/2393093804 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5cf80203d0 con 0x556019ffc850 2023-10-05T19:50:37.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2393093804 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55601a002cd0 con 0x556019ffc850 2023-10-05T19:50:37.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5c5a7fc700 1 -- 172.21.15.167:0/2393093804 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5cf803e040 con 0x556019ffc850 2023-10-05T19:50:37.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5c5a7fc700 1 --2- 172.21.15.167:0/2393093804 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c50030c50 0x7f5c50033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5c5a7fc700 1 -- 172.21.15.167:0/2393093804 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f5cf8041cb0 con 0x556019ffc850 2023-10-05T19:50:37.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5d10ddd700 1 --2- 172.21.15.167:0/2393093804 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c50030c50 0x7f5c50033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5d12aa7e40 5 note: GC not initialized 2023-10-05T19:50:37.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.025+0000 7f5d10ddd700 1 --2- 172.21.15.167:0/2393093804 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c50030c50 0x7f5c50033100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x556019ff23b0 tx=0x7f5d0800d5f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5c4f7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:37.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5c4d7fa700 20 reqs_thread_entry: start 2023-10-05T19:50:37.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5d12aa7e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:37.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5d12aa7e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:37.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5c3b7fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:07 2023 2023-10-05T19:50:37.037 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:37.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5c3affd700 20 reqs_thread_entry: start 2023-10-05T19:50:37.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:102 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55601a06a4d0 con 0x556019fe16c0 2023-10-05T19:50:37.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(102 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:37.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fee9c0 con 0x556019fdd970 2023-10-05T19:50:37.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(103 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.029+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7370 con 0x556019fda800 2023-10-05T19:50:37.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fda800 2023-10-05T19:50:37.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(105 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fa6b60 2023-10-05T19:50:37.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(106 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fa6b60 2023-10-05T19:50:37.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fdd970 2023-10-05T19:50:37.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fda800 2023-10-05T19:50:37.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(108 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fe16c0 2023-10-05T19:50:37.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(109 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:37.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.033+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fa6b60 2023-10-05T19:50:37.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(110 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fa6b60 2023-10-05T19:50:37.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fdd970 2023-10-05T19:50:37.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(111 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fda800 2023-10-05T19:50:37.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fe16c0 2023-10-05T19:50:37.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(113 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf801f480 con 0x556019fe16c0 2023-10-05T19:50:37.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:114 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7720 con 0x556019fda800 2023-10-05T19:50:37.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(114 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fe16c0 2023-10-05T19:50:37.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(115 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf8050040 con 0x556019fe16c0 2023-10-05T19:50:37.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:116 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fa6b60 2023-10-05T19:50:37.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(116 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fa6b60 2023-10-05T19:50:37.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fe16c0 2023-10-05T19:50:37.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(117 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf8050040 con 0x556019fe16c0 2023-10-05T19:50:37.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.037+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fda800 2023-10-05T19:50:37.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(118 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fdd970 2023-10-05T19:50:37.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(119 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:120 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fa6b60 2023-10-05T19:50:37.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(120 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fa6b60 2023-10-05T19:50:37.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fdd970 2023-10-05T19:50:37.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(121 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fda800 2023-10-05T19:50:37.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(122 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:123 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fe16c0 2023-10-05T19:50:37.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(123 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf8050040 con 0x556019fe16c0 2023-10-05T19:50:37.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.041+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:124 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fa6b60 2023-10-05T19:50:37.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(124 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fa6b60 2023-10-05T19:50:37.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:125 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fda800 2023-10-05T19:50:37.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(125 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:126 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fda800 2023-10-05T19:50:37.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(126 [pgnls start_epoch 30 out=127b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:127 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fe16c0 2023-10-05T19:50:37.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(127 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf8050040 con 0x556019fe16c0 2023-10-05T19:50:37.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:128 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fe16c0 2023-10-05T19:50:37.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(128 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf8050040 con 0x556019fe16c0 2023-10-05T19:50:37.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:129 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fa6b60 2023-10-05T19:50:37.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(129 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fa6b60 2023-10-05T19:50:37.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:130 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fda800 2023-10-05T19:50:37.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(130 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.045+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:131 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fdd970 2023-10-05T19:50:37.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.049+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(131 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.049+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:132 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fe16c0 2023-10-05T19:50:37.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.049+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(132 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5cf8050040 con 0x556019fe16c0 2023-10-05T19:50:37.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.049+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:133 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d0804e040 con 0x556019fa6b60 2023-10-05T19:50:37.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.049+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(133 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fa6b60 2023-10-05T19:50:37.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.049+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got myfoo 2023-10-05T19:50:37.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.049+0000 7f5d12aa7e40 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:37.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.049+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93871241329440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55601a028e30 con 0x556019fdd970 2023-10-05T19:50:37.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.053+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 93871241329440] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.053+0000 7f5d12aa7e40 20 remove_watcher() i=0 2023-10-05T19:50:37.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.053+0000 7f5d12aa7e40 2 removed watcher, disabling cache 2023-10-05T19:50:37.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.053+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93871241337712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7b20 con 0x556019fda800 2023-10-05T19:50:37.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.053+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 93871241337712] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.053+0000 7f5d12aa7e40 20 remove_watcher() i=1 2023-10-05T19:50:37.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.053+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93871241342576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fe7b20 con 0x556019fdd970 2023-10-05T19:50:37.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.057+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 93871241342576] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.057+0000 7f5d12aa7e40 20 remove_watcher() i=2 2023-10-05T19:50:37.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.057+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93871241344928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019feae70 con 0x556019fa6b60 2023-10-05T19:50:37.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.057+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 93871241344928] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fa6b60 2023-10-05T19:50:37.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.057+0000 7f5d12aa7e40 20 remove_watcher() i=3 2023-10-05T19:50:37.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.057+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93871241347296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019feb7a0 con 0x556019fdd970 2023-10-05T19:50:37.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.061+0000 7f5d105dc700 1 -- 172.21.15.167:0/1668907887 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 93871241347296] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d00014070 con 0x556019fdd970 2023-10-05T19:50:37.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.061+0000 7f5d12aa7e40 20 remove_watcher() i=4 2023-10-05T19:50:37.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.061+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93871241346032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019fec0e0 con 0x556019fe16c0 2023-10-05T19:50:37.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.061+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 93871241346032] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf8050040 con 0x556019fe16c0 2023-10-05T19:50:37.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.061+0000 7f5d12aa7e40 20 remove_watcher() i=5 2023-10-05T19:50:37.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.061+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93871241355392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019feae70 con 0x556019fe16c0 2023-10-05T19:50:37.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.065+0000 7f5d0fddb700 1 -- 172.21.15.167:0/1668907887 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 93871241355392] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5cf8050040 con 0x556019fe16c0 2023-10-05T19:50:37.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.065+0000 7f5d12aa7e40 20 remove_watcher() i=6 2023-10-05T19:50:37.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.065+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93871241356496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019feae70 con 0x556019fa6b60 2023-10-05T19:50:37.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.065+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 93871241356496] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fa6b60 2023-10-05T19:50:37.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.065+0000 7f5d12aa7e40 20 remove_watcher() i=7 2023-10-05T19:50:37.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5ce0ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:37.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93871241358704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556019feae70 con 0x556019fda800 2023-10-05T19:50:37.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 <== osd.1 v2:172.21.15.167:6808/26775 43 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 93871241358704] v30'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5d0803d050 con 0x556019fda800 2023-10-05T19:50:37.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556019fdd970 msgr2=0x556019fe0b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556019fdd970 0x556019fe0b80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556019fda800 msgr2=0x556019fdcbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556019fda800 0x556019fdcbe0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x556019fa6b60 msgr2=0x7f5d000167e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x556019fa6b60 0x7f5d000167e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556019fe16c0 msgr2=0x556019fe5920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556019fe16c0 0x556019fe5920 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5cf4030c00 msgr2=0x7f5cf40330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5cf4030c00 0x7f5cf40330b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80030c0 tx=0x7f5cf8014000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 msgr2=0x556019fd0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/1668907887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019fab0e0 0x556019fd0d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x556019fc2100 tx=0x7f5d00014000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d10ddd700 1 -- 172.21.15.167:0/1668907887 reap_dead start 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 shutdown_connections 2023-10-05T19:50:37.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 >> 172.21.15.167:0/1668907887 conn(0x556019f1a510 msgr2=0x556019fc0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 shutdown_connections 2023-10-05T19:50:37.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/1668907887 wait complete. 2023-10-05T19:50:37.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2393093804 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c50030c50 msgr2=0x7f5c50033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/2393093804 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c50030c50 0x7f5c50033100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x556019ff23b0 tx=0x7f5d0800d5f0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2393093804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 msgr2=0x55601a002290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/2393093804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x55601a002290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007fd0 tx=0x7f5cf8035000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2393093804 shutdown_connections 2023-10-05T19:50:37.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/2393093804 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c50030c50 0x7f5c50033100 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 --2- 172.21.15.167:0/2393093804 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556019ffc850 0x55601a002290 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2393093804 >> 172.21.15.167:0/2393093804 conn(0x556019ff7c10 msgr2=0x556019ff5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2393093804 shutdown_connections 2023-10-05T19:50:37.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.069+0000 7f5d12aa7e40 1 -- 172.21.15.167:0/2393093804 wait complete. 2023-10-05T19:50:37.081 INFO:teuthology.orchestra.run.smithi167.stdout:[ 2023-10-05T19:50:37.081 INFO:teuthology.orchestra.run.smithi167.stdout: "myfoo" 2023-10-05T19:50:37.081 INFO:teuthology.orchestra.run.smithi167.stdout:] 2023-10-05T19:50:37.083 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2023-10-05T19:50:37.101 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:37.116 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:37.133 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:37.178 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=218 failed=True 2023-10-05T19:50:37.256 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:37.325 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:37.400 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:37.400 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T19:50:37.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T19:50:37.400 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2023-10-05T19:50:37.437 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:37.438 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:37.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 Processor -- start 2023-10-05T19:50:37.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- start start 2023-10-05T19:50:37.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e19749de10 0x55e1974a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e1973e6bd0 con 0x55e19740d490 2023-10-05T19:50:37.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e1973a3ee0 con 0x55e19749de10 2023-10-05T19:50:37.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619e3da700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e19749de10 0x55e1974a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619e3da700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e19749de10 0x55e1974a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45216/0 (socket says 172.21.15.167:45216) 2023-10-05T19:50:37.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619e3da700 1 -- 172.21.15.167:0/98328663 learned_addr learned my addr 172.21.15.167:0/98328663 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619ebdb700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55e19740d490 0x55e19749c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51638/0 (socket says 172.21.15.167:51638) 2023-10-05T19:50:37.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619e3da700 1 -- 172.21.15.167:0/98328663 >> v1:172.21.15.118:6789/0 conn(0x55e19740d490 legacy=0x55e19749c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619e3da700 1 -- 172.21.15.167:0/98328663 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1974a1740 con 0x55e19749de10 2023-10-05T19:50:37.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619e3da700 1 --2- 172.21.15.167:0/98328663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19749de10 0x55e1974a01f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f619400a650 tx=0x7f6194005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e0b114fb92590a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619dbd9700 1 -- 172.21.15.167:0/98328663 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6194008760 con 0x55e19749de10 2023-10-05T19:50:37.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619dbd9700 1 -- 172.21.15.167:0/98328663 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61940088c0 con 0x55e19749de10 2023-10-05T19:50:37.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f619dbd9700 1 -- 172.21.15.167:0/98328663 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6194008bb0 con 0x55e19749de10 2023-10-05T19:50:37.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- 172.21.15.167:0/98328663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19749de10 msgr2=0x55e1974a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/98328663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19749de10 0x55e1974a01f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f619400a650 tx=0x7f6194005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:37.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- 172.21.15.167:0/98328663 shutdown_connections 2023-10-05T19:50:37.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/98328663 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19749de10 0x55e1974a01f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- 172.21.15.167:0/98328663 >> 172.21.15.167:0/98328663 conn(0x55e197494240 msgr2=0x55e197496650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- 172.21.15.167:0/98328663 shutdown_connections 2023-10-05T19:50:37.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- 172.21.15.167:0/98328663 wait complete. 2023-10-05T19:50:37.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 Processor -- start 2023-10-05T19:50:37.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- start start 2023-10-05T19:50:37.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e197499c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.433+0000 7f61a10a6e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e197367e30 con 0x55e19740d490 2023-10-05T19:50:37.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619ebdb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e197499c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619ebdb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e197499c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45230/0 (socket says 172.21.15.167:45230) 2023-10-05T19:50:37.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619ebdb700 1 -- 172.21.15.167:0/2811260614 learned_addr learned my addr 172.21.15.167:0/2811260614 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619ebdb700 1 -- 172.21.15.167:0/2811260614 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6194005db0 con 0x55e19740d490 2023-10-05T19:50:37.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619ebdb700 1 --2- 172.21.15.167:0/2811260614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e197499c70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6190001cf0 tx=0x7f61900018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436f882390e8d088 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619cbd7700 1 -- 172.21.15.167:0/2811260614 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6190014070 con 0x55e19740d490 2023-10-05T19:50:37.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619cbd7700 1 -- 172.21.15.167:0/2811260614 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619000be10 con 0x55e19740d490 2023-10-05T19:50:37.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619cbd7700 1 -- 172.21.15.167:0/2811260614 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f619000f590 con 0x55e19740d490 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 -- 172.21.15.167:0/2811260614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 msgr2=0x55e197499c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/2811260614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e197499c70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6190001cf0 tx=0x7f61900018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 -- 172.21.15.167:0/2811260614 shutdown_connections 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/2811260614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e197499c70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 -- 172.21.15.167:0/2811260614 >> 172.21.15.167:0/2811260614 conn(0x55e197494240 msgr2=0x55e1974b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 -- 172.21.15.167:0/2811260614 shutdown_connections 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 -- 172.21.15.167:0/2811260614 wait complete. 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 Processor -- start 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 -- start start 2023-10-05T19:50:37.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e1974c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f61a10a6e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19733aed0 con 0x55e19740d490 2023-10-05T19:50:37.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619ebdb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e1974c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619ebdb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e1974c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45238/0 (socket says 172.21.15.167:45238) 2023-10-05T19:50:37.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 learned_addr learned my addr 172.21.15.167:0/4184185221 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.437+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1973e6bd0 con 0x55e19740d490 2023-10-05T19:50:37.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f619ebdb700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e1974c19a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61900018e0 tx=0x7f6190016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f618effd700 1 -- 172.21.15.167:0/4184185221 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f619001a690 con 0x55e19740d490 2023-10-05T19:50:37.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f618effd700 1 -- 172.21.15.167:0/4184185221 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190021070 con 0x55e19740d490 2023-10-05T19:50:37.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e1974c1ee0 con 0x55e19740d490 2023-10-05T19:50:37.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f618effd700 1 -- 172.21.15.167:0/4184185221 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f619001a970 con 0x55e19740d490 2023-10-05T19:50:37.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1974c2320 con 0x55e19740d490 2023-10-05T19:50:37.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f618effd700 1 -- 172.21.15.167:0/4184185221 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f619001aba0 con 0x55e19740d490 2023-10-05T19:50:37.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f618effd700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6184030ca0 0x7f6184033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f618effd700 1 -- 172.21.15.167:0/4184185221 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f6190008030 con 0x55e19740d490 2023-10-05T19:50:37.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f619e3da700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6184030ca0 0x7f6184033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e19749de10 0x55e1974cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974cdb60 con 0x55e19749de10 2023-10-05T19:50:37.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f619f3dc700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e19749de10 0x55e1974cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.441+0000 7f619e3da700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6184030ca0 0x7f6184033150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f61940030a0 tx=0x7f6194015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f619f3dc700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e19749de10 0x55e1974cd460 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 20 realm 2023-10-05T19:50:37.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974caa80 con 0x55e19749de10 2023-10-05T19:50:37.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:37.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974ce640 con 0x55e19749de10 2023-10-05T19:50:37.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e1974ce230 0x55e1974d1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d1bb0 con 0x55e1974ce230 2023-10-05T19:50:37.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f619ebdb700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e1974ce230 0x55e1974d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f619ebdb700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e1974ce230 0x55e1974d1480 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6190016070 con 0x55e1974ce230 2023-10-05T19:50:37.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.445+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d2480 con 0x55e19749de10 2023-10-05T19:50:37.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:37.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f61a10a6e40 20 searching for the correct realm 2023-10-05T19:50:37.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e1974d1ff0 0x55e1974d6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974d1ff0 2023-10-05T19:50:37.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619e3da700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e1974d1ff0 0x55e1974d6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619e3da700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e1974d1ff0 0x55e1974d6250 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974ce230 2023-10-05T19:50:37.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6190016070 con 0x55e1974ce230 2023-10-05T19:50:37.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619ebdb700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6190019760 0x7f619000e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x7f6190019760 2023-10-05T19:50:37.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619f3dc700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6190019760 0x7f619000e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619f3dc700 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6190019760 0x7f619000e3b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.449+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974d1ff0 2023-10-05T19:50:37.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974ce230 2023-10-05T19:50:37.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6190016070 con 0x55e1974ce230 2023-10-05T19:50:37.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974ce230 2023-10-05T19:50:37.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6190016070 con 0x55e1974ce230 2023-10-05T19:50:37.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.453+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x7f6190019760 2023-10-05T19:50:37.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x7f6190019760 2023-10-05T19:50:37.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974ce230 2023-10-05T19:50:37.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6190039040 con 0x55e1974ce230 2023-10-05T19:50:37.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974d1ff0 2023-10-05T19:50:37.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.457+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974ce230 2023-10-05T19:50:37.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6190039040 con 0x55e1974ce230 2023-10-05T19:50:37.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974d1ff0 2023-10-05T19:50:37.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.461+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974d1ff0 2023-10-05T19:50:37.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x7f6190019760 2023-10-05T19:50:37.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e19749de10 2023-10-05T19:50:37.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x7f6190019760 2023-10-05T19:50:37.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974d1ff0 2023-10-05T19:50:37.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x7f6190019760 2023-10-05T19:50:37.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.465+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974ce230 2023-10-05T19:50:37.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6190039040 con 0x55e1974ce230 2023-10-05T19:50:37.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974ce230 2023-10-05T19:50:37.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6190039040 con 0x55e1974ce230 2023-10-05T19:50:37.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974d1ff0 2023-10-05T19:50:37.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974ce230 2023-10-05T19:50:37.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6190039040 con 0x55e1974ce230 2023-10-05T19:50:37.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6830 con 0x55e1974ce230 2023-10-05T19:50:37.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6190039040 con 0x55e1974ce230 2023-10-05T19:50:37.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f61a10a6e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f61a10a6e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f61a10a6e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f61a10a6e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.469+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d2ff0 con 0x55e19749de10 2023-10-05T19:50:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d3970 con 0x55e1974ce230 2023-10-05T19:50:37.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d2be0 con 0x55e1974ce230 2023-10-05T19:50:37.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:37.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d71e0 con 0x55e1974d1ff0 2023-10-05T19:50:37.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d7590 con 0x55e19749de10 2023-10-05T19:50:37.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.473+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d7940 con 0x55e1974ce230 2023-10-05T19:50:37.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974d1ff0 2023-10-05T19:50:37.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974ce230 2023-10-05T19:50:37.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x7f6190019760 2023-10-05T19:50:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.477+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974d1ff0 2023-10-05T19:50:37.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974ce230 2023-10-05T19:50:37.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974ce230 2023-10-05T19:50:37.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.481+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x7f6190019760 2023-10-05T19:50:37.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x7f6190019760 2023-10-05T19:50:37.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974ce230 2023-10-05T19:50:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974d1ff0 2023-10-05T19:50:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.485+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974ce230 2023-10-05T19:50:37.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974d1ff0 2023-10-05T19:50:37.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974d1ff0 2023-10-05T19:50:37.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.489+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x7f6190019760 2023-10-05T19:50:37.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e19749de10 2023-10-05T19:50:37.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x7f6190019760 2023-10-05T19:50:37.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974d1ff0 2023-10-05T19:50:37.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x7f6190019760 2023-10-05T19:50:37.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974ce230 2023-10-05T19:50:37.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.493+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974ce230 2023-10-05T19:50:37.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974d1ff0 2023-10-05T19:50:37.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974ce230 2023-10-05T19:50:37.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d8d00 con 0x55e1974ce230 2023-10-05T19:50:37.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f619004b040 con 0x55e1974ce230 2023-10-05T19:50:37.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f61a10a6e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:37.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f61a10a6e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:37.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f61a10a6e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:37.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f61a10a6e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:37.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.497+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d7cf0 con 0x55e1974ce230 2023-10-05T19:50:37.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d80a0 con 0x55e19749de10 2023-10-05T19:50:37.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:37.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6d20 con 0x55e1974ce230 2023-10-05T19:50:37.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6cf0 con 0x55e1974ce230 2023-10-05T19:50:37.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:37.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6cf0 con 0x7f6190019760 2023-10-05T19:50:37.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 zone default found 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 4 Realm: () 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 zonegroup default 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.501+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6cf0 con 0x7f6190019760 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974d6cf0 con 0x55e1974d1ff0 2023-10-05T19:50:37.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974daa30 con 0x55e1974d1ff0 2023-10-05T19:50:37.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 20 started sync module instance, tier type = 2023-10-05T19:50:37.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:37.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.505+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974da0f0 con 0x55e1974ce230 2023-10-05T19:50:37.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.509+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.509+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94427394442464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974dade0 con 0x55e1974ce230 2023-10-05T19:50:37.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.509+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974db680 con 0x55e19749de10 2023-10-05T19:50:37.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.509+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.509+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94427394452960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974db7e0 con 0x55e19749de10 2023-10-05T19:50:37.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.509+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974dc310 con 0x55e1974ce230 2023-10-05T19:50:37.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.509+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94427394442464] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.513+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94427394452960] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.513+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.513+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94427394449936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974dbde0 con 0x55e1974ce230 2023-10-05T19:50:37.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.513+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974dcc00 con 0x7f6190019760 2023-10-05T19:50:37.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.513+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.513+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94427394459408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974dbde0 con 0x7f6190019760 2023-10-05T19:50:37.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.513+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94427394449936] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.513+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974dd540 con 0x55e1974ce230 2023-10-05T19:50:37.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.517+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94427394459408] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.517+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.517+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94427394454128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974dd050 con 0x55e1974ce230 2023-10-05T19:50:37.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.517+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974dd8f0 con 0x55e1974d1ff0 2023-10-05T19:50:37.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.517+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94427394454128] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.517+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.517+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94427394461072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974ddcf0 con 0x55e1974d1ff0 2023-10-05T19:50:37.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.517+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974de700 con 0x55e1974d1ff0 2023-10-05T19:50:37.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94427394468528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974df3f0 con 0x55e1974d1ff0 2023-10-05T19:50:37.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974dfe00 con 0x7f6190019760 2023-10-05T19:50:37.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94427394461072] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94427394472208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974e0250 con 0x7f6190019760 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 20 add_watcher() i=0 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 20 add_watcher() i=1 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 20 add_watcher() i=2 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 20 add_watcher() i=3 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 20 add_watcher() i=4 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 20 add_watcher() i=5 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94427394468528] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6194008ad0 con 0x55e1974d1ff0 2023-10-05T19:50:37.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 20 add_watcher() i=6 2023-10-05T19:50:37.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94427394472208] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 20 add_watcher() i=7 2023-10-05T19:50:37.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:37.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.521+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974e3280 con 0x55e19749de10 2023-10-05T19:50:37.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94427394473312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974e06a0 con 0x55e19749de10 2023-10-05T19:50:37.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94427394473312] v30'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f616ffe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:37.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f61a10a6e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:37.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f61a10a6e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:37.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f61a10a6e40 1 Processor -- start 2023-10-05T19:50:37.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f61a10a6e40 1 -- start start 2023-10-05T19:50:37.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f61a10a6e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974ed710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f61a10a6e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1974edc50 con 0x55e1974ed340 2023-10-05T19:50:37.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f619e3da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f619e3da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45246/0 (socket says 172.21.15.167:45246) 2023-10-05T19:50:37.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f619e3da700 1 -- 172.21.15.167:0/4230837947 learned_addr learned my addr 172.21.15.167:0/4230837947 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.525+0000 7f619e3da700 1 -- 172.21.15.167:0/4230837947 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1974edd90 con 0x55e1974ed340 2023-10-05T19:50:37.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f619e3da700 1 --2- 172.21.15.167:0/4230837947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974ed710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6194002000 tx=0x7f619402a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61846d32f42b9e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f616f7e6700 1 -- 172.21.15.167:0/4230837947 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f619402d050 con 0x55e1974ed340 2023-10-05T19:50:37.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f616f7e6700 1 -- 172.21.15.167:0/4230837947 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619402e040 con 0x55e1974ed340 2023-10-05T19:50:37.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f616f7e6700 1 -- 172.21.15.167:0/4230837947 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6194012960 con 0x55e1974ed340 2023-10-05T19:50:37.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4230837947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 msgr2=0x55e1974ed710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4230837947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974ed710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6194002000 tx=0x7f619402a040 comp rx=0 tx=0).stop 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4230837947 shutdown_connections 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4230837947 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974ed710 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4230837947 >> 172.21.15.167:0/4230837947 conn(0x55e1974e8700 msgr2=0x55e1974e68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4230837947 shutdown_connections 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4230837947 wait complete. 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 Processor -- start 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 -- start start 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f61a10a6e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1974f3cc0 con 0x55e1974ed340 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f619e3da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f619e3da700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974f2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45248/0 (socket says 172.21.15.167:45248) 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f619e3da700 1 -- 172.21.15.167:0/1736607023 learned_addr learned my addr 172.21.15.167:0/1736607023 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.529+0000 7f619e3da700 1 -- 172.21.15.167:0/1736607023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1974a1740 con 0x55e1974ed340 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f619e3da700 1 --2- 172.21.15.167:0/1736607023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974f2cc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6194035040 tx=0x7f619402b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f616dfe3700 1 -- 172.21.15.167:0/1736607023 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6194033b80 con 0x55e1974ed340 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f61a10a6e40 1 -- 172.21.15.167:0/1736607023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e1974f32c0 con 0x55e1974ed340 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f616dfe3700 1 -- 172.21.15.167:0/1736607023 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619403f070 con 0x55e1974ed340 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f616dfe3700 1 -- 172.21.15.167:0/1736607023 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6194033d00 con 0x55e1974ed340 2023-10-05T19:50:37.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f61a10a6e40 1 -- 172.21.15.167:0/1736607023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1974f3700 con 0x55e1974ed340 2023-10-05T19:50:37.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f616dfe3700 1 -- 172.21.15.167:0/1736607023 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f6194045400 con 0x55e1974ed340 2023-10-05T19:50:37.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f616dfe3700 1 --2- 172.21.15.167:0/1736607023 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f60e4030c00 0x7f60e40330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f616dfe3700 1 -- 172.21.15.167:0/1736607023 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f619404fc10 con 0x55e1974ed340 2023-10-05T19:50:37.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f61a10a6e40 5 note: GC not initialized 2023-10-05T19:50:37.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f619f3dc700 1 --2- 172.21.15.167:0/1736607023 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f60e4030c00 0x7f60e40330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.533+0000 7f619f3dc700 1 --2- 172.21.15.167:0/1736607023 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f60e4030c00 0x7f60e40330b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55e1974df0d0 tx=0x7f619800ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f60deffd700 20 reqs_thread_entry: start 2023-10-05T19:50:37.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f60dcff9700 20 reqs_thread_entry: start 2023-10-05T19:50:37.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:37.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:37.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f60d6ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:07 2023 2023-10-05T19:50:37.544 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:37.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f60d67fc700 20 reqs_thread_entry: start 2023-10-05T19:50:37.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 20 get_system_obj_state: rctx=0x7fff56b33500 obj=default.rgw.meta:root:myfoo state=0x55e1973730b0 s->prefetch_data=0 2023-10-05T19:50:37.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19755bd30 con 0x7f6190019760 2023-10-05T19:50:37.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19755e2d0 con 0x7f6190019760 2023-10-05T19:50:37.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:37.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 20 get_system_obj_state: rctx=0x7fff56b33500 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x55e1973492b0 s->prefetch_data=0 2023-10-05T19:50:37.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.537+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19755c7a0 con 0x55e19749de10 2023-10-05T19:50:37.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:37.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:37.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19755c7a0 con 0x55e19749de10 2023-10-05T19:50:37.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(105 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:37.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T19:50:37.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 get_system_obj_state: rctx=0x7fff56b33460 obj=default.rgw.meta:root:myfoo state=0x55e1973492b0 s->prefetch_data=0 2023-10-05T19:50:37.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19755de50 con 0x7f6190019760 2023-10-05T19:50:37.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(106 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19755ae80 con 0x7f6190019760 2023-10-05T19:50:37.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(107 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:37.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 get_system_obj_state: rctx=0x7fff56b33460 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x55e1973730b0 s->prefetch_data=0 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19755ae80 con 0x55e19749de10 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(108 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.541+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19755e410 con 0x55e19749de10 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(109 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T19:50:37.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 4.21 4:85bb0c4e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19755e660 con 0x55e1974d1ff0 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 4.3c 4:3c5ab7e8:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e197562690 con 0x55e19749de10 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 4.b 4:d3872b52:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e197565380 con 0x7f6190019760 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 4.38 4:1c83dc09:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e197567de0 con 0x55e1974ce230 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 4.32 4:4f10a7ef:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19756a860 con 0x55e1974ce230 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 4.10 4:0b50a70f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e197567de0 con 0x55e1974d1ff0 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:116 4.2c 4:36ed1c45:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19756fab0 con 0x55e19749de10 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 4.3b 4:dff81414:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1975726f0 con 0x55e1974d1ff0 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 4.2c 4:35e9aa0f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1975755c0 con 0x55e19749de10 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 4.31 4:8ed18207:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e197578070 con 0x55e1974ce230 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 4.2e 4:74947a99:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e19757af80 con 0x55e1974d1ff0 2023-10-05T19:50:37.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(111 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6194039020 con 0x55e1974d1ff0 2023-10-05T19:50:37.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(116 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(119 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(114 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(113 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(117 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6194039020 con 0x55e1974d1ff0 2023-10-05T19:50:37.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(118 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(115 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6194039020 con 0x55e1974d1ff0 2023-10-05T19:50:37.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(120 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6194039020 con 0x55e1974d1ff0 2023-10-05T19:50:37.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(112 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.545+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94427394442464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974af2a0 con 0x55e1974ce230 2023-10-05T19:50:37.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.549+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(121 notify.0 [watch unwatch cookie 94427394442464] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.549+0000 7f61a10a6e40 20 remove_watcher() i=0 2023-10-05T19:50:37.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.549+0000 7f61a10a6e40 2 removed watcher, disabling cache 2023-10-05T19:50:37.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.549+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94427394452960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974af2a0 con 0x55e19749de10 2023-10-05T19:50:37.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.549+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(122 notify.1 [watch unwatch cookie 94427394452960] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.549+0000 7f61a10a6e40 20 remove_watcher() i=1 2023-10-05T19:50:37.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.549+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94427394449936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974af2a0 con 0x55e1974ce230 2023-10-05T19:50:37.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.553+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(123 notify.2 [watch unwatch cookie 94427394449936] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.553+0000 7f61a10a6e40 20 remove_watcher() i=2 2023-10-05T19:50:37.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.553+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:124 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94427394459408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974af2a0 con 0x7f6190019760 2023-10-05T19:50:37.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.553+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(124 notify.3 [watch unwatch cookie 94427394459408] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.553+0000 7f61a10a6e40 20 remove_watcher() i=3 2023-10-05T19:50:37.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.553+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:125 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94427394454128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974af2a0 con 0x55e1974ce230 2023-10-05T19:50:37.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.557+0000 7f619ebdb700 1 -- 172.21.15.167:0/4184185221 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(125 notify.4 [watch unwatch cookie 94427394454128] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6190056040 con 0x55e1974ce230 2023-10-05T19:50:37.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.557+0000 7f61a10a6e40 20 remove_watcher() i=4 2023-10-05T19:50:37.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.557+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:126 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94427394461072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974af2a0 con 0x55e1974d1ff0 2023-10-05T19:50:37.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.557+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(126 notify.5 [watch unwatch cookie 94427394461072] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6194039020 con 0x55e1974d1ff0 2023-10-05T19:50:37.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.557+0000 7f61a10a6e40 20 remove_watcher() i=5 2023-10-05T19:50:37.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.557+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:127 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94427394468528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974af2a0 con 0x55e1974d1ff0 2023-10-05T19:50:37.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.557+0000 7f619e3da700 1 -- 172.21.15.167:0/4184185221 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(127 notify.6 [watch unwatch cookie 94427394468528] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6194039020 con 0x55e1974d1ff0 2023-10-05T19:50:37.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.557+0000 7f61a10a6e40 20 remove_watcher() i=6 2023-10-05T19:50:37.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.557+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:128 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94427394472208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974af2a0 con 0x7f6190019760 2023-10-05T19:50:37.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.561+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(128 notify.7 [watch unwatch cookie 94427394472208] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x7f6190019760 2023-10-05T19:50:37.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.561+0000 7f61a10a6e40 20 remove_watcher() i=7 2023-10-05T19:50:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.561+0000 7f616ffe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:37.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.561+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:129 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94427394473312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55e1974af2a0 con 0x55e19749de10 2023-10-05T19:50:37.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(129 data_loggenerations_metadata [watch unwatch cookie 94427394473312] v30'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f619800a5a0 con 0x55e19749de10 2023-10-05T19:50:37.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e1974ce230 msgr2=0x55e1974d1480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e1974ce230 0x55e1974d1480 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e19749de10 msgr2=0x55e1974cd460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e19749de10 0x55e1974cd460 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6190019760 msgr2=0x7f619000e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6190019760 0x7f619000e3b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e1974d1ff0 msgr2=0x55e1974d6250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e1974d1ff0 0x55e1974d6250 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6184030ca0 msgr2=0x7f6184033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6184030ca0 0x7f6184033150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f61940030a0 tx=0x7f6194015000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 msgr2=0x55e1974c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f619f3dc700 1 -- 172.21.15.167:0/4184185221 reap_dead start 2023-10-05T19:50:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e1974c19a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61900018e0 tx=0x7f6190016000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 shutdown_connections 2023-10-05T19:50:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/4184185221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e19740d490 0x55e1974c19a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 >> 172.21.15.167:0/4184185221 conn(0x55e197494240 msgr2=0x55e1974b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 shutdown_connections 2023-10-05T19:50:37.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/4184185221 wait complete. 2023-10-05T19:50:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/1736607023 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f60e4030c00 msgr2=0x7f60e40330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/1736607023 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f60e4030c00 0x7f60e40330b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55e1974df0d0 tx=0x7f619800ae50 comp rx=0 tx=0).stop 2023-10-05T19:50:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/1736607023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 msgr2=0x55e1974f2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/1736607023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974f2cc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6194035040 tx=0x7f619402b000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/1736607023 shutdown_connections 2023-10-05T19:50:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/1736607023 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f60e4030c00 0x7f60e40330b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 --2- 172.21.15.167:0/1736607023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e1974ed340 0x55e1974f2cc0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/1736607023 >> 172.21.15.167:0/1736607023 conn(0x55e1974e8700 msgr2=0x55e1974e6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/1736607023 shutdown_connections 2023-10-05T19:50:37.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.565+0000 7f61a10a6e40 1 -- 172.21.15.167:0/1736607023 wait complete. 2023-10-05T19:50:37.575 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:37.575 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:37.575 INFO:teuthology.orchestra.run.smithi167.stdout: "num_shards": 11, 2023-10-05T19:50:37.575 INFO:teuthology.orchestra.run.smithi167.stdout: "tenant": "", 2023-10-05T19:50:37.575 INFO:teuthology.orchestra.run.smithi167.stdout: "zonegroup": "62f730cc-f2d2-47e0-99d9-6d51a9a03581", 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_rule": "default-placement", 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "explicit_placement": { 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "", 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "", 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "" 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "marker": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": "Normal", 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1", 2023-10-05T19:50:37.576 INFO:teuthology.orchestra.run.smithi167.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "mtime": "2023-10-05T19:50:36.667938Z", 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "creation_time": "2023-10-05T19:50:36.660701Z", 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "usage": {}, 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:37.577 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:37.578 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '62f730cc-f2d2-47e0-99d9-6d51a9a03581', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T19:50:36.667938Z', 'creation_time': '2023-10-05T19:50:36.660701Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T19:50:37.579 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2023-10-05T19:50:37.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2023-10-05T19:50:37.579 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2023-10-05T19:50:37.663 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:37.663 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b276efe40 1 Processor -- start 2023-10-05T19:50:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b276efe40 1 -- start start 2023-10-05T19:50:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b276efe40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56124be6a300 0x56124be691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b276efe40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56124bdb6bd0 con 0x56124be69f30 2023-10-05T19:50:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b276efe40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x56124bd73ee0 con 0x56124be6a300 2023-10-05T19:50:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b24a23700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56124be6a300 0x56124be691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b25224700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x56124be69f30 0x56124be68ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51652/0 (socket says 172.21.15.167:51652) 2023-10-05T19:50:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b25224700 1 -- 172.21.15.167:0/1788540474 learned_addr learned my addr 172.21.15.167:0/1788540474 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:37.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b24a23700 1 -- 172.21.15.167:0/1788540474 >> v1:172.21.15.118:6789/0 conn(0x56124be69f30 legacy=0x56124be68ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.657+0000 7f3b24a23700 1 -- 172.21.15.167:0/1788540474 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56124be697f0 con 0x56124be6a300 2023-10-05T19:50:37.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b24a23700 1 --2- 172.21.15.167:0/1788540474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be6a300 0x56124be691f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000a520 tx=0x7f3b10005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5360ad90931855 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b1ffff700 1 -- 172.21.15.167:0/1788540474 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1000f590 con 0x56124be6a300 2023-10-05T19:50:37.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b1ffff700 1 -- 172.21.15.167:0/1788540474 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1000f6f0 con 0x56124be6a300 2023-10-05T19:50:37.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b1ffff700 1 -- 172.21.15.167:0/1788540474 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1000f8a0 con 0x56124be6a300 2023-10-05T19:50:37.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 -- 172.21.15.167:0/1788540474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be6a300 msgr2=0x56124be691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 --2- 172.21.15.167:0/1788540474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be6a300 0x56124be691f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000a520 tx=0x7f3b10005d40 comp rx=0 tx=0).stop 2023-10-05T19:50:37.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 -- 172.21.15.167:0/1788540474 shutdown_connections 2023-10-05T19:50:37.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 --2- 172.21.15.167:0/1788540474 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be6a300 0x56124be691f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 -- 172.21.15.167:0/1788540474 >> 172.21.15.167:0/1788540474 conn(0x56124be64240 msgr2=0x56124be66650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 -- 172.21.15.167:0/1788540474 shutdown_connections 2023-10-05T19:50:37.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 -- 172.21.15.167:0/1788540474 wait complete. 2023-10-05T19:50:37.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 Processor -- start 2023-10-05T19:50:37.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 -- start start 2023-10-05T19:50:37.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be8ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b276efe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124bd37e30 con 0x56124be69f30 2023-10-05T19:50:37.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b25224700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be8ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b25224700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be8ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45260/0 (socket says 172.21.15.167:45260) 2023-10-05T19:50:37.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b25224700 1 -- 172.21.15.167:0/3825844374 learned_addr learned my addr 172.21.15.167:0/3825844374 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b25224700 1 -- 172.21.15.167:0/3825844374 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1000a0e0 con 0x56124be69f30 2023-10-05T19:50:37.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.661+0000 7f3b25224700 1 --2- 172.21.15.167:0/3825844374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be8ab30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000b370 tx=0x7f3b20001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3d3e3a4c8e041b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b1effd700 1 -- 172.21.15.167:0/3825844374 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b2000be40 con 0x56124be69f30 2023-10-05T19:50:37.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b1effd700 1 -- 172.21.15.167:0/3825844374 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2000e470 con 0x56124be69f30 2023-10-05T19:50:37.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b1effd700 1 -- 172.21.15.167:0/3825844374 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b2000e760 con 0x56124be69f30 2023-10-05T19:50:37.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 -- 172.21.15.167:0/3825844374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 msgr2=0x56124be8ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3825844374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be8ab30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000b370 tx=0x7f3b20001930 comp rx=0 tx=0).stop 2023-10-05T19:50:37.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 -- 172.21.15.167:0/3825844374 shutdown_connections 2023-10-05T19:50:37.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3825844374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be8ab30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 -- 172.21.15.167:0/3825844374 >> 172.21.15.167:0/3825844374 conn(0x56124be64240 msgr2=0x56124be866f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 -- 172.21.15.167:0/3825844374 shutdown_connections 2023-10-05T19:50:37.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 -- 172.21.15.167:0/3825844374 wait complete. 2023-10-05T19:50:37.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 Processor -- start 2023-10-05T19:50:37.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 -- start start 2023-10-05T19:50:37.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be91910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124bd0aed0 con 0x56124be69f30 2023-10-05T19:50:37.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b25224700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be91910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b25224700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be91910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45274/0 (socket says 172.21.15.167:45274) 2023-10-05T19:50:37.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 learned_addr learned my addr 172.21.15.167:0/3473574650 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20001c10 con 0x56124be69f30 2023-10-05T19:50:37.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b25224700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be91910 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b20000c00 tx=0x7f3b20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b1d7fa700 1 -- 172.21.15.167:0/3473574650 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b2001f070 con 0x56124be69f30 2023-10-05T19:50:37.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b1d7fa700 1 -- 172.21.15.167:0/3473574650 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2001a680 con 0x56124be69f30 2023-10-05T19:50:37.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56124be91e50 con 0x56124be69f30 2023-10-05T19:50:37.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b1d7fa700 1 -- 172.21.15.167:0/3473574650 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b2001a970 con 0x56124be69f30 2023-10-05T19:50:37.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.665+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56124be92290 con 0x56124be69f30 2023-10-05T19:50:37.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b1d7fa700 1 -- 172.21.15.167:0/3473574650 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3b2001aad0 con 0x56124be69f30 2023-10-05T19:50:37.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b1d7fa700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3b08030c50 0x7f3b08033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b1d7fa700 1 -- 172.21.15.167:0/3473574650 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f3b20045210 con 0x56124be69f30 2023-10-05T19:50:37.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b24a23700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3b08030c50 0x7f3b08033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56124be6a300 0x56124be9d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be9da70 con 0x56124be6a300 2023-10-05T19:50:37.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b25a25700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56124be6a300 0x56124be9d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b24a23700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3b08030c50 0x7f3b08033100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000a4f0 tx=0x7f3b10014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b25a25700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56124be6a300 0x56124be9d460 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b1800a500 con 0x56124be6a300 2023-10-05T19:50:37.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b276efe40 20 realm 2023-10-05T19:50:37.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.669+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be9aac0 con 0x56124be6a300 2023-10-05T19:50:37.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b1800a500 con 0x56124be6a300 2023-10-05T19:50:37.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:37.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be9e550 con 0x56124be6a300 2023-10-05T19:50:37.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b1800a500 con 0x56124be6a300 2023-10-05T19:50:37.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56124be9e180 0x56124bea13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea1af0 con 0x56124be9e180 2023-10-05T19:50:37.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b25224700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56124be9e180 0x56124bea13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b25224700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56124be9e180 0x56124bea13c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea23c0 con 0x56124be6a300 2023-10-05T19:50:37.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3b1800a500 con 0x56124be6a300 2023-10-05T19:50:37.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:37.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 20 searching for the correct realm 2023-10-05T19:50:37.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56124bea1f30 0x56124bea6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124bea1f30 2023-10-05T19:50:37.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b24a23700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56124bea1f30 0x56124bea6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.673+0000 7f3b24a23700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56124bea1f30 0x56124bea6190 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be9e180 2023-10-05T19:50:37.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25224700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3b2000d750 0x7f3b20017430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x7f3b2000d750 2023-10-05T19:50:37.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25a25700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3b2000d750 0x7f3b20017430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25a25700 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3b2000d750 0x7f3b20017430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x7f3b2000d750 2023-10-05T19:50:37.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124bea1f30 2023-10-05T19:50:37.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.677+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be9e180 2023-10-05T19:50:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be9e180 2023-10-05T19:50:37.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x7f3b2000d750 2023-10-05T19:50:37.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x7f3b2000d750 2023-10-05T19:50:37.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x7f3b2000d750 2023-10-05T19:50:37.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x7f3b2000d750 2023-10-05T19:50:37.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.681+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be9e180 2023-10-05T19:50:37.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124bea1f30 2023-10-05T19:50:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be9e180 2023-10-05T19:50:37.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124bea1f30 2023-10-05T19:50:37.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.685+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124bea1f30 2023-10-05T19:50:37.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x7f3b2000d750 2023-10-05T19:50:37.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x7f3b2000d750 2023-10-05T19:50:37.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be6a300 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x7f3b2000d750 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x7f3b2000d750 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124bea1f30 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x7f3b2000d750 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x7f3b2000d750 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be9e180 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.689+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be9e180 2023-10-05T19:50:37.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124bea1f30 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be9e180 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea6770 con 0x56124be9e180 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b276efe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b276efe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b276efe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b276efe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea2f30 con 0x56124be6a300 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.693+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea38b0 con 0x56124be9e180 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea2b20 con 0x56124be9e180 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea7120 con 0x56124bea1f30 2023-10-05T19:50:37.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea7880 con 0x56124be9e180 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea8c40 con 0x56124bea1f30 2023-10-05T19:50:37.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.697+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea8c40 con 0x56124be9e180 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea8c40 con 0x7f3b2000d750 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x7f3b2000d750 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124bea1f30 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.701+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be9e180 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be9e180 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x7f3b2000d750 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x7f3b2000d750 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x7f3b2000d750 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x7f3b2000d750 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.705+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be9e180 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124bea1f30 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be9e180 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124bea1f30 2023-10-05T19:50:37.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18014040 con 0x56124be6a300 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.709+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124bea1f30 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x7f3b2000d750 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be6a300 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x7f3b2000d750 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124bea1f30 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x7f3b2000d750 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.713+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be9e180 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be9e180 2023-10-05T19:50:37.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124bea1f30 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be9e180 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea74d0 con 0x56124be9e180 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3b20014070 con 0x56124be9e180 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b276efe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b276efe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b276efe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b276efe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.717+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea7c30 con 0x56124be9e180 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea7fe0 con 0x56124be6a300 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea83c0 con 0x56124be9e180 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea88b0 con 0x56124be9e180 2023-10-05T19:50:37.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.721+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea8cf0 con 0x7f3b2000d750 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 zone default found 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 4 Realm: () 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 zonegroup default 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea8cf0 con 0x7f3b2000d750 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beaa670 con 0x56124bea1f30 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beaaa20 con 0x56124bea1f30 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 started sync module instance, tier type = 2023-10-05T19:50:37.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.725+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea9d30 con 0x56124be9e180 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.729+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.729+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94636583054384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bea9d30 con 0x56124be9e180 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.729+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beab2c0 con 0x56124be6a300 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.729+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94636583054384] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.729+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.729+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94636583068000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beab2c0 con 0x56124be6a300 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.729+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beabb60 con 0x56124be9e180 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.733+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94636583068000] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.733+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.733+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94636583071472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beab830 con 0x56124be9e180 2023-10-05T19:50:37.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.733+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beac450 con 0x7f3b2000d750 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.733+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.733+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94636583075680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beac8a0 con 0x7f3b2000d750 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.733+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bead2b0 con 0x56124be9e180 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.733+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94636583071472] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.737+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94636583075680] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.737+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.737+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94636583076784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beac800 con 0x56124be9e180 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.737+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bead7a0 con 0x56124bea1f30 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.737+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.737+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94636583080624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beae040 con 0x56124bea1f30 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.737+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beaea50 con 0x56124bea1f30 2023-10-05T19:50:37.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.737+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94636583076784] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94636583080624] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94636583085408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beaee00 con 0x56124bea1f30 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beaf6a0 con 0x7f3b2000d750 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94636583085408] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b1000fc70 con 0x56124bea1f30 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94636583087616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beaf740 con 0x7f3b2000d750 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 20 add_watcher() i=0 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 20 add_watcher() i=1 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 20 add_watcher() i=2 2023-10-05T19:50:37.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 20 add_watcher() i=3 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 20 add_watcher() i=4 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 20 add_watcher() i=5 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.741+0000 7f3b276efe40 20 add_watcher() i=6 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94636583087616] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b276efe40 20 add_watcher() i=7 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b276efe40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beb2850 con 0x56124be6a300 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94636583088720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124beafb90 con 0x56124be6a300 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94636583088720] v30'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3af67e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b276efe40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b276efe40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b276efe40 1 Processor -- start 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.745+0000 7f3b276efe40 1 -- start start 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bebcd70 0x56124bebd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124bebd680 con 0x56124bebcd70 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b24a23700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bebcd70 0x56124bebd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b24a23700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bebcd70 0x56124bebd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45276/0 (socket says 172.21.15.167:45276) 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b24a23700 1 -- 172.21.15.167:0/1056700724 learned_addr learned my addr 172.21.15.167:0/1056700724 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b24a23700 1 -- 172.21.15.167:0/1056700724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56124bebd7c0 con 0x56124bebcd70 2023-10-05T19:50:37.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b24a23700 1 --2- 172.21.15.167:0/1056700724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bebcd70 0x56124bebd140 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3b10003440 tx=0x7f3b10011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8767b1df34bf67 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3af5fe3700 1 -- 172.21.15.167:0/1056700724 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1001ca10 con 0x56124bebcd70 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3af5fe3700 1 -- 172.21.15.167:0/1056700724 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1002f040 con 0x56124bebcd70 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3af5fe3700 1 -- 172.21.15.167:0/1056700724 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1001cb90 con 0x56124bebcd70 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 -- 172.21.15.167:0/1056700724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bebcd70 msgr2=0x56124bebd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 --2- 172.21.15.167:0/1056700724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bebcd70 0x56124bebd140 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3b10003440 tx=0x7f3b10011000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 -- 172.21.15.167:0/1056700724 shutdown_connections 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 --2- 172.21.15.167:0/1056700724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bebcd70 0x56124bebd140 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 -- 172.21.15.167:0/1056700724 >> 172.21.15.167:0/1056700724 conn(0x56124beb8130 msgr2=0x56124beb62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 -- 172.21.15.167:0/1056700724 shutdown_connections 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 -- 172.21.15.167:0/1056700724 wait complete. 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 Processor -- start 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 -- start start 2023-10-05T19:50:37.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bec2970 0x56124bec2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.749+0000 7f3b276efe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56124bec3970 con 0x56124bec2970 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3b24a23700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bec2970 0x56124bec2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3b24a23700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bec2970 0x56124bec2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45280/0 (socket says 172.21.15.167:45280) 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3b24a23700 1 -- 172.21.15.167:0/1096363929 learned_addr learned my addr 172.21.15.167:0/1096363929 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3b24a23700 1 -- 172.21.15.167:0/1096363929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56124be697f0 con 0x56124bec2970 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3b24a23700 1 --2- 172.21.15.167:0/1096363929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bec2970 0x56124bec2d40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3b10003440 tx=0x7f3b10034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3a67fff700 1 -- 172.21.15.167:0/1096363929 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1000f960 con 0x56124bec2970 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3a67fff700 1 -- 172.21.15.167:0/1096363929 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b10020070 con 0x56124bec2970 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3a67fff700 1 -- 172.21.15.167:0/1096363929 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b1001ce90 con 0x56124bec2970 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3b276efe40 1 -- 172.21.15.167:0/1096363929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56124bec3340 con 0x56124bec2970 2023-10-05T19:50:37.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3b276efe40 1 -- 172.21.15.167:0/1096363929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56124bec5e90 con 0x56124bec2970 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3a67fff700 1 -- 172.21.15.167:0/1096363929 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3b10010420 con 0x56124bec2970 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3a67fff700 1 --2- 172.21.15.167:0/1096363929 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3a6c030c00 0x7f3a6c0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3a67fff700 1 -- 172.21.15.167:0/1096363929 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f3b10022070 con 0x56124bec2970 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.753+0000 7f3b276efe40 5 note: GC not initialized 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3a657fa700 20 reqs_thread_entry: start 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3a5d7fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:08 2023 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3a5cff9700 20 reqs_thread_entry: start 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 20 get_system_obj_state: rctx=0x7fff67321c78 obj=default.rgw.meta:users.uid:foo state=0x56124bd430b0 s->prefetch_data=0 2023-10-05T19:50:37.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf2b550 con 0x56124be6a300 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b25a25700 1 --2- 172.21.15.167:0/1096363929 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3a6c030c00 0x7f3a6c0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3a5effd700 20 reqs_thread_entry: start 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b25a25700 1 --2- 172.21.15.167:0/1096363929 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3a6c030c00 0x7f3a6c0330b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x56124beb2920 tx=0x7f3b1800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf2b4d0 con 0x56124be6a300 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:37.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf2b4d0 con 0x7f3b2000d750 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 20 get_system_obj_state: rctx=0x7fff67321b30 obj=default.rgw.meta:root:myfoo state=0x56124bd430b0 s->prefetch_data=0 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.757+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf2b4d0 con 0x7f3b2000d750 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(105 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf2d300 con 0x7f3b2000d750 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(106 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 get_system_obj_state: rctx=0x7fff67321b30 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x56124bd192b0 s->prefetch_data=0 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf2d950 con 0x56124be6a300 2023-10-05T19:50:37.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(107 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf2a6a0 con 0x56124be6a300 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(108 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 4.21 4:85bb0c4e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf2f260 con 0x56124bea1f30 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 4.3c 4:3c5ab7e8:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf31da0 con 0x56124be6a300 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 4.b 4:d3872b52:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf34ad0 con 0x7f3b2000d750 2023-10-05T19:50:37.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 4.38 4:1c83dc09:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf37820 con 0x56124be9e180 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 4.32 4:4f10a7ef:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf3a2a0 con 0x56124be9e180 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:114 4.10 4:0b50a70f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf3cb60 con 0x56124bea1f30 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 4.2c 4:36ed1c45:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf34ad0 con 0x56124be6a300 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 4.3b 4:dff81414:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf41bf0 con 0x56124bea1f30 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:117 4.2c 4:35e9aa0f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf44790 con 0x56124be6a300 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:118 4.31 4:8ed18207:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf47530 con 0x56124be9e180 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:119 4.2e 4:74947a99:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf49df0 con 0x56124bea1f30 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(110 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(115 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(111 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b1003c040 con 0x56124bea1f30 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(113 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(112 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(117 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(118 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(119 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f3b1003c040 con 0x56124bea1f30 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(116 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b1003c040 con 0x56124bea1f30 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.761+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(114 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3b1003c040 con 0x56124bea1f30 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.765+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:120 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94636583054384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124bf29e80 con 0x56124be9e180 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.765+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(120 notify.0 [watch unwatch cookie 94636583054384] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.765+0000 7f3b276efe40 20 remove_watcher() i=0 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.765+0000 7f3b276efe40 2 removed watcher, disabling cache 2023-10-05T19:50:37.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.765+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:121 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94636583068000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be81410 con 0x56124be6a300 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.765+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(121 notify.1 [watch unwatch cookie 94636583068000] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.765+0000 7f3b276efe40 20 remove_watcher() i=1 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.765+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:122 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94636583071472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be81410 con 0x56124be9e180 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.769+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(122 notify.2 [watch unwatch cookie 94636583071472] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.769+0000 7f3b276efe40 20 remove_watcher() i=2 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.769+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:123 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94636583075680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be81410 con 0x7f3b2000d750 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.769+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(123 notify.3 [watch unwatch cookie 94636583075680] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.769+0000 7f3b276efe40 20 remove_watcher() i=3 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.769+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:124 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94636583076784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be81410 con 0x56124be9e180 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b25224700 1 -- 172.21.15.167:0/3473574650 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(124 notify.4 [watch unwatch cookie 94636583076784] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b20055040 con 0x56124be9e180 2023-10-05T19:50:37.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b276efe40 20 remove_watcher() i=4 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:125 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94636583080624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be81410 con 0x56124bea1f30 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(125 notify.5 [watch unwatch cookie 94636583080624] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b1003c040 con 0x56124bea1f30 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b276efe40 20 remove_watcher() i=5 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:126 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94636583085408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be81410 con 0x56124bea1f30 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b24a23700 1 -- 172.21.15.167:0/3473574650 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(126 notify.6 [watch unwatch cookie 94636583085408] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b1003c040 con 0x56124bea1f30 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b276efe40 20 remove_watcher() i=6 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:127 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94636583087616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be81410 con 0x7f3b2000d750 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.773+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(127 notify.7 [watch unwatch cookie 94636583087616] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x7f3b2000d750 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 20 remove_watcher() i=7 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3af67e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:37.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:128 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94636583088720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56124be81410 con 0x56124be6a300 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(128 data_loggenerations_metadata [watch unwatch cookie 94636583088720] v30'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3b18033040 con 0x56124be6a300 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56124be9e180 msgr2=0x56124bea13c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56124be9e180 0x56124bea13c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56124be6a300 msgr2=0x56124be9d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56124be6a300 0x56124be9d460 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3b2000d750 msgr2=0x7f3b20017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3b2000d750 0x7f3b20017430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56124bea1f30 msgr2=0x56124bea6190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56124bea1f30 0x56124bea6190 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3b08030c50 msgr2=0x7f3b08033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3b08030c50 0x7f3b08033100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000a4f0 tx=0x7f3b10014000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 msgr2=0x56124be91910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b25a25700 1 -- 172.21.15.167:0/3473574650 reap_dead start 2023-10-05T19:50:37.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be91910 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b20000c00 tx=0x7f3b20016000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 shutdown_connections 2023-10-05T19:50:37.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 --2- 172.21.15.167:0/3473574650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124be69f30 0x56124be91910 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 >> 172.21.15.167:0/3473574650 conn(0x56124be64240 msgr2=0x56124be85170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 shutdown_connections 2023-10-05T19:50:37.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/3473574650 wait complete. 2023-10-05T19:50:37.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/1096363929 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3a6c030c00 msgr2=0x7f3a6c0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 --2- 172.21.15.167:0/1096363929 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3a6c030c00 0x7f3a6c0330b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x56124beb2920 tx=0x7f3b1800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:37.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 -- 172.21.15.167:0/1096363929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bec2970 msgr2=0x56124bec2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.777+0000 7f3b276efe40 1 --2- 172.21.15.167:0/1096363929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bec2970 0x56124bec2d40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3b10003440 tx=0x7f3b10034000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.781+0000 7f3b276efe40 1 -- 172.21.15.167:0/1096363929 shutdown_connections 2023-10-05T19:50:37.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.781+0000 7f3b276efe40 1 --2- 172.21.15.167:0/1096363929 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3a6c030c00 0x7f3a6c0330b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.781+0000 7f3b276efe40 1 --2- 172.21.15.167:0/1096363929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56124bec2970 0x56124bec2d40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.781+0000 7f3b276efe40 1 -- 172.21.15.167:0/1096363929 >> 172.21.15.167:0/1096363929 conn(0x56124beb8130 msgr2=0x56124beb6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.781+0000 7f3b276efe40 1 -- 172.21.15.167:0/1096363929 shutdown_connections 2023-10-05T19:50:37.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.781+0000 7f3b276efe40 1 -- 172.21.15.167:0/1096363929 wait complete. 2023-10-05T19:50:37.818 INFO:teuthology.orchestra.run.smithi167.stdout:[ 2023-10-05T19:50:37.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:37.818 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:37.818 INFO:teuthology.orchestra.run.smithi167.stdout: "num_shards": 11, 2023-10-05T19:50:37.818 INFO:teuthology.orchestra.run.smithi167.stdout: "tenant": "", 2023-10-05T19:50:37.818 INFO:teuthology.orchestra.run.smithi167.stdout: "zonegroup": "62f730cc-f2d2-47e0-99d9-6d51a9a03581", 2023-10-05T19:50:37.818 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_rule": "default-placement", 2023-10-05T19:50:37.818 INFO:teuthology.orchestra.run.smithi167.stdout: "explicit_placement": { 2023-10-05T19:50:37.818 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "" 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "marker": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": "Normal", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "mtime": "2023-10-05T19:50:36.667938Z", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "creation_time": "2023-10-05T19:50:36.660701Z", 2023-10-05T19:50:37.819 INFO:teuthology.orchestra.run.smithi167.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout: "usage": {}, 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:37.820 INFO:teuthology.orchestra.run.smithi167.stdout:] 2023-10-05T19:50:37.821 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '62f730cc-f2d2-47e0-99d9-6d51a9a03581', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T19:50:36.667938Z', 'creation_time': '2023-10-05T19:50:36.660701Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2023-10-05T19:50:37.833 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-10-05T19:50:37.833 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T19:50:37.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T19:50:37.834 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2023-10-05T19:50:37.869 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:37.869 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:37.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.860+0000 7f2aff70de40 1 Processor -- start 2023-10-05T19:50:37.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.860+0000 7f2aff70de40 1 -- start start 2023-10-05T19:50:37.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.860+0000 7f2aff70de40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x556bf76d8920 0x556bf76d8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.860+0000 7f2aff70de40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556bf7625bd0 con 0x556bf76d9230 2023-10-05T19:50:37.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.860+0000 7f2aff70de40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x556bf75e2ee0 con 0x556bf76d8920 2023-10-05T19:50:37.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2afd242700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x556bf76d8920 0x556bf76d8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2afca41700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x556bf76d9230 0x556bf76d9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51658/0 (socket says 172.21.15.167:51658) 2023-10-05T19:50:37.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2afca41700 1 -- 172.21.15.167:0/1376619790 learned_addr learned my addr 172.21.15.167:0/1376619790 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:37.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2af7fff700 1 -- 172.21.15.167:0/1376619790 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606597269 0 0) 0x556bf7625bd0 con 0x556bf76d9230 2023-10-05T19:50:37.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2af7fff700 1 -- 172.21.15.167:0/1376619790 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aec001e10 con 0x556bf76d9230 2023-10-05T19:50:37.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2afd242700 1 -- 172.21.15.167:0/1376619790 >> v1:172.21.15.118:6789/0 conn(0x556bf76d9230 legacy=0x556bf76d9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2afd242700 1 -- 172.21.15.167:0/1376619790 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bf76da3e0 con 0x556bf76d8920 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2afd242700 1 --2- 172.21.15.167:0/1376619790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf76d8cf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2af000a5d0 tx=0x7f2af0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d625c92f3e686b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2af7fff700 1 -- 172.21.15.167:0/1376619790 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2af0007610 con 0x556bf76d8920 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2af7fff700 1 -- 172.21.15.167:0/1376619790 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0007770 con 0x556bf76d8920 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2af7fff700 1 -- 172.21.15.167:0/1376619790 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2af0007a40 con 0x556bf76d8920 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 -- 172.21.15.167:0/1376619790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 msgr2=0x556bf76d8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 --2- 172.21.15.167:0/1376619790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf76d8cf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2af000a5d0 tx=0x7f2af0005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 -- 172.21.15.167:0/1376619790 shutdown_connections 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 --2- 172.21.15.167:0/1376619790 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf76d8cf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 -- 172.21.15.167:0/1376619790 >> 172.21.15.167:0/1376619790 conn(0x556bf76d4340 msgr2=0x556bf76d6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 -- 172.21.15.167:0/1376619790 shutdown_connections 2023-10-05T19:50:37.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 -- 172.21.15.167:0/1376619790 wait complete. 2023-10-05T19:50:37.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 Processor -- start 2023-10-05T19:50:37.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 -- start start 2023-10-05T19:50:37.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf764e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.864+0000 7f2aff70de40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf75a6e30 con 0x556bf76d8920 2023-10-05T19:50:37.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2afd242700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf764e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2afd242700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf764e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45290/0 (socket says 172.21.15.167:45290) 2023-10-05T19:50:37.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2afd242700 1 -- 172.21.15.167:0/1350615069 learned_addr learned my addr 172.21.15.167:0/1350615069 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2afd242700 1 -- 172.21.15.167:0/1350615069 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af0005cf0 con 0x556bf76d8920 2023-10-05T19:50:37.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2afd242700 1 --2- 172.21.15.167:0/1350615069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf764e230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2af0000c00 tx=0x7f2af0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4550b17a56e4ae server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2af6ffd700 1 -- 172.21.15.167:0/1350615069 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2af00078e0 con 0x556bf76d8920 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2af6ffd700 1 -- 172.21.15.167:0/1350615069 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0007a40 con 0x556bf76d8920 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2af6ffd700 1 -- 172.21.15.167:0/1350615069 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2af0007bd0 con 0x556bf76d8920 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 -- 172.21.15.167:0/1350615069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 msgr2=0x556bf764e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 --2- 172.21.15.167:0/1350615069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf764e230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2af0000c00 tx=0x7f2af0014000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 -- 172.21.15.167:0/1350615069 shutdown_connections 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 --2- 172.21.15.167:0/1350615069 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf764e230 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 -- 172.21.15.167:0/1350615069 >> 172.21.15.167:0/1350615069 conn(0x556bf76d4340 msgr2=0x556bf76f3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 -- 172.21.15.167:0/1350615069 shutdown_connections 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 -- 172.21.15.167:0/1350615069 wait complete. 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 Processor -- start 2023-10-05T19:50:37.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 -- start start 2023-10-05T19:50:37.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf7700670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2aff70de40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf7579ed0 con 0x556bf76d8920 2023-10-05T19:50:37.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2afd242700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf7700670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2afd242700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf7700670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45306/0 (socket says 172.21.15.167:45306) 2023-10-05T19:50:37.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 learned_addr learned my addr 172.21.15.167:0/3902318836 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.868+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bf76da3e0 con 0x556bf76d8920 2023-10-05T19:50:37.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2afd242700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf7700670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2af001f040 tx=0x7f2af001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2af57fa700 1 -- 172.21.15.167:0/3902318836 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2af0007bb0 con 0x556bf76d8920 2023-10-05T19:50:37.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2af57fa700 1 -- 172.21.15.167:0/3902318836 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0029070 con 0x556bf76d8920 2023-10-05T19:50:37.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556bf7700bb0 con 0x556bf76d8920 2023-10-05T19:50:37.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2af57fa700 1 -- 172.21.15.167:0/3902318836 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2af0012610 con 0x556bf76d8920 2023-10-05T19:50:37.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bf7700ff0 con 0x556bf76d8920 2023-10-05T19:50:37.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2af57fa700 1 -- 172.21.15.167:0/3902318836 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2af0012770 con 0x556bf76d8920 2023-10-05T19:50:37.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2af57fa700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ae0030ca0 0x7f2ae0033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2af57fa700 1 -- 172.21.15.167:0/3902318836 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2af002b070 con 0x556bf76d8920 2023-10-05T19:50:37.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2afca41700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ae0030ca0 0x7f2ae0033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2aff70de40 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556bf76d9230 0x556bf770c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf770c7d0 con 0x556bf76d9230 2023-10-05T19:50:37.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2afca41700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ae0030ca0 0x7f2ae0033150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80044f0 tx=0x7f2ae8006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.872+0000 7f2afda43700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556bf76d9230 0x556bf770c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2afda43700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556bf76d9230 0x556bf770c1c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2af800a500 con 0x556bf76d9230 2023-10-05T19:50:37.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 20 realm 2023-10-05T19:50:37.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7709820 con 0x556bf76d9230 2023-10-05T19:50:37.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2af800a500 con 0x556bf76d9230 2023-10-05T19:50:37.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:37.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf770d2b0 con 0x556bf76d9230 2023-10-05T19:50:37.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2af800a500 con 0x556bf76d9230 2023-10-05T19:50:37.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556bf770cee0 0x556bf7710120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7710850 con 0x556bf770cee0 2023-10-05T19:50:37.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2afd242700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556bf770cee0 0x556bf7710120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.876+0000 7f2afd242700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556bf770cee0 0x556bf7710120 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7711120 con 0x556bf76d9230 2023-10-05T19:50:37.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2af800a500 con 0x556bf76d9230 2023-10-05T19:50:37.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:37.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2aff70de40 20 searching for the correct realm 2023-10-05T19:50:37.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2aff70de40 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556bf7710c90 0x556bf7714ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf7710c90 2023-10-05T19:50:37.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afca41700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556bf7710c90 0x556bf7714ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afca41700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556bf7710c90 0x556bf7714ef0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae8004520 con 0x556bf7710c90 2023-10-05T19:50:37.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf770cee0 2023-10-05T19:50:37.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afd242700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2af0007030 0x7f2af001e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x7f2af0007030 2023-10-05T19:50:37.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afda43700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2af0007030 0x7f2af001e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.880+0000 7f2afda43700 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2af0007030 0x7f2af001e780 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x7f2af0007030 2023-10-05T19:50:37.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf7710c90 2023-10-05T19:50:37.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae8004520 con 0x556bf7710c90 2023-10-05T19:50:37.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf770cee0 2023-10-05T19:50:37.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf770cee0 2023-10-05T19:50:37.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.884+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x7f2af0007030 2023-10-05T19:50:37.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x7f2af0007030 2023-10-05T19:50:37.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x7f2af0007030 2023-10-05T19:50:37.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x7f2af0007030 2023-10-05T19:50:37.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf770cee0 2023-10-05T19:50:37.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf7710c90 2023-10-05T19:50:37.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae8004520 con 0x556bf7710c90 2023-10-05T19:50:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.888+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf770cee0 2023-10-05T19:50:37.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf7710c90 2023-10-05T19:50:37.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.892+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf7710c90 2023-10-05T19:50:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x7f2af0007030 2023-10-05T19:50:37.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x7f2af0007030 2023-10-05T19:50:37.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf76d9230 2023-10-05T19:50:37.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x7f2af0007030 2023-10-05T19:50:37.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x7f2af0007030 2023-10-05T19:50:37.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf7710c90 2023-10-05T19:50:37.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x7f2af0007030 2023-10-05T19:50:37.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x7f2af0007030 2023-10-05T19:50:37.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf770cee0 2023-10-05T19:50:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.896+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf770cee0 2023-10-05T19:50:37.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77154d0 con 0x556bf7710c90 2023-10-05T19:50:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2ae8021040 con 0x556bf770cee0 2023-10-05T19:50:37.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2ae8021040 con 0x556bf770cee0 2023-10-05T19:50:37.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2aff70de40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:37.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2aff70de40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:37.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2aff70de40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:37.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2aff70de40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:37.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7711c90 con 0x556bf76d9230 2023-10-05T19:50:37.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.900+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7712610 con 0x556bf770cee0 2023-10-05T19:50:37.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7711880 con 0x556bf770cee0 2023-10-05T19:50:37.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:37.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7715e80 con 0x556bf7710c90 2023-10-05T19:50:37.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77165e0 con 0x556bf770cee0 2023-10-05T19:50:37.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77179a0 con 0x556bf7710c90 2023-10-05T19:50:37.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.904+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77179a0 con 0x556bf770cee0 2023-10-05T19:50:37.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77179a0 con 0x7f2af0007030 2023-10-05T19:50:37.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x7f2af0007030 2023-10-05T19:50:37.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf7710c90 2023-10-05T19:50:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.908+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf770cee0 2023-10-05T19:50:37.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf770cee0 2023-10-05T19:50:37.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x7f2af0007030 2023-10-05T19:50:37.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x7f2af0007030 2023-10-05T19:50:37.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x7f2af0007030 2023-10-05T19:50:37.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x7f2af0007030 2023-10-05T19:50:37.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.912+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf770cee0 2023-10-05T19:50:37.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf7710c90 2023-10-05T19:50:37.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf770cee0 2023-10-05T19:50:37.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf7710c90 2023-10-05T19:50:37.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.916+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8014040 con 0x556bf76d9230 2023-10-05T19:50:37.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf7710c90 2023-10-05T19:50:37.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x7f2af0007030 2023-10-05T19:50:37.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf76d9230 2023-10-05T19:50:37.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x7f2af0007030 2023-10-05T19:50:37.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.920+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf7710c90 2023-10-05T19:50:37.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x7f2af0007030 2023-10-05T19:50:37.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf770cee0 2023-10-05T19:50:37.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf770cee0 2023-10-05T19:50:37.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf7710c90 2023-10-05T19:50:37.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf770cee0 2023-10-05T19:50:37.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.924+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716230 con 0x556bf770cee0 2023-10-05T19:50:37.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:37.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:37.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:37.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:37.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716990 con 0x556bf770cee0 2023-10-05T19:50:37.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7716d40 con 0x556bf76d9230 2023-10-05T19:50:37.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:37.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7715ab0 con 0x556bf770cee0 2023-10-05T19:50:37.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:37.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.928+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7717660 con 0x556bf770cee0 2023-10-05T19:50:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7717660 con 0x7f2af0007030 2023-10-05T19:50:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 zone default found 2023-10-05T19:50:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 4 Realm: () 2023-10-05T19:50:37.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:37.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:37.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:37.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 zonegroup default 2023-10-05T19:50:37.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7717660 con 0x7f2af0007030 2023-10-05T19:50:37.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7718fe0 con 0x556bf7710c90 2023-10-05T19:50:37.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7719390 con 0x556bf7710c90 2023-10-05T19:50:37.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:37.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 started sync module instance, tier type = 2023-10-05T19:50:37.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:37.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.932+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77186a0 con 0x556bf770cee0 2023-10-05T19:50:37.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.936+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.936+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93922201274016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7717210 con 0x556bf770cee0 2023-10-05T19:50:37.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.936+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7719d80 con 0x556bf76d9230 2023-10-05T19:50:37.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.936+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93922201274016] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.940+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.940+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93922201275120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7717210 con 0x556bf76d9230 2023-10-05T19:50:37.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.940+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771a670 con 0x556bf770cee0 2023-10-05T19:50:37.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.940+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.940+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93922201280896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771aac0 con 0x556bf770cee0 2023-10-05T19:50:37.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.940+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93922201275120] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.940+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7719850 con 0x7f2af0007030 2023-10-05T19:50:37.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.944+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93922201280896] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.944+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.944+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93922201282000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7719970 con 0x7f2af0007030 2023-10-05T19:50:37.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.944+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771b9c0 con 0x556bf770cee0 2023-10-05T19:50:37.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.944+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.944+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93922201285840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771be10 con 0x556bf770cee0 2023-10-05T19:50:37.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.944+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771c820 con 0x556bf7710c90 2023-10-05T19:50:37.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.944+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93922201282000] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93922201289520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771cbd0 con 0x556bf7710c90 2023-10-05T19:50:37.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771d5e0 con 0x556bf7710c90 2023-10-05T19:50:37.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93922201285840] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 93922201289520] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93922201293040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771d990 con 0x556bf7710c90 2023-10-05T19:50:37.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771e230 con 0x7f2af0007030 2023-10-05T19:50:37.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93922201293040] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93922201295248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771ba30 con 0x7f2af0007030 2023-10-05T19:50:37.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 20 add_watcher() i=0 2023-10-05T19:50:37.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 20 add_watcher() i=1 2023-10-05T19:50:37.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 20 add_watcher() i=2 2023-10-05T19:50:37.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 20 add_watcher() i=3 2023-10-05T19:50:37.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 20 add_watcher() i=4 2023-10-05T19:50:37.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 20 add_watcher() i=5 2023-10-05T19:50:37.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.948+0000 7f2aff70de40 20 add_watcher() i=6 2023-10-05T19:50:37.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93922201295248] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 20 add_watcher() i=7 2023-10-05T19:50:37.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:37.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7721390 con 0x556bf76d9230 2023-10-05T19:50:37.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93922201296352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf771e850 con 0x556bf76d9230 2023-10-05T19:50:37.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93922201296352] v30'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2ace7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:37.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:37.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:37.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 1 Processor -- start 2023-10-05T19:50:37.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 1 -- start start 2023-10-05T19:50:37.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf772bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2aff70de40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf772c010 con 0x556bf772b700 2023-10-05T19:50:37.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2afca41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf772bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2afca41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf772bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45310/0 (socket says 172.21.15.167:45310) 2023-10-05T19:50:37.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.952+0000 7f2afca41700 1 -- 172.21.15.167:0/2922952319 learned_addr learned my addr 172.21.15.167:0/2922952319 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2afca41700 1 -- 172.21.15.167:0/2922952319 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bf772c150 con 0x556bf772b700 2023-10-05T19:50:37.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2afca41700 1 --2- 172.21.15.167:0/2922952319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf772bad0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2af001f010 tx=0x7f2ae8006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4a06df84eb1b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2acdfe3700 1 -- 172.21.15.167:0/2922952319 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ae801a040 con 0x556bf772b700 2023-10-05T19:50:37.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2acdfe3700 1 -- 172.21.15.167:0/2922952319 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae802dae0 con 0x556bf772b700 2023-10-05T19:50:37.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2acdfe3700 1 -- 172.21.15.167:0/2922952319 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ae80049b0 con 0x556bf772b700 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 -- 172.21.15.167:0/2922952319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 msgr2=0x556bf772bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 --2- 172.21.15.167:0/2922952319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf772bad0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2af001f010 tx=0x7f2ae8006000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 -- 172.21.15.167:0/2922952319 shutdown_connections 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 --2- 172.21.15.167:0/2922952319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf772bad0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 -- 172.21.15.167:0/2922952319 >> 172.21.15.167:0/2922952319 conn(0x556bf7726ac0 msgr2=0x556bf7724c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 -- 172.21.15.167:0/2922952319 shutdown_connections 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 -- 172.21.15.167:0/2922952319 wait complete. 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 Processor -- start 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 -- start start 2023-10-05T19:50:37.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf7731210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2aff70de40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bf7732210 con 0x556bf772b700 2023-10-05T19:50:37.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2afca41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf7731210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2afca41700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf7731210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45326/0 (socket says 172.21.15.167:45326) 2023-10-05T19:50:37.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2afca41700 1 -- 172.21.15.167:0/531510575 learned_addr learned my addr 172.21.15.167:0/531510575 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:37.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.956+0000 7f2afca41700 1 -- 172.21.15.167:0/531510575 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec001e10 con 0x556bf772b700 2023-10-05T19:50:37.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2afca41700 1 --2- 172.21.15.167:0/531510575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf7731210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2ae803a040 tx=0x7f2ae8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2a3ffff700 1 -- 172.21.15.167:0/531510575 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ae801a040 con 0x556bf772b700 2023-10-05T19:50:37.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2a3ffff700 1 -- 172.21.15.167:0/531510575 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae8004330 con 0x556bf772b700 2023-10-05T19:50:37.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2a3ffff700 1 -- 172.21.15.167:0/531510575 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ae80149b0 con 0x556bf772b700 2023-10-05T19:50:37.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2aff70de40 1 -- 172.21.15.167:0/531510575 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556bf7731810 con 0x556bf772b700 2023-10-05T19:50:37.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2aff70de40 1 -- 172.21.15.167:0/531510575 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bf7731c50 con 0x556bf772b700 2023-10-05T19:50:37.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2a3ffff700 1 -- 172.21.15.167:0/531510575 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2ae8014b90 con 0x556bf772b700 2023-10-05T19:50:37.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2a3ffff700 1 --2- 172.21.15.167:0/531510575 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2a44030c00 0x7f2a440330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:37.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2a3ffff700 1 -- 172.21.15.167:0/531510575 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2ae8027040 con 0x556bf772b700 2023-10-05T19:50:37.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2afda43700 1 --2- 172.21.15.167:0/531510575 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2a44030c00 0x7f2a440330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:37.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2aff70de40 5 note: GC not initialized 2023-10-05T19:50:37.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.960+0000 7f2afda43700 1 --2- 172.21.15.167:0/531510575 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2a44030c00 0x7f2a440330b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x556bf771bca0 tx=0x7f2af800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:37.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2a3d7fa700 20 reqs_thread_entry: start 2023-10-05T19:50:37.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:37.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:37.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2a357fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:08 2023 2023-10-05T19:50:37.971 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:37.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2a34ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:37.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 get_system_obj_state: rctx=0x7ffddbf17410 obj=default.rgw.meta:root:myfoo state=0x556bf75b20b0 s->prefetch_data=0 2023-10-05T19:50:37.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf779a320 con 0x7f2af0007030 2023-10-05T19:50:37.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2a36ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:37.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf779c8c0 con 0x7f2af0007030 2023-10-05T19:50:37.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:37.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 get_system_obj_state: rctx=0x7ffddbf17410 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x556bf75882b0 s->prefetch_data=0 2023-10-05T19:50:37.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf779ad90 con 0x556bf76d9230 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf779cdb0 con 0x556bf76d9230 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(105 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 20 get_system_obj_state: rctx=0x7ffddbf17370 obj=default.rgw.meta:root:myfoo state=0x556bf75882b0 s->prefetch_data=0 2023-10-05T19:50:37.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.964+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf779c0d0 con 0x7f2af0007030 2023-10-05T19:50:37.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(106 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7799470 con 0x7f2af0007030 2023-10-05T19:50:37.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(107 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 get_system_obj_state: rctx=0x7ffddbf17370 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x556bf75b20b0 s->prefetch_data=0 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf7799470 con 0x556bf76d9230 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(108 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 rados->read ofs=0 len=0 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf779c6c0 con 0x556bf76d9230 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(109 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 4.21 4:85bb0c4e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf779e3e0 con 0x556bf7710c90 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 4.3c 4:3c5ab7e8:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77a0e60 con 0x556bf76d9230 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 4.b 4:d3872b52:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77a3b80 con 0x7f2af0007030 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 4.38 4:1c83dc09:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77a68f0 con 0x556bf770cee0 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 4.32 4:4f10a7ef:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77a92a0 con 0x556bf770cee0 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 4.10 4:0b50a70f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77a3b80 con 0x556bf7710c90 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:116 4.2c 4:36ed1c45:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77ae070 con 0x556bf76d9230 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 4.3b 4:dff81414:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b0ea0 con 0x556bf7710c90 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 4.2c 4:35e9aa0f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b3da0 con 0x556bf76d9230 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 4.31 4:8ed18207:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b6c90 con 0x556bf770cee0 2023-10-05T19:50:37.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 4.2e 4:74947a99:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b9b80 con 0x556bf7710c90 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(111 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(112 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(113 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(119 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(114 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.968+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(115 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(117 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(116 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(120 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(118 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93922201274016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b0ea0 con 0x556bf770cee0 2023-10-05T19:50:37.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(121 notify.0 [watch unwatch cookie 93922201274016] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2aff70de40 20 remove_watcher() i=0 2023-10-05T19:50:37.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2aff70de40 2 removed watcher, disabling cache 2023-10-05T19:50:37.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.972+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93922201275120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b9b80 con 0x556bf76d9230 2023-10-05T19:50:37.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.976+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(122 notify.1 [watch unwatch cookie 93922201275120] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.976+0000 7f2aff70de40 20 remove_watcher() i=1 2023-10-05T19:50:37.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.976+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93922201280896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b0ea0 con 0x556bf770cee0 2023-10-05T19:50:37.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.976+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(123 notify.2 [watch unwatch cookie 93922201280896] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.976+0000 7f2aff70de40 20 remove_watcher() i=2 2023-10-05T19:50:37.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.976+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:124 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93922201282000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b9b80 con 0x7f2af0007030 2023-10-05T19:50:37.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.980+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(124 notify.3 [watch unwatch cookie 93922201282000] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.980+0000 7f2aff70de40 20 remove_watcher() i=3 2023-10-05T19:50:37.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.980+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:125 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93922201285840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b0ea0 con 0x556bf770cee0 2023-10-05T19:50:37.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.980+0000 7f2afd242700 1 -- 172.21.15.167:0/3902318836 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(125 notify.4 [watch unwatch cookie 93922201285840] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af0041040 con 0x556bf770cee0 2023-10-05T19:50:37.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.980+0000 7f2aff70de40 20 remove_watcher() i=4 2023-10-05T19:50:37.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.980+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:126 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93922201289520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b9b80 con 0x556bf7710c90 2023-10-05T19:50:37.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.984+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(126 notify.5 [watch unwatch cookie 93922201289520] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.984+0000 7f2aff70de40 20 remove_watcher() i=5 2023-10-05T19:50:37.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.984+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:127 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93922201293040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b0ea0 con 0x556bf7710c90 2023-10-05T19:50:37.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.984+0000 7f2afca41700 1 -- 172.21.15.167:0/3902318836 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(127 notify.6 [watch unwatch cookie 93922201293040] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ae801d040 con 0x556bf7710c90 2023-10-05T19:50:37.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.984+0000 7f2aff70de40 20 remove_watcher() i=6 2023-10-05T19:50:37.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.984+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:128 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93922201295248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b9b80 con 0x7f2af0007030 2023-10-05T19:50:37.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.984+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(128 notify.7 [watch unwatch cookie 93922201295248] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x7f2af0007030 2023-10-05T19:50:37.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.984+0000 7f2aff70de40 20 remove_watcher() i=7 2023-10-05T19:50:37.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2ace7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:37.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:129 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93922201296352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556bf77b0ea0 con 0x556bf76d9230 2023-10-05T19:50:37.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(129 data_loggenerations_metadata [watch unwatch cookie 93922201296352] v30'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2af8033040 con 0x556bf76d9230 2023-10-05T19:50:37.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556bf770cee0 msgr2=0x556bf7710120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x556bf770cee0 0x556bf7710120 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556bf76d9230 msgr2=0x556bf770c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x556bf76d9230 0x556bf770c1c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2af0007030 msgr2=0x7f2af001e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2af0007030 0x7f2af001e780 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556bf7710c90 msgr2=0x556bf7714ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x556bf7710c90 0x556bf7714ef0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:37.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ae0030ca0 msgr2=0x7f2ae0033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2ae0030ca0 0x7f2ae0033150 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80044f0 tx=0x7f2ae8006690 comp rx=0 tx=0).stop 2023-10-05T19:50:37.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 msgr2=0x556bf7700670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:37.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 --2- 172.21.15.167:0/3902318836 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf76d8920 0x556bf7700670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2af001f040 tx=0x7f2af001c000 comp rx=0 tx=0).stop 2023-10-05T19:50:37.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2afda43700 1 -- 172.21.15.167:0/3902318836 reap_dead start 2023-10-05T19:50:37.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 shutdown_connections 2023-10-05T19:50:37.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.988+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 >> 172.21.15.167:0/3902318836 conn(0x556bf76d4340 msgr2=0x556bf76f1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 shutdown_connections 2023-10-05T19:50:38.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 -- 172.21.15.167:0/3902318836 wait complete. 2023-10-05T19:50:38.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 -- 172.21.15.167:0/531510575 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2a44030c00 msgr2=0x7f2a440330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 --2- 172.21.15.167:0/531510575 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2a44030c00 0x7f2a440330b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x556bf771bca0 tx=0x7f2af800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:38.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 -- 172.21.15.167:0/531510575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 msgr2=0x556bf7731210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 --2- 172.21.15.167:0/531510575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf7731210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2ae803a040 tx=0x7f2ae8030000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 -- 172.21.15.167:0/531510575 shutdown_connections 2023-10-05T19:50:38.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 --2- 172.21.15.167:0/531510575 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2a44030c00 0x7f2a440330b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 --2- 172.21.15.167:0/531510575 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x556bf772b700 0x556bf7731210 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 -- 172.21.15.167:0/531510575 >> 172.21.15.167:0/531510575 conn(0x556bf7726ac0 msgr2=0x556bf7724bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 -- 172.21.15.167:0/531510575 shutdown_connections 2023-10-05T19:50:38.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:37.992+0000 7f2aff70de40 1 -- 172.21.15.167:0/531510575 wait complete. 2023-10-05T19:50:38.001 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "num_shards": 11, 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "tenant": "", 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "zonegroup": "62f730cc-f2d2-47e0-99d9-6d51a9a03581", 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_rule": "default-placement", 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "explicit_placement": { 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "", 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "", 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "" 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:38.002 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "marker": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": "Normal", 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1", 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "mtime": "2023-10-05T19:50:36.667938Z", 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "creation_time": "2023-10-05T19:50:36.660701Z", 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "usage": { 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "rgw.main": { 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 3, 2023-10-05T19:50:38.003 INFO:teuthology.orchestra.run.smithi167.stdout: "size_actual": 4096, 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "size_utilized": 3, 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "size_kb": 1, 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "size_kb_actual": 4, 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "size_kb_utilized": 1, 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "num_objects": 1 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:38.004 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:38.005 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:38.005 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:38.005 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:38.006 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '62f730cc-f2d2-47e0-99d9-6d51a9a03581', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T19:50:36.667938Z', 'creation_time': '2023-10-05T19:50:36.660701Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T19:50:38.006 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2023-10-05T19:50:38.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2023-10-05T19:50:38.006 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2023-10-05T19:50:38.047 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:38.047 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:38.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0c835e40 1 Processor -- start 2023-10-05T19:50:38.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0c835e40 1 -- start start 2023-10-05T19:50:38.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0c835e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560e13410930 0x560e13410d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0c835e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560e1335dbd0 con 0x560e13411240 2023-10-05T19:50:38.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0c835e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x560e1331aee0 con 0x560e13410930 2023-10-05T19:50:38.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0a36a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560e13410930 0x560e13410d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0a36a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560e13410930 0x560e13410d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45338/0 (socket says 172.21.15.167:45338) 2023-10-05T19:50:38.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0a36a700 1 -- 172.21.15.167:0/3175540361 learned_addr learned my addr 172.21.15.167:0/3175540361 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f09b69700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x560e13411240 0x560e13411ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51660/0 (socket says 172.21.15.167:51660) 2023-10-05T19:50:38.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0a36a700 1 -- 172.21.15.167:0/3175540361 >> v1:172.21.15.118:6789/0 conn(0x560e13411240 legacy=0x560e13411ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0a36a700 1 -- 172.21.15.167:0/3175540361 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e134123f0 con 0x560e13410930 2023-10-05T19:50:38.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f0a36a700 1 --2- 172.21.15.167:0/3175540361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e13410d00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400a5c0 tx=0x7f6f04005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d2d14526088d05 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f09368700 1 -- 172.21.15.167:0/3175540361 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0400e510 con 0x560e13410930 2023-10-05T19:50:38.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f09368700 1 -- 172.21.15.167:0/3175540361 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0400e670 con 0x560e13410930 2023-10-05T19:50:38.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.040+0000 7f6f09368700 1 -- 172.21.15.167:0/3175540361 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0400e920 con 0x560e13410930 2023-10-05T19:50:38.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 -- 172.21.15.167:0/3175540361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 msgr2=0x560e13410d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/3175540361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e13410d00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400a5c0 tx=0x7f6f04005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:38.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 -- 172.21.15.167:0/3175540361 shutdown_connections 2023-10-05T19:50:38.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/3175540361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e13410d00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 -- 172.21.15.167:0/3175540361 >> 172.21.15.167:0/3175540361 conn(0x560e1340c350 msgr2=0x560e1340e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 -- 172.21.15.167:0/3175540361 shutdown_connections 2023-10-05T19:50:38.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 -- 172.21.15.167:0/3175540361 wait complete. 2023-10-05T19:50:38.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 Processor -- start 2023-10-05T19:50:38.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 -- start start 2023-10-05T19:50:38.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e1342f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0c835e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e132dee30 con 0x560e13410930 2023-10-05T19:50:38.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0a36a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e1342f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0a36a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e1342f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45352/0 (socket says 172.21.15.167:45352) 2023-10-05T19:50:38.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0a36a700 1 -- 172.21.15.167:0/703300623 learned_addr learned my addr 172.21.15.167:0/703300623 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0a36a700 1 -- 172.21.15.167:0/703300623 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0400a180 con 0x560e13410930 2023-10-05T19:50:38.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6f0a36a700 1 --2- 172.21.15.167:0/703300623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e1342f970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400a510 tx=0x7f6f04013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcb575596789f06 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6efbfff700 1 -- 172.21.15.167:0/703300623 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0400e7e0 con 0x560e13410930 2023-10-05T19:50:38.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6efbfff700 1 -- 172.21.15.167:0/703300623 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0400e960 con 0x560e13410930 2023-10-05T19:50:38.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.044+0000 7f6efbfff700 1 -- 172.21.15.167:0/703300623 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0400ec50 con 0x560e13410930 2023-10-05T19:50:38.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 -- 172.21.15.167:0/703300623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 msgr2=0x560e1342f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/703300623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e1342f970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400a510 tx=0x7f6f04013000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 -- 172.21.15.167:0/703300623 shutdown_connections 2023-10-05T19:50:38.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/703300623 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e1342f970 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 -- 172.21.15.167:0/703300623 >> 172.21.15.167:0/703300623 conn(0x560e1340c350 msgr2=0x560e1342b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 -- 172.21.15.167:0/703300623 shutdown_connections 2023-10-05T19:50:38.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 -- 172.21.15.167:0/703300623 wait complete. 2023-10-05T19:50:38.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 Processor -- start 2023-10-05T19:50:38.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 -- start start 2023-10-05T19:50:38.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e134365d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e132b1ed0 con 0x560e13410930 2023-10-05T19:50:38.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0a36a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e134365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0a36a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e134365d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45358/0 (socket says 172.21.15.167:45358) 2023-10-05T19:50:38.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 learned_addr learned my addr 172.21.15.167:0/2284613334 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e134123f0 con 0x560e13410930 2023-10-05T19:50:38.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0a36a700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e134365d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6f0401e040 tx=0x7f6f0401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6efa7fc700 1 -- 172.21.15.167:0/2284613334 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0400ee50 con 0x560e13410930 2023-10-05T19:50:38.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6efa7fc700 1 -- 172.21.15.167:0/2284613334 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f04010b20 con 0x560e13410930 2023-10-05T19:50:38.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560e13436b10 con 0x560e13410930 2023-10-05T19:50:38.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.048+0000 7f6efa7fc700 1 -- 172.21.15.167:0/2284613334 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f04010e10 con 0x560e13410930 2023-10-05T19:50:38.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.052+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e13436ef0 con 0x560e13410930 2023-10-05T19:50:38.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.052+0000 7f6efa7fc700 1 -- 172.21.15.167:0/2284613334 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f6f0401c430 con 0x560e13410930 2023-10-05T19:50:38.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.052+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.052+0000 7f6efa7fc700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6eec030bb0 0x7f6eec033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.052+0000 7f6efa7fc700 1 -- 172.21.15.167:0/2284613334 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f6f040465c0 con 0x560e13410930 2023-10-05T19:50:38.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.052+0000 7f6f09b69700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6eec030bb0 0x7f6eec033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.052+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560e13411240 0x560e13442030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.052+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13442730 con 0x560e13411240 2023-10-05T19:50:38.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.052+0000 7f6f0ab6b700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560e13411240 0x560e13442030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f09b69700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6eec030bb0 0x7f6eec033060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000b300 tx=0x7f6f00001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0ab6b700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560e13411240 0x560e13442030 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6efc00a500 con 0x560e13411240 2023-10-05T19:50:38.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 20 realm 2023-10-05T19:50:38.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1343f690 con 0x560e13411240 2023-10-05T19:50:38.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6efc00a500 con 0x560e13411240 2023-10-05T19:50:38.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:38.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13443210 con 0x560e13411240 2023-10-05T19:50:38.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6efc00a500 con 0x560e13411240 2023-10-05T19:50:38.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560e13442e40 0x560e13446080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134467b0 con 0x560e13442e40 2023-10-05T19:50:38.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0a36a700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560e13442e40 0x560e13446080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0a36a700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560e13442e40 0x560e13446080 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.056+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13447080 con 0x560e13411240 2023-10-05T19:50:38.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6efc00a500 con 0x560e13411240 2023-10-05T19:50:38.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f0c835e40 20 searching for the correct realm 2023-10-05T19:50:38.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560e13446bf0 0x560e1344ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13446bf0 2023-10-05T19:50:38.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f09b69700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560e13446bf0 0x560e1344ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f09b69700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560e13446bf0 0x560e1344ae50 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13442e40 2023-10-05T19:50:38.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f0a36a700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6f04037030 0x7f6f040390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x7f6f04037030 2023-10-05T19:50:38.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.060+0000 7f6f0ab6b700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6f04037030 0x7f6f040390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0ab6b700 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6f04037030 0x7f6f040390c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x7f6f04037030 2023-10-05T19:50:38.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13446bf0 2023-10-05T19:50:38.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13442e40 2023-10-05T19:50:38.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.064+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13442e40 2023-10-05T19:50:38.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x7f6f04037030 2023-10-05T19:50:38.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x7f6f04037030 2023-10-05T19:50:38.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x7f6f04037030 2023-10-05T19:50:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x7f6f04037030 2023-10-05T19:50:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13442e40 2023-10-05T19:50:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.068+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13446bf0 2023-10-05T19:50:38.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13442e40 2023-10-05T19:50:38.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13446bf0 2023-10-05T19:50:38.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.072+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13446bf0 2023-10-05T19:50:38.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x7f6f04037030 2023-10-05T19:50:38.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x7f6f04037030 2023-10-05T19:50:38.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13411240 2023-10-05T19:50:38.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x7f6f04037030 2023-10-05T19:50:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x7f6f04037030 2023-10-05T19:50:38.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13446bf0 2023-10-05T19:50:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x7f6f04037030 2023-10-05T19:50:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x7f6f04037030 2023-10-05T19:50:38.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.076+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13442e40 2023-10-05T19:50:38.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13442e40 2023-10-05T19:50:38.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13446bf0 2023-10-05T19:50:38.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13442e40 2023-10-05T19:50:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344b430 con 0x560e13442e40 2023-10-05T19:50:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0c835e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0c835e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0c835e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0c835e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13447bf0 con 0x560e13411240 2023-10-05T19:50:38.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.080+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134484e0 con 0x560e13442e40 2023-10-05T19:50:38.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13447820 con 0x560e13442e40 2023-10-05T19:50:38.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344bde0 con 0x560e13446bf0 2023-10-05T19:50:38.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c540 con 0x560e13442e40 2023-10-05T19:50:38.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.084+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344d900 con 0x560e13446bf0 2023-10-05T19:50:38.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344d900 con 0x560e13442e40 2023-10-05T19:50:38.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344d900 con 0x7f6f04037030 2023-10-05T19:50:38.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x7f6f04037030 2023-10-05T19:50:38.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13446bf0 2023-10-05T19:50:38.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.088+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13442e40 2023-10-05T19:50:38.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13442e40 2023-10-05T19:50:38.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x7f6f04037030 2023-10-05T19:50:38.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x7f6f04037030 2023-10-05T19:50:38.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x7f6f04037030 2023-10-05T19:50:38.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x7f6f04037030 2023-10-05T19:50:38.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.092+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13442e40 2023-10-05T19:50:38.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13446bf0 2023-10-05T19:50:38.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13442e40 2023-10-05T19:50:38.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13446bf0 2023-10-05T19:50:38.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc014040 con 0x560e13411240 2023-10-05T19:50:38.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.096+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13446bf0 2023-10-05T19:50:38.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x7f6f04037030 2023-10-05T19:50:38.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13411240 2023-10-05T19:50:38.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x7f6f04037030 2023-10-05T19:50:38.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.100+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13446bf0 2023-10-05T19:50:38.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x7f6f04037030 2023-10-05T19:50:38.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13442e40 2023-10-05T19:50:38.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13442e40 2023-10-05T19:50:38.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13446bf0 2023-10-05T19:50:38.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13442e40 2023-10-05T19:50:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.104+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c190 con 0x560e13442e40 2023-10-05T19:50:38.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c8f0 con 0x560e13442e40 2023-10-05T19:50:38.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344c8f0 con 0x560e13411240 2023-10-05T19:50:38.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344d190 con 0x560e13442e40 2023-10-05T19:50:38.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.108+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344d190 con 0x560e13442e40 2023-10-05T19:50:38.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344d290 con 0x7f6f04037030 2023-10-05T19:50:38.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 zone default found 2023-10-05T19:50:38.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 4 Realm: () 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 zonegroup default 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344d290 con 0x7f6f04037030 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344ec10 con 0x560e13446bf0 2023-10-05T19:50:38.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344efc0 con 0x560e13446bf0 2023-10-05T19:50:38.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 started sync module instance, tier type = 2023-10-05T19:50:38.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:38.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.112+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344e2d0 con 0x560e13442e40 2023-10-05T19:50:38.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.116+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.116+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94618452811232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344e7f0 con 0x560e13442e40 2023-10-05T19:50:38.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.116+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344e2d0 con 0x560e13411240 2023-10-05T19:50:38.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.116+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94618452811232] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.116+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.116+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94618452816752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e1344e290 con 0x560e13411240 2023-10-05T19:50:38.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.116+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13450400 con 0x560e13442e40 2023-10-05T19:50:38.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.120+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.120+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94618452819728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13450850 con 0x560e13442e40 2023-10-05T19:50:38.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.120+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13451130 con 0x7f6f04037030 2023-10-05T19:50:38.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.120+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94618452816752] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.120+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.120+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94618452817856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13450d40 con 0x7f6f04037030 2023-10-05T19:50:38.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.120+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13451a20 con 0x560e13442e40 2023-10-05T19:50:38.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.120+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94618452819728] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.124+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94618452817856] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.124+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.124+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94618452825952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13450850 con 0x560e13442e40 2023-10-05T19:50:38.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.124+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13452310 con 0x560e13446bf0 2023-10-05T19:50:38.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.124+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.124+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94618452827680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13450850 con 0x560e13446bf0 2023-10-05T19:50:38.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.124+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13453210 con 0x560e13446bf0 2023-10-05T19:50:38.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.124+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94618452825952] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94618452827680] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94618452831520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134535c0 con 0x560e13446bf0 2023-10-05T19:50:38.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13453e60 con 0x7f6f04037030 2023-10-05T19:50:38.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94618452831520] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f0000f560 con 0x560e13446bf0 2023-10-05T19:50:38.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94618452833728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13453f00 con 0x7f6f04037030 2023-10-05T19:50:38.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 20 add_watcher() i=0 2023-10-05T19:50:38.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 20 add_watcher() i=1 2023-10-05T19:50:38.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 20 add_watcher() i=2 2023-10-05T19:50:38.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 20 add_watcher() i=3 2023-10-05T19:50:38.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 20 add_watcher() i=4 2023-10-05T19:50:38.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 20 add_watcher() i=5 2023-10-05T19:50:38.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.128+0000 7f6f0c835e40 20 add_watcher() i=6 2023-10-05T19:50:38.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94618452833728] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 20 add_watcher() i=7 2023-10-05T19:50:38.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:38.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13456f70 con 0x560e13411240 2023-10-05T19:50:38.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94618452834832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e13454500 con 0x560e13411240 2023-10-05T19:50:38.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94618452834832] v30'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6edbfdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:38.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:38.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 1 Processor -- start 2023-10-05T19:50:38.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 1 -- start start 2023-10-05T19:50:38.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13461830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.132+0000 7f6f0c835e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13461d70 con 0x560e13461460 2023-10-05T19:50:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f09b69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13461830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f09b69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13461830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45374/0 (socket says 172.21.15.167:45374) 2023-10-05T19:50:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f09b69700 1 -- 172.21.15.167:0/1958255436 learned_addr learned my addr 172.21.15.167:0/1958255436 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f09b69700 1 -- 172.21.15.167:0/1958255436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e13461eb0 con 0x560e13461460 2023-10-05T19:50:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f09b69700 1 --2- 172.21.15.167:0/1958255436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13461830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6f00000fb0 tx=0x7f6f00006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386bb5d5ed2fcf08 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6edb7de700 1 -- 172.21.15.167:0/1958255436 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0002e740 con 0x560e13461460 2023-10-05T19:50:38.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6edb7de700 1 -- 172.21.15.167:0/1958255436 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f00024040 con 0x560e13461460 2023-10-05T19:50:38.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6edb7de700 1 -- 172.21.15.167:0/1958255436 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0002e8e0 con 0x560e13461460 2023-10-05T19:50:38.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 -- 172.21.15.167:0/1958255436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 msgr2=0x560e13461830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/1958255436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13461830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6f00000fb0 tx=0x7f6f00006000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 -- 172.21.15.167:0/1958255436 shutdown_connections 2023-10-05T19:50:38.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/1958255436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13461830 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 -- 172.21.15.167:0/1958255436 >> 172.21.15.167:0/1958255436 conn(0x560e1345c820 msgr2=0x560e1345a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 -- 172.21.15.167:0/1958255436 shutdown_connections 2023-10-05T19:50:38.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 -- 172.21.15.167:0/1958255436 wait complete. 2023-10-05T19:50:38.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 Processor -- start 2023-10-05T19:50:38.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 -- start start 2023-10-05T19:50:38.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13386450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.136+0000 7f6f0c835e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e13385d50 con 0x560e13461460 2023-10-05T19:50:38.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6f09b69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13386450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6f09b69700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13386450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45388/0 (socket says 172.21.15.167:45388) 2023-10-05T19:50:38.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6f09b69700 1 -- 172.21.15.167:0/220980478 learned_addr learned my addr 172.21.15.167:0/220980478 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6f09b69700 1 -- 172.21.15.167:0/220980478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00006070 con 0x560e13461460 2023-10-05T19:50:38.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6f09b69700 1 --2- 172.21.15.167:0/220980478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13386450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x560e13447790 tx=0x7f6f00037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6ed9fdb700 1 -- 172.21.15.167:0/220980478 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0002c410 con 0x560e13461460 2023-10-05T19:50:38.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6ed9fdb700 1 -- 172.21.15.167:0/220980478 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0002c570 con 0x560e13461460 2023-10-05T19:50:38.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6f0c835e40 1 -- 172.21.15.167:0/220980478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560e13386a50 con 0x560e13461460 2023-10-05T19:50:38.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6ed9fdb700 1 -- 172.21.15.167:0/220980478 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f0002c700 con 0x560e13461460 2023-10-05T19:50:38.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6f0c835e40 1 -- 172.21.15.167:0/220980478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e13384db0 con 0x560e13461460 2023-10-05T19:50:38.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6ed9fdb700 1 -- 172.21.15.167:0/220980478 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f6f0001a040 con 0x560e13461460 2023-10-05T19:50:38.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6ed9fdb700 1 --2- 172.21.15.167:0/220980478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c50 0x7f6e50033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6ed9fdb700 1 -- 172.21.15.167:0/220980478 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f6f0004cc10 con 0x560e13461460 2023-10-05T19:50:38.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6f0ab6b700 1 --2- 172.21.15.167:0/220980478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c50 0x7f6e50033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.140+0000 7f6f0c835e40 5 note: GC not initialized 2023-10-05T19:50:38.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0ab6b700 1 --2- 172.21.15.167:0/220980478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c50 0x7f6e50033100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x560e13454460 tx=0x7f6efc00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6e4affd700 20 reqs_thread_entry: start 2023-10-05T19:50:38.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6e48ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:38.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0c835e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:38.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0c835e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:38.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6e3affd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:08 2023 2023-10-05T19:50:38.153 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:38.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6e3a7fc700 20 reqs_thread_entry: start 2023-10-05T19:50:38.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0c835e40 20 get_system_obj_state: rctx=0x7fffc89e9fa8 obj=default.rgw.meta:users.uid:foo state=0x560e132ea0b0 s->prefetch_data=0 2023-10-05T19:50:38.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134d1950 con 0x560e13411240 2023-10-05T19:50:38.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0c835e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0c835e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.144+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134d1920 con 0x560e13411240 2023-10-05T19:50:38.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:38.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134d1920 con 0x7f6f04037030 2023-10-05T19:50:38.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 20 get_system_obj_state: rctx=0x7fffc89ea300 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x560e132ea0b0 s->prefetch_data=0 2023-10-05T19:50:38.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134d1920 con 0x560e13411240 2023-10-05T19:50:38.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:38.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134d5660 con 0x560e13411240 2023-10-05T19:50:38.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(106 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:38.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T19:50:38.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 4.21 4:85bb0c4e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134d5040 con 0x560e13446bf0 2023-10-05T19:50:38.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 4.3c 4:3c5ab7e8:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134d7d20 con 0x560e13411240 2023-10-05T19:50:38.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 4.b 4:d3872b52:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134da6f0 con 0x7f6f04037030 2023-10-05T19:50:38.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 4.38 4:1c83dc09:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134dcfb0 con 0x560e13442e40 2023-10-05T19:50:38.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 4.32 4:4f10a7ef:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134df870 con 0x560e13442e40 2023-10-05T19:50:38.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 4.10 4:0b50a70f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134e22d0 con 0x560e13446bf0 2023-10-05T19:50:38.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 4.2c 4:36ed1c45:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134e4b90 con 0x560e13411240 2023-10-05T19:50:38.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:114 4.3b 4:dff81414:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134e7560 con 0x560e13446bf0 2023-10-05T19:50:38.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 4.2c 4:35e9aa0f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134e9ff0 con 0x560e13411240 2023-10-05T19:50:38.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.148+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 4.31 4:8ed18207:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ecc80 con 0x560e13442e40 2023-10-05T19:50:38.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 4.2e 4:74947a99:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13446bf0 2023-10-05T19:50:38.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(110 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6f00040040 con 0x560e13446bf0 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(114 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6f00040040 con 0x560e13446bf0 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(112 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f6f00040040 con 0x560e13446bf0 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(111 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(117 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6f0005a060 con 0x560e13446bf0 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(116 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(108 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(113 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(115 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:118 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x7f6f04037030 2023-10-05T19:50:38.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(118 foo.buckets [call] v30'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.152+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:119 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x7f6f04037030 2023-10-05T19:50:38.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(119 foo.buckets [call] v30'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0c835e40 20 get_system_obj_state: rctx=0x7fffc89ea1e8 obj=default.rgw.meta:users.uid:foo state=0x560e132ea0b0 s->prefetch_data=0 2023-10-05T19:50:38.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:120 8.18 8:1e6ca5ed:users.uid::foo:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13411240 2023-10-05T19:50:38.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(120 foo [getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+91 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0c835e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0c835e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:121 8.18 8:1e6ca5ed:users.uid::foo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13411240 2023-10-05T19:50:38.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(121 foo [read 0~357 out=357b] v0'0 uv11 ondisk = 0) v8 ==== 147+0+357 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0c835e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:38.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:122 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x7f6f04037030 2023-10-05T19:50:38.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(122 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.156+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94618452811232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13442e40 2023-10-05T19:50:38.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.160+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(123 notify.0 [watch unwatch cookie 94618452811232] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.160+0000 7f6f0c835e40 20 remove_watcher() i=0 2023-10-05T19:50:38.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.160+0000 7f6f0c835e40 2 removed watcher, disabling cache 2023-10-05T19:50:38.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.160+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:124 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94618452816752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13411240 2023-10-05T19:50:38.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.160+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(124 notify.1 [watch unwatch cookie 94618452816752] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.160+0000 7f6f0c835e40 20 remove_watcher() i=1 2023-10-05T19:50:38.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.160+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:125 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94618452819728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13442e40 2023-10-05T19:50:38.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.164+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(125 notify.2 [watch unwatch cookie 94618452819728] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.164+0000 7f6f0c835e40 20 remove_watcher() i=2 2023-10-05T19:50:38.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.164+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:126 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94618452817856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x7f6f04037030 2023-10-05T19:50:38.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.164+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(126 notify.3 [watch unwatch cookie 94618452817856] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.164+0000 7f6f0c835e40 20 remove_watcher() i=3 2023-10-05T19:50:38.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.164+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:127 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94618452825952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13442e40 2023-10-05T19:50:38.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.168+0000 7f6f0a36a700 1 -- 172.21.15.167:0/2284613334 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(127 notify.4 [watch unwatch cookie 94618452825952] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f04034070 con 0x560e13442e40 2023-10-05T19:50:38.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.168+0000 7f6f0c835e40 20 remove_watcher() i=4 2023-10-05T19:50:38.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.168+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:128 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94618452827680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13446bf0 2023-10-05T19:50:38.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.168+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(128 notify.5 [watch unwatch cookie 94618452827680] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f0005a060 con 0x560e13446bf0 2023-10-05T19:50:38.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.168+0000 7f6f0c835e40 20 remove_watcher() i=5 2023-10-05T19:50:38.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.168+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:129 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94618452831520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13446bf0 2023-10-05T19:50:38.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.168+0000 7f6f09b69700 1 -- 172.21.15.167:0/2284613334 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(129 notify.6 [watch unwatch cookie 94618452831520] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6f0005a060 con 0x560e13446bf0 2023-10-05T19:50:38.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.172+0000 7f6f0c835e40 20 remove_watcher() i=6 2023-10-05T19:50:38.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.172+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:130 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94618452833728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x7f6f04037030 2023-10-05T19:50:38.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.172+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(130 notify.7 [watch unwatch cookie 94618452833728] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x7f6f04037030 2023-10-05T19:50:38.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.172+0000 7f6f0c835e40 20 remove_watcher() i=7 2023-10-05T19:50:38.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.172+0000 7f6edbfdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.172+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:131 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94618452834832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560e134ef770 con 0x560e13411240 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(131 data_loggenerations_metadata [watch unwatch cookie 94618452834832] v30'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6efc033040 con 0x560e13411240 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560e13442e40 msgr2=0x560e13446080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560e13442e40 0x560e13446080 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560e13411240 msgr2=0x560e13442030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560e13411240 0x560e13442030 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6f04037030 msgr2=0x7f6f040390c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6f04037030 0x7f6f040390c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560e13446bf0 msgr2=0x560e1344ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560e13446bf0 0x560e1344ae50 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6eec030bb0 msgr2=0x7f6eec033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6eec030bb0 0x7f6eec033060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000b300 tx=0x7f6f00001430 comp rx=0 tx=0).stop 2023-10-05T19:50:38.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0ab6b700 1 -- 172.21.15.167:0/2284613334 reap_dead start 2023-10-05T19:50:38.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 msgr2=0x560e134365d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e134365d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6f0401e040 tx=0x7f6f0401c000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 shutdown_connections 2023-10-05T19:50:38.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/2284613334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13410930 0x560e134365d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 >> 172.21.15.167:0/2284613334 conn(0x560e1340c350 msgr2=0x560e13429fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 shutdown_connections 2023-10-05T19:50:38.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/2284613334 wait complete. 2023-10-05T19:50:38.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/220980478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c50 msgr2=0x7f6e50033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/220980478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c50 0x7f6e50033100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x560e13454460 tx=0x7f6efc00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:38.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/220980478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 msgr2=0x560e13386450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/220980478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13386450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x560e13447790 tx=0x7f6f00037000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/220980478 shutdown_connections 2023-10-05T19:50:38.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/220980478 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c50 0x7f6e50033100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 --2- 172.21.15.167:0/220980478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560e13461460 0x560e13386450 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/220980478 >> 172.21.15.167:0/220980478 conn(0x560e1345c820 msgr2=0x560e1345a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/220980478 shutdown_connections 2023-10-05T19:50:38.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.176+0000 7f6f0c835e40 1 -- 172.21.15.167:0/220980478 wait complete. 2023-10-05T19:50:38.188 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:38.188 INFO:teuthology.orchestra.run.smithi167.stdout: "stats": { 2023-10-05T19:50:38.189 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 3, 2023-10-05T19:50:38.189 INFO:teuthology.orchestra.run.smithi167.stdout: "size_actual": 4096, 2023-10-05T19:50:38.189 INFO:teuthology.orchestra.run.smithi167.stdout: "size_kb": 1, 2023-10-05T19:50:38.189 INFO:teuthology.orchestra.run.smithi167.stdout: "size_kb_actual": 4, 2023-10-05T19:50:38.189 INFO:teuthology.orchestra.run.smithi167.stdout: "num_objects": 1 2023-10-05T19:50:38.189 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:38.189 INFO:teuthology.orchestra.run.smithi167.stdout: "last_stats_sync": "2023-10-05T19:50:38.159135Z", 2023-10-05T19:50:38.189 INFO:teuthology.orchestra.run.smithi167.stdout: "last_stats_update": "2023-10-05T19:50:38.157261Z" 2023-10-05T19:50:38.189 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:38.191 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2023-10-05T19:50:38.159135Z', 'last_stats_update': '2023-10-05T19:50:38.157261Z'} 2023-10-05T19:50:38.199 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:38.199 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2023-10-05T19:50:38.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2023-10-05T19:50:38.199 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2023-10-05T19:50:38.276 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:38.276 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.268+0000 7f212333ce40 1 Processor -- start 2023-10-05T19:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.268+0000 7f212333ce40 1 -- start start 2023-10-05T19:50:38.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.268+0000 7f212333ce40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f1724e1e20 0x55f1724e4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.268+0000 7f212333ce40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f17242abd0 con 0x55f1724514a0 2023-10-05T19:50:38.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.268+0000 7f212333ce40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f1723e7ee0 con 0x55f1724e1e20 2023-10-05T19:50:38.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.268+0000 7f2120670700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f1724e1e20 0x55f1724e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.268+0000 7f2120e71700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55f1724514a0 0x55f1724e0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51668/0 (socket says 172.21.15.167:51668) 2023-10-05T19:50:38.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.268+0000 7f2120670700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f1724e1e20 0x55f1724e4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45396/0 (socket says 172.21.15.167:45396) 2023-10-05T19:50:38.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.268+0000 7f2120e71700 1 -- 172.21.15.167:0/3283330495 learned_addr learned my addr 172.21.15.167:0/3283330495 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:38.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f2120670700 1 -- 172.21.15.167:0/3283330495 >> v1:172.21.15.118:6789/0 conn(0x55f1724514a0 legacy=0x55f1724e0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f2120670700 1 -- 172.21.15.167:0/3283330495 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1724e5750 con 0x55f1724e1e20 2023-10-05T19:50:38.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f2120670700 1 --2- 172.21.15.167:0/3283330495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724e1e20 0x55f1724e4200 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f211000a5d0 tx=0x7f2110005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59d7b73b5b52514 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f211fe6f700 1 -- 172.21.15.167:0/3283330495 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21100086a0 con 0x55f1724e1e20 2023-10-05T19:50:38.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f211fe6f700 1 -- 172.21.15.167:0/3283330495 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2110008800 con 0x55f1724e1e20 2023-10-05T19:50:38.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f211fe6f700 1 -- 172.21.15.167:0/3283330495 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2110008ad0 con 0x55f1724e1e20 2023-10-05T19:50:38.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 -- 172.21.15.167:0/3283330495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724e1e20 msgr2=0x55f1724e4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 --2- 172.21.15.167:0/3283330495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724e1e20 0x55f1724e4200 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f211000a5d0 tx=0x7f2110005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:38.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 -- 172.21.15.167:0/3283330495 shutdown_connections 2023-10-05T19:50:38.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 --2- 172.21.15.167:0/3283330495 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724e1e20 0x55f1724e4200 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 -- 172.21.15.167:0/3283330495 >> 172.21.15.167:0/3283330495 conn(0x55f1724d8250 msgr2=0x55f1724da660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 -- 172.21.15.167:0/3283330495 shutdown_connections 2023-10-05T19:50:38.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 -- 172.21.15.167:0/3283330495 wait complete. 2023-10-05T19:50:38.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 Processor -- start 2023-10-05T19:50:38.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 -- start start 2023-10-05T19:50:38.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f1724fc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f212333ce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1723abe30 con 0x55f1724514a0 2023-10-05T19:50:38.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f2120e71700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f1724fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f2120e71700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f1724fc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45400/0 (socket says 172.21.15.167:45400) 2023-10-05T19:50:38.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.272+0000 7f2120e71700 1 -- 172.21.15.167:0/505935106 learned_addr learned my addr 172.21.15.167:0/505935106 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f2120e71700 1 -- 172.21.15.167:0/505935106 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2110005cf0 con 0x55f1724514a0 2023-10-05T19:50:38.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f2120e71700 1 --2- 172.21.15.167:0/505935106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f1724fc9a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2108001bf0 tx=0x7f21080017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca9f467e13395c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f211ee6d700 1 -- 172.21.15.167:0/505935106 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f210800bbf0 con 0x55f1724514a0 2023-10-05T19:50:38.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f211ee6d700 1 -- 172.21.15.167:0/505935106 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800bd50 con 0x55f1724514a0 2023-10-05T19:50:38.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f211ee6d700 1 -- 172.21.15.167:0/505935106 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f210800e470 con 0x55f1724514a0 2023-10-05T19:50:38.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f212333ce40 1 -- 172.21.15.167:0/505935106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 msgr2=0x55f1724fc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f212333ce40 1 --2- 172.21.15.167:0/505935106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f1724fc9a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2108001bf0 tx=0x7f21080017a0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f212333ce40 1 -- 172.21.15.167:0/505935106 shutdown_connections 2023-10-05T19:50:38.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f212333ce40 1 --2- 172.21.15.167:0/505935106 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f1724fc9a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f212333ce40 1 -- 172.21.15.167:0/505935106 >> 172.21.15.167:0/505935106 conn(0x55f1724d8250 msgr2=0x55f1724f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f212333ce40 1 -- 172.21.15.167:0/505935106 shutdown_connections 2023-10-05T19:50:38.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f212333ce40 1 -- 172.21.15.167:0/505935106 wait complete. 2023-10-05T19:50:38.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f212333ce40 1 Processor -- start 2023-10-05T19:50:38.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.276+0000 7f212333ce40 1 -- start start 2023-10-05T19:50:38.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f212333ce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f172503770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f212333ce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17237eed0 con 0x55f1724514a0 2023-10-05T19:50:38.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f2120e71700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f172503770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f2120e71700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f172503770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45408/0 (socket says 172.21.15.167:45408) 2023-10-05T19:50:38.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 learned_addr learned my addr 172.21.15.167:0/478577621 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f17242abd0 con 0x55f1724514a0 2023-10-05T19:50:38.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f2120e71700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f172503770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55f1724f9080 tx=0x7f2108016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f211d66a700 1 -- 172.21.15.167:0/478577621 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f210801f070 con 0x55f1724514a0 2023-10-05T19:50:38.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f211d66a700 1 -- 172.21.15.167:0/478577621 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210801a2e0 con 0x55f1724514a0 2023-10-05T19:50:38.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f172503cb0 con 0x55f1724514a0 2023-10-05T19:50:38.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f211d66a700 1 -- 172.21.15.167:0/478577621 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f210800bec0 con 0x55f1724514a0 2023-10-05T19:50:38.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.280+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1725040f0 con 0x55f1724514a0 2023-10-05T19:50:38.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f211d66a700 1 -- 172.21.15.167:0/478577621 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f210801a960 con 0x55f1724514a0 2023-10-05T19:50:38.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f211d66a700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2104030c50 0x7f2104033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f211d66a700 1 -- 172.21.15.167:0/478577621 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f21080450c0 con 0x55f1724514a0 2023-10-05T19:50:38.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f2120670700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2104030c50 0x7f2104033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f1724e1e20 0x55f17250f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17250f8a0 con 0x55f1724e1e20 2023-10-05T19:50:38.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f2121672700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f1724e1e20 0x55f17250f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f2120670700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2104030c50 0x7f2104033100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2110005a90 tx=0x7f2110015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f2121672700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f1724e1e20 0x55f17250f230 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 20 realm 2023-10-05T19:50:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17250c890 con 0x55f1724e1e20 2023-10-05T19:50:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:38.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.284+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172510380 con 0x55f1724e1e20 2023-10-05T19:50:38.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f1725111b0 0x55f172513590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172513ad0 con 0x55f1725111b0 2023-10-05T19:50:38.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f2120e71700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f1725111b0 0x55f172513590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f2120e71700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f1725111b0 0x55f172513590 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172514370 con 0x55f1724e1e20 2023-10-05T19:50:38.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 20 searching for the correct realm 2023-10-05T19:50:38.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f172516130 0x55f172518510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f172516130 2023-10-05T19:50:38.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f2120670700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f172516130 0x55f172518510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.288+0000 7f2120670700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f172516130 0x55f172518510 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1725111b0 2023-10-05T19:50:38.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2120e71700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f210802d020 0x7f210803d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x7f210802d020 2023-10-05T19:50:38.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2121672700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f210802d020 0x7f210803d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2121672700 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f210802d020 0x7f210803d8d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f172516130 2023-10-05T19:50:38.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.292+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1725111b0 2023-10-05T19:50:38.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1725111b0 2023-10-05T19:50:38.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x7f210802d020 2023-10-05T19:50:38.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x7f210802d020 2023-10-05T19:50:38.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.296+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1725111b0 2023-10-05T19:50:38.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f172516130 2023-10-05T19:50:38.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1725111b0 2023-10-05T19:50:38.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f172516130 2023-10-05T19:50:38.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.300+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f172516130 2023-10-05T19:50:38.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x7f210802d020 2023-10-05T19:50:38.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1724e1e20 2023-10-05T19:50:38.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x7f210802d020 2023-10-05T19:50:38.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f172516130 2023-10-05T19:50:38.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x7f210802d020 2023-10-05T19:50:38.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.304+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1725111b0 2023-10-05T19:50:38.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1725111b0 2023-10-05T19:50:38.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f172516130 2023-10-05T19:50:38.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1725111b0 2023-10-05T19:50:38.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518a50 con 0x55f1725111b0 2023-10-05T19:50:38.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f212333ce40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f212333ce40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f212333ce40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f212333ce40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172514ee0 con 0x55f1724e1e20 2023-10-05T19:50:38.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.308+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172515830 con 0x55f1725111b0 2023-10-05T19:50:38.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172518e00 con 0x55f1725111b0 2023-10-05T19:50:38.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725191b0 con 0x55f172516130 2023-10-05T19:50:38.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172519560 con 0x55f1724e1e20 2023-10-05T19:50:38.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172515400 con 0x55f1725111b0 2023-10-05T19:50:38.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f172516130 2023-10-05T19:50:38.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.312+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1725111b0 2023-10-05T19:50:38.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x7f210802d020 2023-10-05T19:50:38.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f172516130 2023-10-05T19:50:38.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.316+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1725111b0 2023-10-05T19:50:38.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1725111b0 2023-10-05T19:50:38.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x7f210802d020 2023-10-05T19:50:38.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.320+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x7f210802d020 2023-10-05T19:50:38.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1725111b0 2023-10-05T19:50:38.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f172516130 2023-10-05T19:50:38.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1725111b0 2023-10-05T19:50:38.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f172516130 2023-10-05T19:50:38.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.324+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f172516130 2023-10-05T19:50:38.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x7f210802d020 2023-10-05T19:50:38.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1724e1e20 2023-10-05T19:50:38.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x7f210802d020 2023-10-05T19:50:38.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.328+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f172516130 2023-10-05T19:50:38.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x7f210802d020 2023-10-05T19:50:38.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1725111b0 2023-10-05T19:50:38.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1725111b0 2023-10-05T19:50:38.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f172516130 2023-10-05T19:50:38.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.332+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1725111b0 2023-10-05T19:50:38.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251ae90 con 0x55f1725111b0 2023-10-05T19:50:38.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2108014070 con 0x55f1725111b0 2023-10-05T19:50:38.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172519e80 con 0x55f1725111b0 2023-10-05T19:50:38.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251a230 con 0x55f1724e1e20 2023-10-05T19:50:38.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172519a30 con 0x55f1725111b0 2023-10-05T19:50:38.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.336+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172519a00 con 0x55f1725111b0 2023-10-05T19:50:38.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172519a00 con 0x7f210802d020 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 zone default found 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 4 Realm: () 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 zonegroup default 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172519a00 con 0x7f210802d020 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172519a00 con 0x55f172516130 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251cbc0 con 0x55f172516130 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 started sync module instance, tier type = 2023-10-05T19:50:38.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:38.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.340+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c770 con 0x55f1725111b0 2023-10-05T19:50:38.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.344+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.344+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94495493440128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c6d0 con 0x55f1725111b0 2023-10-05T19:50:38.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.344+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251d950 con 0x55f1724e1e20 2023-10-05T19:50:38.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.348+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94495493440128] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.348+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.348+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94495493443440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c6d0 con 0x55f1724e1e20 2023-10-05T19:50:38.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.348+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251df10 con 0x55f1725111b0 2023-10-05T19:50:38.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.348+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.348+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94495493443440] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.348+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94495493444544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251df10 con 0x55f1725111b0 2023-10-05T19:50:38.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.348+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251e7b0 con 0x7f210802d020 2023-10-05T19:50:38.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.352+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.352+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94495493447728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251e970 con 0x7f210802d020 2023-10-05T19:50:38.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.352+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94495493444544] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.352+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251da20 con 0x55f1725111b0 2023-10-05T19:50:38.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.352+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94495493447728] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.352+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.352+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94495493448832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251e8d0 con 0x55f1725111b0 2023-10-05T19:50:38.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.352+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251f9e0 con 0x55f172516130 2023-10-05T19:50:38.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.356+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94495493448832] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.356+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.356+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94495493451776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251fd90 con 0x55f172516130 2023-10-05T19:50:38.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.356+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725207a0 con 0x55f172516130 2023-10-05T19:50:38.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.356+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94495493451776] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.356+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.356+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94495493452880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172521040 con 0x55f172516130 2023-10-05T19:50:38.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.356+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725218e0 con 0x7f210802d020 2023-10-05T19:50:38.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94495493461536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172522020 con 0x7f210802d020 2023-10-05T19:50:38.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 20 add_watcher() i=0 2023-10-05T19:50:38.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 20 add_watcher() i=1 2023-10-05T19:50:38.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 20 add_watcher() i=2 2023-10-05T19:50:38.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 20 add_watcher() i=3 2023-10-05T19:50:38.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 20 add_watcher() i=4 2023-10-05T19:50:38.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 20 add_watcher() i=5 2023-10-05T19:50:38.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94495493452880] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2110012450 con 0x55f172516130 2023-10-05T19:50:38.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 20 add_watcher() i=6 2023-10-05T19:50:38.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94495493461536] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x7f210802d020 2023-10-05T19:50:38.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 20 add_watcher() i=7 2023-10-05T19:50:38.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:38.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f172520b50 con 0x55f1724e1e20 2023-10-05T19:50:38.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.360+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94495493462768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725224e0 con 0x55f1724e1e20 2023-10-05T19:50:38.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94495493462768] v30'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f211800a5a0 con 0x55f1724e1e20 2023-10-05T19:50:38.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f20f17f2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:38.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:38.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 Processor -- start 2023-10-05T19:50:38.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 -- start start 2023-10-05T19:50:38.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f17252fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17252ff90 con 0x55f17252f680 2023-10-05T19:50:38.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f2120670700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f17252fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f2120670700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f17252fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45420/0 (socket says 172.21.15.167:45420) 2023-10-05T19:50:38.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f2120670700 1 -- 172.21.15.167:0/4198296783 learned_addr learned my addr 172.21.15.167:0/4198296783 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f2120670700 1 -- 172.21.15.167:0/4198296783 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1725300d0 con 0x55f17252f680 2023-10-05T19:50:38.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f2120670700 1 --2- 172.21.15.167:0/4198296783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f17252fa50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55f172450d30 tx=0x7f2110012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f89a82c6edbc124 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f20f0ff1700 1 -- 172.21.15.167:0/4198296783 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f211002d040 con 0x55f17252f680 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f20f0ff1700 1 -- 172.21.15.167:0/4198296783 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2110028890 con 0x55f17252f680 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f20f0ff1700 1 -- 172.21.15.167:0/4198296783 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2110012980 con 0x55f17252f680 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 -- 172.21.15.167:0/4198296783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 msgr2=0x55f17252fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 --2- 172.21.15.167:0/4198296783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f17252fa50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55f172450d30 tx=0x7f2110012000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 -- 172.21.15.167:0/4198296783 shutdown_connections 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 --2- 172.21.15.167:0/4198296783 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f17252fa50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 -- 172.21.15.167:0/4198296783 >> 172.21.15.167:0/4198296783 conn(0x55f17252aa40 msgr2=0x55f172528b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 -- 172.21.15.167:0/4198296783 shutdown_connections 2023-10-05T19:50:38.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.364+0000 7f212333ce40 1 -- 172.21.15.167:0/4198296783 wait complete. 2023-10-05T19:50:38.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f212333ce40 1 Processor -- start 2023-10-05T19:50:38.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f212333ce40 1 -- start start 2023-10-05T19:50:38.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f212333ce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f1724ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f212333ce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1724dd7b0 con 0x55f17252f680 2023-10-05T19:50:38.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f2120670700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f1724ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f2120670700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f1724ddeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45434/0 (socket says 172.21.15.167:45434) 2023-10-05T19:50:38.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f2120670700 1 -- 172.21.15.167:0/642959497 learned_addr learned my addr 172.21.15.167:0/642959497 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f2120670700 1 -- 172.21.15.167:0/642959497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1724e5750 con 0x55f17252f680 2023-10-05T19:50:38.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f2120670700 1 --2- 172.21.15.167:0/642959497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f1724ddeb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x55f172529700 tx=0x7f211002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f206affd700 1 -- 172.21.15.167:0/642959497 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2110033640 con 0x55f17252f680 2023-10-05T19:50:38.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f206affd700 1 -- 172.21.15.167:0/642959497 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21100337c0 con 0x55f17252f680 2023-10-05T19:50:38.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f212333ce40 1 -- 172.21.15.167:0/642959497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f1724de4b0 con 0x55f17252f680 2023-10-05T19:50:38.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f206affd700 1 -- 172.21.15.167:0/642959497 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2110033970 con 0x55f17252f680 2023-10-05T19:50:38.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f212333ce40 1 -- 172.21.15.167:0/642959497 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1724dc810 con 0x55f17252f680 2023-10-05T19:50:38.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f206affd700 1 -- 172.21.15.167:0/642959497 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2110033be0 con 0x55f17252f680 2023-10-05T19:50:38.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f206affd700 1 --2- 172.21.15.167:0/642959497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2060030c00 0x7f20600330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.368+0000 7f206affd700 1 -- 172.21.15.167:0/642959497 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2110046c20 con 0x55f17252f680 2023-10-05T19:50:38.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f2121672700 1 --2- 172.21.15.167:0/642959497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2060030c00 0x7f20600330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 5 note: GC not initialized 2023-10-05T19:50:38.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f2121672700 1 --2- 172.21.15.167:0/642959497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2060030c00 0x7f20600330b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55f172522260 tx=0x7f211800d630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f205ffff700 20 reqs_thread_entry: start 2023-10-05T19:50:38.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f205dffb700 20 reqs_thread_entry: start 2023-10-05T19:50:38.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:38.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:38.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f204b7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:38.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 20 get_system_obj_state: rctx=0x7ffe73cbdd28 obj=default.rgw.meta:users.uid:foo state=0x55f1723b70b0 s->prefetch_data=0 2023-10-05T19:50:38.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:38.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17259fad0 con 0x55f1724e1e20 2023-10-05T19:50:38.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f204bfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:08 2023 2023-10-05T19:50:38.382 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:38.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f211803d050 con 0x55f1724e1e20 2023-10-05T19:50:38.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:38.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:38.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.372+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725a2560 con 0x55f1724e1e20 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f211803d050 con 0x55f1724e1e20 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 get_system_obj_state: rctx=0x7ffe73cbdd70 obj=default.rgw.meta:root:myfoo state=0x55f1723b70b0 s->prefetch_data=0 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:50:38.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725a1d70 con 0x7f210802d020 2023-10-05T19:50:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f211803d050 con 0x7f210802d020 2023-10-05T19:50:38.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725a3f60 con 0x7f210802d020 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f211803d050 con 0x7f210802d020 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:38.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 get_system_obj_state: rctx=0x7ffe73cbdd70 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x55f17238d2b0 s->prefetch_data=0 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : miss 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725a28e0 con 0x55f1724e1e20 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f211803d050 con 0x55f1724e1e20 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x16 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.376+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725a3320 con 0x55f1724e1e20 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(107 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f211803d050 con 0x55f1724e1e20 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x13 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 20 get_system_obj_state: rctx=0x7ffe73cbdd08 obj=default.rgw.meta:users.uid:foo state=0x55f17238d2b0 s->prefetch_data=0 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x16, cached=0x13) 2023-10-05T19:50:38.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725a6200 con 0x55f1724e1e20 2023-10-05T19:50:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(108 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f211803d050 con 0x55f1724e1e20 2023-10-05T19:50:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x17) 2023-10-05T19:50:38.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725a6200 con 0x7f210802d020 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(109 foo.buckets [call] v30'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f211803d050 con 0x7f210802d020 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 20 get_system_obj_state: rctx=0x7ffe73cbde48 obj=default.rgw.meta:root:myfoo state=0x55f17238d2b0 s->prefetch_data=0 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x16, cached=0x13) 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725a65f0 con 0x7f210802d020 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(110 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f211803d050 con 0x7f210802d020 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x13, cached=0x17) 2023-10-05T19:50:38.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.380+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725aad20 con 0x7f210802d020 2023-10-05T19:50:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(111 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f211803d050 con 0x7f210802d020 2023-10-05T19:50:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f212333ce40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-10-05T19:50:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f212333ce40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f212333ce40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T19:50:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94495494023216 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1725a7950 con 0x55f172516130 2023-10-05T19:50:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== watch-notify(notify (1) cookie 94495493452880 notify 128849018881 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x55f1724dc810 con 0x55f172516130 2023-10-05T19:50:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f211ee6d700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94495493452880 notifier 4445 bl.length()=338 2023-10-05T19:50:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f211ee6d700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-10-05T19:50:38.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f211ee6d700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(112 notify.6 [notify cookie 94495494023216 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2110039020 con 0x55f172516130 2023-10-05T19:50:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f211ee6d700 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f20f8003d90 con 0x55f172516130 2023-10-05T19:50:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(113 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2110039020 con 0x55f172516130 2023-10-05T19:50:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== watch-notify(notify_complete (2) cookie 94495494023216 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f1724de4b0 con 0x55f172516130 2023-10-05T19:50:38.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.384+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94495493440128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f1724f3280 con 0x55f1725111b0 2023-10-05T19:50:38.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.388+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94495493440128] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.388+0000 7f212333ce40 20 remove_watcher() i=0 2023-10-05T19:50:38.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.388+0000 7f212333ce40 2 removed watcher, disabling cache 2023-10-05T19:50:38.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.388+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94495493443440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c280 con 0x55f1724e1e20 2023-10-05T19:50:38.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.388+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94495493443440] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f211803d050 con 0x55f1724e1e20 2023-10-05T19:50:38.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.388+0000 7f212333ce40 20 remove_watcher() i=1 2023-10-05T19:50:38.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.388+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94495493444544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c280 con 0x55f1725111b0 2023-10-05T19:50:38.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.392+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94495493444544] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.392+0000 7f212333ce40 20 remove_watcher() i=2 2023-10-05T19:50:38.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.392+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94495493447728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c280 con 0x7f210802d020 2023-10-05T19:50:38.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.392+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94495493447728] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f211803d050 con 0x7f210802d020 2023-10-05T19:50:38.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.392+0000 7f212333ce40 20 remove_watcher() i=3 2023-10-05T19:50:38.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.392+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94495493448832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c280 con 0x55f1725111b0 2023-10-05T19:50:38.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.396+0000 7f2120e71700 1 -- 172.21.15.167:0/478577621 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94495493448832] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2108059040 con 0x55f1725111b0 2023-10-05T19:50:38.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.396+0000 7f212333ce40 20 remove_watcher() i=4 2023-10-05T19:50:38.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.396+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94495493451776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c280 con 0x55f172516130 2023-10-05T19:50:38.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.396+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94495493451776] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2110039020 con 0x55f172516130 2023-10-05T19:50:38.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.396+0000 7f212333ce40 20 remove_watcher() i=5 2023-10-05T19:50:38.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.396+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94495493452880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c280 con 0x55f172516130 2023-10-05T19:50:38.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.400+0000 7f2120670700 1 -- 172.21.15.167:0/478577621 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94495493452880] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2110039020 con 0x55f172516130 2023-10-05T19:50:38.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.400+0000 7f212333ce40 20 remove_watcher() i=6 2023-10-05T19:50:38.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.400+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94495493461536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c280 con 0x7f210802d020 2023-10-05T19:50:38.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.400+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94495493461536] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f211803d050 con 0x7f210802d020 2023-10-05T19:50:38.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.400+0000 7f212333ce40 20 remove_watcher() i=7 2023-10-05T19:50:38.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.400+0000 7f20f17f2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.400+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94495493462768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f17251c280 con 0x55f1724e1e20 2023-10-05T19:50:38.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94495493462768] v30'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f211803d050 con 0x55f1724e1e20 2023-10-05T19:50:38.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f1725111b0 msgr2=0x55f172513590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f1725111b0 0x55f172513590 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f1724e1e20 msgr2=0x55f17250f230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f1724e1e20 0x55f17250f230 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f210802d020 msgr2=0x7f210803d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f210802d020 0x7f210803d8d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f172516130 msgr2=0x55f172518510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f172516130 0x55f172518510 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2104030c50 msgr2=0x7f2104033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2104030c50 0x7f2104033100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2110005a90 tx=0x7f2110015000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f2121672700 1 -- 172.21.15.167:0/478577621 reap_dead start 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 msgr2=0x55f172503770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f172503770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55f1724f9080 tx=0x7f2108016000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 shutdown_connections 2023-10-05T19:50:38.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/478577621 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f1724514a0 0x55f172503770 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 >> 172.21.15.167:0/478577621 conn(0x55f1724d8250 msgr2=0x55f1724f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 shutdown_connections 2023-10-05T19:50:38.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/478577621 wait complete. 2023-10-05T19:50:38.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/642959497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2060030c00 msgr2=0x7f20600330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/642959497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2060030c00 0x7f20600330b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55f172522260 tx=0x7f211800d630 comp rx=0 tx=0).stop 2023-10-05T19:50:38.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/642959497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 msgr2=0x55f1724ddeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/642959497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f1724ddeb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x55f172529700 tx=0x7f211002c000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/642959497 shutdown_connections 2023-10-05T19:50:38.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/642959497 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2060030c00 0x7f20600330b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 --2- 172.21.15.167:0/642959497 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f17252f680 0x55f1724ddeb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/642959497 >> 172.21.15.167:0/642959497 conn(0x55f17252aa40 msgr2=0x55f172528ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/642959497 shutdown_connections 2023-10-05T19:50:38.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.404+0000 7f212333ce40 1 -- 172.21.15.167:0/642959497 wait complete. 2023-10-05T19:50:38.419 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-10-05T19:50:38.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-10-05T19:50:38.420 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2023-10-05T19:50:38.468 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:38.468 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:38.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193cd75e40 1 Processor -- start 2023-10-05T19:50:38.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193cd75e40 1 -- start start 2023-10-05T19:50:38.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193cd75e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5599528fdf40 0x559952900320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193cd75e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559952846bd0 con 0x5599528f9960 2023-10-05T19:50:38.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193cd75e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x559952803ee0 con 0x5599528fdf40 2023-10-05T19:50:38.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193a0a9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5599528fdf40 0x559952900320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193a0a9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5599528fdf40 0x559952900320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45446/0 (socket says 172.21.15.167:45446) 2023-10-05T19:50:38.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193a0a9700 1 -- 172.21.15.167:0/1551336238 learned_addr learned my addr 172.21.15.167:0/1551336238 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193a8aa700 1 --1- 172.21.15.167:0/1551336238 >> v1:172.21.15.118:6789/0 conn(0x5599528f9960 0x5599528f9d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51676/0 (socket says 172.21.15.167:51676) 2023-10-05T19:50:38.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193a0a9700 1 -- 172.21.15.167:0/1551336238 >> v1:172.21.15.118:6789/0 conn(0x5599528f9960 legacy=0x5599528f9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193a0a9700 1 -- 172.21.15.167:0/1551336238 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599528fa570 con 0x5599528fdf40 2023-10-05T19:50:38.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.460+0000 7f193a0a9700 1 --2- 172.21.15.167:0/1551336238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 0x559952900320 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f192400a5c0 tx=0x7f1924005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfc6c83e280a12b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f19398a8700 1 -- 172.21.15.167:0/1551336238 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f192400e510 con 0x5599528fdf40 2023-10-05T19:50:38.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f19398a8700 1 -- 172.21.15.167:0/1551336238 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400e670 con 0x5599528fdf40 2023-10-05T19:50:38.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f19398a8700 1 -- 172.21.15.167:0/1551336238 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f192400e920 con 0x5599528fdf40 2023-10-05T19:50:38.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 -- 172.21.15.167:0/1551336238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 msgr2=0x559952900320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 --2- 172.21.15.167:0/1551336238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 0x559952900320 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f192400a5c0 tx=0x7f1924005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 -- 172.21.15.167:0/1551336238 shutdown_connections 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 --2- 172.21.15.167:0/1551336238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 0x559952900320 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 -- 172.21.15.167:0/1551336238 >> 172.21.15.167:0/1551336238 conn(0x5599528f5380 msgr2=0x5599528f7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 -- 172.21.15.167:0/1551336238 shutdown_connections 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 -- 172.21.15.167:0/1551336238 wait complete. 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 Processor -- start 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 -- start start 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528f9960 0x55995286f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193cd75e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599527c7e30 con 0x5599528f9960 2023-10-05T19:50:38.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193a8aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528f9960 0x55995286f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193a8aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528f9960 0x55995286f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45450/0 (socket says 172.21.15.167:45450) 2023-10-05T19:50:38.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193a8aa700 1 -- 172.21.15.167:0/3082949233 learned_addr learned my addr 172.21.15.167:0/3082949233 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193a8aa700 1 -- 172.21.15.167:0/3082949233 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192400a180 con 0x5599528f9960 2023-10-05T19:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f193a8aa700 1 --2- 172.21.15.167:0/3082949233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528f9960 0x55995286f270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1934001cf0 tx=0x7f19340018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5c5237cec2ce02 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f19388a6700 1 -- 172.21.15.167:0/3082949233 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1934014070 con 0x5599528f9960 2023-10-05T19:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f19388a6700 1 -- 172.21.15.167:0/3082949233 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400be10 con 0x5599528f9960 2023-10-05T19:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.464+0000 7f19388a6700 1 -- 172.21.15.167:0/3082949233 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f193400f590 con 0x5599528f9960 2023-10-05T19:50:38.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 -- 172.21.15.167:0/3082949233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528f9960 msgr2=0x55995286f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 --2- 172.21.15.167:0/3082949233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528f9960 0x55995286f270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1934001cf0 tx=0x7f19340018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 -- 172.21.15.167:0/3082949233 shutdown_connections 2023-10-05T19:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 --2- 172.21.15.167:0/3082949233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528f9960 0x55995286f270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 -- 172.21.15.167:0/3082949233 >> 172.21.15.167:0/3082949233 conn(0x5599528f5380 msgr2=0x5599529146f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 -- 172.21.15.167:0/3082949233 shutdown_connections 2023-10-05T19:50:38.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 -- 172.21.15.167:0/3082949233 wait complete. 2023-10-05T19:50:38.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 Processor -- start 2023-10-05T19:50:38.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 -- start start 2023-10-05T19:50:38.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 0x559952921c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193cd75e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55995279aed0 con 0x5599528fdf40 2023-10-05T19:50:38.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193a8aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 0x559952921c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193a8aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 0x559952921c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45466/0 (socket says 172.21.15.167:45466) 2023-10-05T19:50:38.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 learned_addr learned my addr 172.21.15.167:0/4200139453 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559952846bd0 con 0x5599528fdf40 2023-10-05T19:50:38.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.468+0000 7f193a8aa700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 0x559952921c60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f19340018e0 tx=0x7f1934016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f1932ffd700 1 -- 172.21.15.167:0/4200139453 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f193401c6f0 con 0x5599528fdf40 2023-10-05T19:50:38.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f1932ffd700 1 -- 172.21.15.167:0/4200139453 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193401c870 con 0x5599528fdf40 2023-10-05T19:50:38.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f1932ffd700 1 -- 172.21.15.167:0/4200139453 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f193401cb60 con 0x5599528fdf40 2023-10-05T19:50:38.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599529221a0 con 0x5599528fdf40 2023-10-05T19:50:38.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599529225e0 con 0x5599528fdf40 2023-10-05T19:50:38.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f1932ffd700 1 -- 172.21.15.167:0/4200139453 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f1934023020 con 0x5599528fdf40 2023-10-05T19:50:38.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f1932ffd700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1920030c00 0x7f19200330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f1932ffd700 1 -- 172.21.15.167:0/4200139453 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f1934008030 con 0x5599528fdf40 2023-10-05T19:50:38.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f193a0a9700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1920030c00 0x7f19200330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55995292b6c0 0x55995292dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995292e200 con 0x55995292b6c0 2023-10-05T19:50:38.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f193b0ab700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55995292b6c0 0x55995292dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f193a0a9700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1920030c00 0x7f19200330b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f80 tx=0x7f1924013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.472+0000 7f193b0ab700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55995292b6c0 0x55995292dad0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f192c00a500 con 0x55995292b6c0 2023-10-05T19:50:38.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 20 realm 2023-10-05T19:50:38.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995292ad30 con 0x55995292b6c0 2023-10-05T19:50:38.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f192c00a500 con 0x55995292b6c0 2023-10-05T19:50:38.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:38.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995292ece0 con 0x55995292b6c0 2023-10-05T19:50:38.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f192c00a500 con 0x55995292b6c0 2023-10-05T19:50:38.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55995292fb10 0x559952931ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952932430 con 0x55995292fb10 2023-10-05T19:50:38.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193a8aa700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55995292fb10 0x559952931ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193a8aa700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55995292fb10 0x559952931ef0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.476+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952932cd0 con 0x55995292b6c0 2023-10-05T19:50:38.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f192c00a500 con 0x55995292b6c0 2023-10-05T19:50:38.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193cd75e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193cd75e40 20 searching for the correct realm 2023-10-05T19:50:38.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559952934a90 0x559952936e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x559952934a90 2023-10-05T19:50:38.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193a0a9700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559952934a90 0x559952936e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193a0a9700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559952934a90 0x559952936e70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292fb10 2023-10-05T19:50:38.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193a8aa700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f193401a070 0x7f19340421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x7f193401a070 2023-10-05T19:50:38.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193b0ab700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f193401a070 0x7f19340421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193b0ab700 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f193401a070 0x7f19340421f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x7f193401a070 2023-10-05T19:50:38.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.480+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x559952934a90 2023-10-05T19:50:38.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292fb10 2023-10-05T19:50:38.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292fb10 2023-10-05T19:50:38.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x7f193401a070 2023-10-05T19:50:38.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x7f193401a070 2023-10-05T19:50:38.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.484+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x7f193401a070 2023-10-05T19:50:38.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x7f193401a070 2023-10-05T19:50:38.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292fb10 2023-10-05T19:50:38.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x559952934a90 2023-10-05T19:50:38.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292fb10 2023-10-05T19:50:38.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x559952934a90 2023-10-05T19:50:38.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.488+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x559952934a90 2023-10-05T19:50:38.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x7f193401a070 2023-10-05T19:50:38.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x7f193401a070 2023-10-05T19:50:38.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292b6c0 2023-10-05T19:50:38.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x7f193401a070 2023-10-05T19:50:38.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x7f193401a070 2023-10-05T19:50:38.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x559952934a90 2023-10-05T19:50:38.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.492+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x7f193401a070 2023-10-05T19:50:38.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x7f193401a070 2023-10-05T19:50:38.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529373b0 con 0x55995292fb10 2023-10-05T19:50:38.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f193403d040 con 0x55995292fb10 2023-10-05T19:50:38.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f193403d040 con 0x559952934a90 2023-10-05T19:50:38.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f193403d040 con 0x55995292fb10 2023-10-05T19:50:38.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f193403d040 con 0x55995292fb10 2023-10-05T19:50:38.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193cd75e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193cd75e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193cd75e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193cd75e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952933810 con 0x55995292b6c0 2023-10-05T19:50:38.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.496+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952933410 con 0x55995292fb10 2023-10-05T19:50:38.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1934016070 con 0x55995292fb10 2023-10-05T19:50:38.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937760 con 0x55995292fb10 2023-10-05T19:50:38.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937b10 con 0x559952934a90 2023-10-05T19:50:38.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952933d00 con 0x55995292fb10 2023-10-05T19:50:38.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.500+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529397c0 con 0x559952934a90 2023-10-05T19:50:38.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529397c0 con 0x55995292fb10 2023-10-05T19:50:38.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529397c0 con 0x7f193401a070 2023-10-05T19:50:38.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x7f193401a070 2023-10-05T19:50:38.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x559952934a90 2023-10-05T19:50:38.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.504+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292fb10 2023-10-05T19:50:38.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292fb10 2023-10-05T19:50:38.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x7f193401a070 2023-10-05T19:50:38.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x7f193401a070 2023-10-05T19:50:38.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.508+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x7f193401a070 2023-10-05T19:50:38.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x7f193401a070 2023-10-05T19:50:38.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292fb10 2023-10-05T19:50:38.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x559952934a90 2023-10-05T19:50:38.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292fb10 2023-10-05T19:50:38.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x559952934a90 2023-10-05T19:50:38.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.512+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c014040 con 0x55995292b6c0 2023-10-05T19:50:38.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x559952934a90 2023-10-05T19:50:38.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x7f193401a070 2023-10-05T19:50:38.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292b6c0 2023-10-05T19:50:38.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x7f193401a070 2023-10-05T19:50:38.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.516+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x559952934a90 2023-10-05T19:50:38.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x7f193401a070 2023-10-05T19:50:38.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292fb10 2023-10-05T19:50:38.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292fb10 2023-10-05T19:50:38.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x559952934a90 2023-10-05T19:50:38.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292fb10 2023-10-05T19:50:38.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.520+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952937ec0 con 0x55995292fb10 2023-10-05T19:50:38.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529387b0 con 0x55995292fb10 2023-10-05T19:50:38.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529387b0 con 0x55995292b6c0 2023-10-05T19:50:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952939050 con 0x55995292fb10 2023-10-05T19:50:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.524+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952939050 con 0x55995292fb10 2023-10-05T19:50:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952939150 con 0x7f193401a070 2023-10-05T19:50:38.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 zone default found 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 4 Realm: () 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 zonegroup default 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952939150 con 0x7f193401a070 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293aad0 con 0x559952934a90 2023-10-05T19:50:38.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293ae80 con 0x559952934a90 2023-10-05T19:50:38.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 started sync module instance, tier type = 2023-10-05T19:50:38.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:38.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.528+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293a190 con 0x55995292fb10 2023-10-05T19:50:38.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.532+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.532+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117003763136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293a700 con 0x55995292fb10 2023-10-05T19:50:38.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.532+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293b7b0 con 0x55995292b6c0 2023-10-05T19:50:38.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.532+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94117003763136] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.532+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.532+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94117003768800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293a700 con 0x55995292b6c0 2023-10-05T19:50:38.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.532+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293c0a0 con 0x55995292fb10 2023-10-05T19:50:38.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.536+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94117003768800] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.536+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.536+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94117003771088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293a700 con 0x55995292fb10 2023-10-05T19:50:38.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.536+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293c990 con 0x7f193401a070 2023-10-05T19:50:38.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.536+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94117003771088] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.536+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.536+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94117003764528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293c990 con 0x7f193401a070 2023-10-05T19:50:38.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.536+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293d230 con 0x55995292fb10 2023-10-05T19:50:38.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.540+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94117003764528] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.540+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.540+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117003773648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293d010 con 0x55995292fb10 2023-10-05T19:50:38.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.540+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293dc90 con 0x559952934a90 2023-10-05T19:50:38.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.540+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94117003773648] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.540+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.540+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94117003774752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293cf70 con 0x559952934a90 2023-10-05T19:50:38.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.540+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293ea60 con 0x559952934a90 2023-10-05T19:50:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94117003774752] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94117003780720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293f350 con 0x559952934a90 2023-10-05T19:50:38.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293fc30 con 0x7f193401a070 2023-10-05T19:50:38.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94117003785984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952940520 con 0x7f193401a070 2023-10-05T19:50:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 20 add_watcher() i=0 2023-10-05T19:50:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 20 add_watcher() i=1 2023-10-05T19:50:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 20 add_watcher() i=2 2023-10-05T19:50:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 20 add_watcher() i=3 2023-10-05T19:50:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 20 add_watcher() i=4 2023-10-05T19:50:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94117003780720] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1924017050 con 0x559952934a90 2023-10-05T19:50:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 20 add_watcher() i=5 2023-10-05T19:50:38.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.544+0000 7f193cd75e40 20 add_watcher() i=6 2023-10-05T19:50:38.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94117003785984] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193cd75e40 20 add_watcher() i=7 2023-10-05T19:50:38.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193cd75e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:38.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952940520 con 0x55995292b6c0 2023-10-05T19:50:38.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94117003788256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559952940430 con 0x55995292b6c0 2023-10-05T19:50:38.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94117003788256] v30'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f190b7ee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193cd75e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:38.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193cd75e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:38.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193cd75e40 1 Processor -- start 2023-10-05T19:50:38.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.548+0000 7f193cd75e40 1 -- start start 2023-10-05T19:50:38.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x55995294de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55995294e340 con 0x55995294da30 2023-10-05T19:50:38.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193a0a9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x55995294de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193a0a9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x55995294de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45478/0 (socket says 172.21.15.167:45478) 2023-10-05T19:50:38.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193a0a9700 1 -- 172.21.15.167:0/2918212023 learned_addr learned my addr 172.21.15.167:0/2918212023 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193a0a9700 1 -- 172.21.15.167:0/2918212023 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55995294e480 con 0x55995294da30 2023-10-05T19:50:38.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193a0a9700 1 --2- 172.21.15.167:0/2918212023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x55995294de00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1924003000 tx=0x7f1924010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6b52382e191aff server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f190afed700 1 -- 172.21.15.167:0/2918212023 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1924037070 con 0x55995294da30 2023-10-05T19:50:38.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f190afed700 1 -- 172.21.15.167:0/2918212023 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1924010b30 con 0x55995294da30 2023-10-05T19:50:38.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f190afed700 1 -- 172.21.15.167:0/2918212023 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f192402d040 con 0x55995294da30 2023-10-05T19:50:38.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 -- 172.21.15.167:0/2918212023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 msgr2=0x55995294de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 --2- 172.21.15.167:0/2918212023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x55995294de00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1924003000 tx=0x7f1924010000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 -- 172.21.15.167:0/2918212023 shutdown_connections 2023-10-05T19:50:38.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 --2- 172.21.15.167:0/2918212023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x55995294de00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 -- 172.21.15.167:0/2918212023 >> 172.21.15.167:0/2918212023 conn(0x559952948df0 msgr2=0x559952946f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 -- 172.21.15.167:0/2918212023 shutdown_connections 2023-10-05T19:50:38.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 -- 172.21.15.167:0/2918212023 wait complete. 2023-10-05T19:50:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 Processor -- start 2023-10-05T19:50:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.552+0000 7f193cd75e40 1 -- start start 2023-10-05T19:50:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f193cd75e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x5599529534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f193cd75e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599529544a0 con 0x55995294da30 2023-10-05T19:50:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f193a0a9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x5599529534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f193a0a9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x5599529534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45492/0 (socket says 172.21.15.167:45492) 2023-10-05T19:50:38.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f193a0a9700 1 -- 172.21.15.167:0/1204042914 learned_addr learned my addr 172.21.15.167:0/1204042914 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f193a0a9700 1 -- 172.21.15.167:0/1204042914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599528fa570 con 0x55995294da30 2023-10-05T19:50:38.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f193a0a9700 1 --2- 172.21.15.167:0/1204042914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x5599529534a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f192400ea70 tx=0x7f192402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f19097ea700 1 -- 172.21.15.167:0/1204042914 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1924037050 con 0x55995294da30 2023-10-05T19:50:38.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f19097ea700 1 -- 172.21.15.167:0/1204042914 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192403c440 con 0x55995294da30 2023-10-05T19:50:38.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f193cd75e40 1 -- 172.21.15.167:0/1204042914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559952953aa0 con 0x55995294da30 2023-10-05T19:50:38.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f19097ea700 1 -- 172.21.15.167:0/1204042914 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f192403c5d0 con 0x55995294da30 2023-10-05T19:50:38.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f193cd75e40 1 -- 172.21.15.167:0/1204042914 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559952953ee0 con 0x55995294da30 2023-10-05T19:50:38.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.556+0000 7f19097ea700 1 -- 172.21.15.167:0/1204042914 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f192403c730 con 0x55995294da30 2023-10-05T19:50:38.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f19097ea700 1 --2- 172.21.15.167:0/1204042914 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1880030c50 0x7f1880033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f19097ea700 1 -- 172.21.15.167:0/1204042914 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f1924046c40 con 0x55995294da30 2023-10-05T19:50:38.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f193b0ab700 1 --2- 172.21.15.167:0/1204042914 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1880030c50 0x7f1880033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f193cd75e40 5 note: GC not initialized 2023-10-05T19:50:38.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f193b0ab700 1 --2- 172.21.15.167:0/1204042914 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1880030c50 0x7f1880033100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55995293f0d0 tx=0x7f192c00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f187a7fc700 20 reqs_thread_entry: start 2023-10-05T19:50:38.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f193cd75e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:38.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f186bfff700 20 reqs_thread_entry: start 2023-10-05T19:50:38.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f193cd75e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:38.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f186a7fc700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:09 2023 2023-10-05T19:50:38.570 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f1869ffb700 20 reqs_thread_entry: start 2023-10-05T19:50:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f193cd75e40 20 get_system_obj_state: rctx=0x7fffc723e7d8 obj=default.rgw.meta:users.uid:fud state=0x5599527d30b0 s->prefetch_data=0 2023-10-05T19:50:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f193cd75e40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T19:50:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.560+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529bbcd0 con 0x7f193401a070 2023-10-05T19:50:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 fud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-10-05T19:50:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 20 get_system_obj_state: rctx=0x7fffc723e4c8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x5599527d30b0 s->prefetch_data=0 2023-10-05T19:50:38.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-10-05T19:50:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:103 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529bbcd0 con 0x559952934a90 2023-10-05T19:50:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(103 p5YnriCv1nAtykxBrupQ [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f1924042070 con 0x559952934a90 2023-10-05T19:50:38.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-10-05T19:50:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:50:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 20 get_system_obj_state: rctx=0x7fffc723dd68 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x5599527d30b0 s->prefetch_data=0 2023-10-05T19:50:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T19:50:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 20 get_system_obj_state: rctx=0x7fffc723e408 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x5599527d30b0 s->prefetch_data=0 2023-10-05T19:50:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T19:50:38.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529be300 con 0x7f193401a070 2023-10-05T19:50:38.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(104 fud [delete,create,call,writefull 0~346] v30'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-10-05T19:50:38.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:38.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-10-05T19:50:38.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 7.3 7:c609908c:::notify.5:head [notify cookie 94117004294912 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529befc0 con 0x559952934a90 2023-10-05T19:50:38.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== watch-notify(notify (1) cookie 94117003774752 notify 128849018882 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x559952953ee0 con 0x559952934a90 2023-10-05T19:50:38.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f19388a6700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94117003774752 notifier 4451 bl.length()=522 2023-10-05T19:50:38.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f19388a6700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-10-05T19:50:38.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f19388a6700 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:38.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.564+0000 7f19388a6700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1914003d90 con 0x559952934a90 2023-10-05T19:50:38.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(105 notify.5 [notify cookie 94117004294912 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1924042070 con 0x559952934a90 2023-10-05T19:50:38.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(106 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1924042070 con 0x559952934a90 2023-10-05T19:50:38.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== watch-notify(notify_complete (2) cookie 94117004294912 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559952953aa0 con 0x559952934a90 2023-10-05T19:50:38.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529befc0 con 0x559952934a90 2023-10-05T19:50:38.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f1924042070 con 0x559952934a90 2023-10-05T19:50:38.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193cd75e40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T19:50:38.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193cd75e40 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:50:38.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193cd75e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T19:50:38.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94117004306960 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5599529befc0 con 0x55995292fb10 2023-10-05T19:50:38.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94117003771088 notify 128849018906 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x5599529225e0 con 0x55995292fb10 2023-10-05T19:50:38.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f1933fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018906 cookie 94117003771088 notifier 4451 bl.length()=177 2023-10-05T19:50:38.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f1933fff700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T19:50:38.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f1933fff700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:50:38.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(108 notify.2 [notify cookie 94117004306960 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.568+0000 7f1933fff700 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1888003450 con 0x55995292fb10 2023-10-05T19:50:38.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.572+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.572+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94117004306960 notify 128849018906 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5599529221a0 con 0x55995292fb10 2023-10-05T19:50:38.579 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:38.579 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "fud", 2023-10-05T19:50:38.579 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Fud", 2023-10-05T19:50:38.579 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "", 2023-10-05T19:50:38.579 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:38.579 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 1, 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "fud", 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:38.580 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:38.581 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:38.582 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:38.582 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:38.582 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:38.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:38.582 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:38.582 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:38.582 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:38.582 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:38.582 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:38.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.572+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94117003763136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995290f390 con 0x55995292fb10 2023-10-05T19:50:38.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.572+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94117003763136] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.572+0000 7f193cd75e40 20 remove_watcher() i=0 2023-10-05T19:50:38.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.572+0000 7f193cd75e40 2 removed watcher, disabling cache 2023-10-05T19:50:38.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.572+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94117003768800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995290f390 con 0x55995292b6c0 2023-10-05T19:50:38.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.576+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94117003768800] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.576+0000 7f193cd75e40 20 remove_watcher() i=1 2023-10-05T19:50:38.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.576+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94117003771088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995290f390 con 0x55995292fb10 2023-10-05T19:50:38.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.576+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94117003771088] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.576+0000 7f193cd75e40 20 remove_watcher() i=2 2023-10-05T19:50:38.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.576+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94117003764528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995290f390 con 0x7f193401a070 2023-10-05T19:50:38.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.580+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94117003764528] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.580+0000 7f193cd75e40 20 remove_watcher() i=3 2023-10-05T19:50:38.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.580+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94117003773648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995290f390 con 0x55995292fb10 2023-10-05T19:50:38.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.580+0000 7f193a8aa700 1 -- 172.21.15.167:0/4200139453 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94117003773648] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f193404c040 con 0x55995292fb10 2023-10-05T19:50:38.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.580+0000 7f193cd75e40 20 remove_watcher() i=4 2023-10-05T19:50:38.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.580+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94117003774752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995290f390 con 0x559952934a90 2023-10-05T19:50:38.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.584+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94117003774752] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1924042070 con 0x559952934a90 2023-10-05T19:50:38.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.584+0000 7f193cd75e40 20 remove_watcher() i=5 2023-10-05T19:50:38.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.584+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94117003780720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293cbc0 con 0x559952934a90 2023-10-05T19:50:38.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.584+0000 7f193a0a9700 1 -- 172.21.15.167:0/4200139453 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94117003780720] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1924042070 con 0x559952934a90 2023-10-05T19:50:38.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.584+0000 7f193cd75e40 20 remove_watcher() i=6 2023-10-05T19:50:38.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.584+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94117003785984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293cbc0 con 0x7f193401a070 2023-10-05T19:50:38.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.588+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94117003785984] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f192c033040 con 0x7f193401a070 2023-10-05T19:50:38.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.588+0000 7f193cd75e40 20 remove_watcher() i=7 2023-10-05T19:50:38.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.588+0000 7f190b7ee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.588+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94117003788256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55995293cbc0 con 0x55995292b6c0 2023-10-05T19:50:38.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94117003788256] v30'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f192c033040 con 0x55995292b6c0 2023-10-05T19:50:38.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55995292fb10 msgr2=0x559952931ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55995292fb10 0x559952931ef0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55995292b6c0 msgr2=0x55995292dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55995292b6c0 0x55995292dad0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f193401a070 msgr2=0x7f19340421f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f193401a070 0x7f19340421f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559952934a90 msgr2=0x559952936e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559952934a90 0x559952936e70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1920030c00 msgr2=0x7f19200330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1920030c00 0x7f19200330b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f80 tx=0x7f1924013000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193b0ab700 1 -- 172.21.15.167:0/4200139453 reap_dead start 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 msgr2=0x559952921c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 0x559952921c60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f19340018e0 tx=0x7f1934016000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 shutdown_connections 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/4200139453 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5599528fdf40 0x559952921c60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 >> 172.21.15.167:0/4200139453 conn(0x5599528f5380 msgr2=0x559952913170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 shutdown_connections 2023-10-05T19:50:38.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/4200139453 wait complete. 2023-10-05T19:50:38.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/1204042914 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1880030c50 msgr2=0x7f1880033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/1204042914 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1880030c50 0x7f1880033100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55995293f0d0 tx=0x7f192c00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:38.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/1204042914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 msgr2=0x5599529534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/1204042914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x5599529534a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f192400ea70 tx=0x7f192402c000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/1204042914 shutdown_connections 2023-10-05T19:50:38.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/1204042914 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1880030c50 0x7f1880033100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 --2- 172.21.15.167:0/1204042914 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55995294da30 0x5599529534a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/1204042914 >> 172.21.15.167:0/1204042914 conn(0x559952948df0 msgr2=0x559952946e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/1204042914 shutdown_connections 2023-10-05T19:50:38.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.592+0000 7f193cd75e40 1 -- 172.21.15.167:0/1204042914 wait complete. 2023-10-05T19:50:38.606 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:38.616 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-10-05T19:50:38.624 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:38.625 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2023-10-05T19:50:38.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2023-10-05T19:50:38.625 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2023-10-05T19:50:38.661 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:38.662 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:38.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 Processor -- start 2023-10-05T19:50:38.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 -- start start 2023-10-05T19:50:38.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f3b529ff00 0x55f3b52a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f3b51e8bd0 con 0x55f3b529b920 2023-10-05T19:50:38.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f3b51a5ee0 con 0x55f3b529ff00 2023-10-05T19:50:38.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb701a7c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f3b529ff00 0x55f3b52a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb701a7c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f3b529ff00 0x55f3b52a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45494/0 (socket says 172.21.15.167:45494) 2023-10-05T19:50:38.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb70227d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55f3b529b920 0x55f3b529bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51678/0 (socket says 172.21.15.167:51678) 2023-10-05T19:50:38.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb701a7c700 1 -- 172.21.15.167:0/2791700035 learned_addr learned my addr 172.21.15.167:0/2791700035 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb701a7c700 1 -- 172.21.15.167:0/2791700035 >> v1:172.21.15.118:6789/0 conn(0x55f3b529b920 legacy=0x55f3b529bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb701a7c700 1 -- 172.21.15.167:0/2791700035 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3b529c530 con 0x55f3b529ff00 2023-10-05T19:50:38.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb701a7c700 1 --2- 172.21.15.167:0/2791700035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529ff00 0x55f3b52a22e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00a650 tx=0x7fb6ec005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d2ceb63ab8913f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb70127b700 1 -- 172.21.15.167:0/2791700035 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec008760 con 0x55f3b529ff00 2023-10-05T19:50:38.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb70127b700 1 -- 172.21.15.167:0/2791700035 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec0088c0 con 0x55f3b529ff00 2023-10-05T19:50:38.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb70127b700 1 -- 172.21.15.167:0/2791700035 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec008bb0 con 0x55f3b529ff00 2023-10-05T19:50:38.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 -- 172.21.15.167:0/2791700035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529ff00 msgr2=0x55f3b52a22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 --2- 172.21.15.167:0/2791700035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529ff00 0x55f3b52a22e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00a650 tx=0x7fb6ec005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:38.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 -- 172.21.15.167:0/2791700035 shutdown_connections 2023-10-05T19:50:38.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 --2- 172.21.15.167:0/2791700035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529ff00 0x55f3b52a22e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 -- 172.21.15.167:0/2791700035 >> 172.21.15.167:0/2791700035 conn(0x55f3b5297340 msgr2=0x55f3b5299750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 -- 172.21.15.167:0/2791700035 shutdown_connections 2023-10-05T19:50:38.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 -- 172.21.15.167:0/2791700035 wait complete. 2023-10-05T19:50:38.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 Processor -- start 2023-10-05T19:50:38.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.656+0000 7fb704748e40 1 -- start start 2023-10-05T19:50:38.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b52ba9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b5169e30 con 0x55f3b529b920 2023-10-05T19:50:38.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb70227d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b52ba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb70227d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b52ba9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45510/0 (socket says 172.21.15.167:45510) 2023-10-05T19:50:38.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb70227d700 1 -- 172.21.15.167:0/2472278892 learned_addr learned my addr 172.21.15.167:0/2472278892 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb70227d700 1 -- 172.21.15.167:0/2472278892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec005db0 con 0x55f3b529b920 2023-10-05T19:50:38.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb70227d700 1 --2- 172.21.15.167:0/2472278892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b52ba9e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc006fa0 tx=0x7fb6fc006b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee70b6989a099ef server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb6fbfff700 1 -- 172.21.15.167:0/2472278892 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6fc006110 con 0x55f3b529b920 2023-10-05T19:50:38.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb6fbfff700 1 -- 172.21.15.167:0/2472278892 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc006270 con 0x55f3b529b920 2023-10-05T19:50:38.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb6fbfff700 1 -- 172.21.15.167:0/2472278892 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6fc0135a0 con 0x55f3b529b920 2023-10-05T19:50:38.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 -- 172.21.15.167:0/2472278892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 msgr2=0x55f3b52ba9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 --2- 172.21.15.167:0/2472278892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b52ba9e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc006fa0 tx=0x7fb6fc006b50 comp rx=0 tx=0).stop 2023-10-05T19:50:38.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 -- 172.21.15.167:0/2472278892 shutdown_connections 2023-10-05T19:50:38.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 --2- 172.21.15.167:0/2472278892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b52ba9e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 -- 172.21.15.167:0/2472278892 >> 172.21.15.167:0/2472278892 conn(0x55f3b5297340 msgr2=0x55f3b52b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 -- 172.21.15.167:0/2472278892 shutdown_connections 2023-10-05T19:50:38.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 -- 172.21.15.167:0/2472278892 wait complete. 2023-10-05T19:50:38.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 Processor -- start 2023-10-05T19:50:38.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 -- start start 2023-10-05T19:50:38.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b5211440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb704748e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b513ced0 con 0x55f3b529b920 2023-10-05T19:50:38.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb70227d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b5211440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb70227d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b5211440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45526/0 (socket says 172.21.15.167:45526) 2023-10-05T19:50:38.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.660+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 learned_addr learned my addr 172.21.15.167:0/3175749908 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3b51e8bd0 con 0x55f3b529b920 2023-10-05T19:50:38.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb70227d700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b5211440 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000f80 tx=0x7fb6fc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb6fa7fc700 1 -- 172.21.15.167:0/3175749908 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6fc003450 con 0x55f3b529b920 2023-10-05T19:50:38.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb6fa7fc700 1 -- 172.21.15.167:0/3175749908 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc0035b0 con 0x55f3b529b920 2023-10-05T19:50:38.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3b5211980 con 0x55f3b529b920 2023-10-05T19:50:38.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb6fa7fc700 1 -- 172.21.15.167:0/3175749908 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6fc0038a0 con 0x55f3b529b920 2023-10-05T19:50:38.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3b520fd40 con 0x55f3b529b920 2023-10-05T19:50:38.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb6fa7fc700 1 -- 172.21.15.167:0/3175749908 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fb6fc01a070 con 0x55f3b529b920 2023-10-05T19:50:38.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb6fa7fc700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb6e4030c00 0x7fb6e40330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb6fa7fc700 1 -- 172.21.15.167:0/3175749908 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fb6fc044b50 con 0x55f3b529b920 2023-10-05T19:50:38.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb701a7c700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb6e4030c00 0x7fb6e40330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f3b529ff00 0x55f3b52cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52cfb40 con 0x55f3b529ff00 2023-10-05T19:50:38.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.664+0000 7fb702a7e700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f3b529ff00 0x55f3b52cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb701a7c700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb6e4030c00 0x7fb6e40330b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0030a0 tx=0x7fb6ec015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb702a7e700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f3b529ff00 0x55f3b52cf490 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f400a500 con 0x55f3b529ff00 2023-10-05T19:50:38.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 20 realm 2023-10-05T19:50:38.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52ccab0 con 0x55f3b529ff00 2023-10-05T19:50:38.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f400a500 con 0x55f3b529ff00 2023-10-05T19:50:38.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:38.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d0620 con 0x55f3b529ff00 2023-10-05T19:50:38.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f400a500 con 0x55f3b529ff00 2023-10-05T19:50:38.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f3b52d0220 0x55f3b52d3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d3b30 con 0x55f3b52d0220 2023-10-05T19:50:38.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb70227d700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f3b52d0220 0x55f3b52d3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.668+0000 7fb70227d700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f3b52d0220 0x55f3b52d3430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d4400 con 0x55f3b529ff00 2023-10-05T19:50:38.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb6f400a500 con 0x55f3b529ff00 2023-10-05T19:50:38.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb704748e40 20 searching for the correct realm 2023-10-05T19:50:38.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f3b52d3f70 0x55f3b52d81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d3f70 2023-10-05T19:50:38.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb701a7c700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f3b52d3f70 0x55f3b52d81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb701a7c700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f3b52d3f70 0x55f3b52d81d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d0220 2023-10-05T19:50:38.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb70227d700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb6fc028c70 0x7fb6fc003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x7fb6fc028c70 2023-10-05T19:50:38.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb702a7e700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb6fc028c70 0x7fb6fc003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.672+0000 7fb702a7e700 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb6fc028c70 0x7fb6fc003aa0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x7fb6fc028c70 2023-10-05T19:50:38.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d3f70 2023-10-05T19:50:38.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d0220 2023-10-05T19:50:38.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d0220 2023-10-05T19:50:38.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.676+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x7fb6fc028c70 2023-10-05T19:50:38.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x7fb6fc028c70 2023-10-05T19:50:38.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x7fb6fc028c70 2023-10-05T19:50:38.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x7fb6fc028c70 2023-10-05T19:50:38.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d0220 2023-10-05T19:50:38.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d3f70 2023-10-05T19:50:38.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.680+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d0220 2023-10-05T19:50:38.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d3f70 2023-10-05T19:50:38.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d3f70 2023-10-05T19:50:38.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.684+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x7fb6fc028c70 2023-10-05T19:50:38.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x7fb6fc028c70 2023-10-05T19:50:38.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b529ff00 2023-10-05T19:50:38.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x7fb6fc028c70 2023-10-05T19:50:38.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x7fb6fc028c70 2023-10-05T19:50:38.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d3f70 2023-10-05T19:50:38.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x7fb6fc028c70 2023-10-05T19:50:38.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x7fb6fc028c70 2023-10-05T19:50:38.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d0220 2023-10-05T19:50:38.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.688+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d0220 2023-10-05T19:50:38.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d3f70 2023-10-05T19:50:38.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d0220 2023-10-05T19:50:38.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d87b0 con 0x55f3b52d0220 2023-10-05T19:50:38.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d4f40 con 0x55f3b529ff00 2023-10-05T19:50:38.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d5890 con 0x55f3b52d0220 2023-10-05T19:50:38.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.692+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d4ad0 con 0x55f3b52d0220 2023-10-05T19:50:38.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d9110 con 0x55f3b52d3f70 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d9870 con 0x55f3b52d0220 2023-10-05T19:50:38.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dac30 con 0x55f3b52d3f70 2023-10-05T19:50:38.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dac30 con 0x55f3b52d0220 2023-10-05T19:50:38.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.696+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dac30 con 0x7fb6fc028c70 2023-10-05T19:50:38.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x7fb6fc028c70 2023-10-05T19:50:38.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d3f70 2023-10-05T19:50:38.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d0220 2023-10-05T19:50:38.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.700+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d0220 2023-10-05T19:50:38.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x7fb6fc028c70 2023-10-05T19:50:38.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x7fb6fc028c70 2023-10-05T19:50:38.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x7fb6fc028c70 2023-10-05T19:50:38.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x7fb6fc028c70 2023-10-05T19:50:38.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d0220 2023-10-05T19:50:38.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d3f70 2023-10-05T19:50:38.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.704+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d0220 2023-10-05T19:50:38.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d3f70 2023-10-05T19:50:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4014040 con 0x55f3b529ff00 2023-10-05T19:50:38.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4033040 con 0x55f3b529ff00 2023-10-05T19:50:38.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4033040 con 0x55f3b529ff00 2023-10-05T19:50:38.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d3f70 2023-10-05T19:50:38.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.708+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x7fb6fc028c70 2023-10-05T19:50:38.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b529ff00 2023-10-05T19:50:38.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4033040 con 0x55f3b529ff00 2023-10-05T19:50:38.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x7fb6fc028c70 2023-10-05T19:50:38.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d3f70 2023-10-05T19:50:38.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x7fb6fc028c70 2023-10-05T19:50:38.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d0220 2023-10-05T19:50:38.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.712+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d0220 2023-10-05T19:50:38.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d3f70 2023-10-05T19:50:38.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d0220 2023-10-05T19:50:38.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d94c0 con 0x55f3b52d0220 2023-10-05T19:50:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb704748e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb704748e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb704748e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb704748e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d9c20 con 0x55f3b52d0220 2023-10-05T19:50:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.716+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52d9fd0 con 0x55f3b529ff00 2023-10-05T19:50:38.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb6f4033040 con 0x55f3b529ff00 2023-10-05T19:50:38.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52da870 con 0x55f3b52d0220 2023-10-05T19:50:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52da870 con 0x55f3b52d0220 2023-10-05T19:50:38.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52da8a0 con 0x7fb6fc028c70 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 zone default found 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 4 Realm: () 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 zonegroup default 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52da8a0 con 0x7fb6fc028c70 2023-10-05T19:50:38.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.720+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dc220 con 0x55f3b52d3f70 2023-10-05T19:50:38.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dc5d0 con 0x55f3b52d3f70 2023-10-05T19:50:38.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb704748e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb704748e40 20 started sync module instance, tier type = 2023-10-05T19:50:38.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb704748e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:38.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52db930 con 0x55f3b52d0220 2023-10-05T19:50:38.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94505205085248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dbe50 con 0x55f3b52d0220 2023-10-05T19:50:38.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.724+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dd3b0 con 0x55f3b529ff00 2023-10-05T19:50:38.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.728+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94505205085248] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.728+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x55f3b529ff00 2023-10-05T19:50:38.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.728+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94505205090768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dbe50 con 0x55f3b529ff00 2023-10-05T19:50:38.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.728+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dd9b0 con 0x55f3b52d0220 2023-10-05T19:50:38.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.728+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94505205090768] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x55f3b529ff00 2023-10-05T19:50:38.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.728+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.732+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94505205091872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dbe50 con 0x55f3b52d0220 2023-10-05T19:50:38.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.732+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52de2a0 con 0x7fb6fc028c70 2023-10-05T19:50:38.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.732+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.732+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94505205091872] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.732+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94505205095856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52de200 con 0x7fb6fc028c70 2023-10-05T19:50:38.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.732+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52deaa0 con 0x55f3b52d0220 2023-10-05T19:50:38.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.736+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94505205095856] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.736+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.736+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94505205096960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52deea0 con 0x55f3b52d0220 2023-10-05T19:50:38.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.736+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52df740 con 0x55f3b52d3f70 2023-10-05T19:50:38.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.736+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.736+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94505205100192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52df370 con 0x55f3b52d3f70 2023-10-05T19:50:38.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.736+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52e07f0 con 0x55f3b52d3f70 2023-10-05T19:50:38.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.736+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94505205096960] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.736+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94505205100192] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94505205098064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52e0bf0 con 0x55f3b52d3f70 2023-10-05T19:50:38.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52e1490 con 0x7fb6fc028c70 2023-10-05T19:50:38.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94505205098064] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec012450 con 0x55f3b52d3f70 2023-10-05T19:50:38.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94505205108640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52e18e0 con 0x7fb6fc028c70 2023-10-05T19:50:38.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 20 add_watcher() i=0 2023-10-05T19:50:38.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 20 add_watcher() i=1 2023-10-05T19:50:38.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 20 add_watcher() i=2 2023-10-05T19:50:38.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 20 add_watcher() i=3 2023-10-05T19:50:38.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 20 add_watcher() i=4 2023-10-05T19:50:38.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 20 add_watcher() i=5 2023-10-05T19:50:38.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 20 add_watcher() i=6 2023-10-05T19:50:38.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94505205108640] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 20 add_watcher() i=7 2023-10-05T19:50:38.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:38.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.740+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52e4940 con 0x55f3b529ff00 2023-10-05T19:50:38.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb6f4033040 con 0x55f3b529ff00 2023-10-05T19:50:38.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94505205109744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52e1d30 con 0x55f3b529ff00 2023-10-05T19:50:38.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94505205109744] v30'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x55f3b529ff00 2023-10-05T19:50:38.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb6d3fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb704748e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:38.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb704748e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:38.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb704748e40 1 Processor -- start 2023-10-05T19:50:38.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb704748e40 1 -- start start 2023-10-05T19:50:38.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb704748e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52ef230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb704748e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b52ef770 con 0x55f3b52eee60 2023-10-05T19:50:38.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb701a7c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb701a7c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52ef230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45540/0 (socket says 172.21.15.167:45540) 2023-10-05T19:50:38.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.744+0000 7fb701a7c700 1 -- 172.21.15.167:0/4105033536 learned_addr learned my addr 172.21.15.167:0/4105033536 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb701a7c700 1 -- 172.21.15.167:0/4105033536 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3b52ef8b0 con 0x55f3b52eee60 2023-10-05T19:50:38.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb701a7c700 1 --2- 172.21.15.167:0/4105033536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52ef230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec002000 tx=0x7fb6ec012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce912d62006a898 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb6d37de700 1 -- 172.21.15.167:0/4105033536 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec02d040 con 0x55f3b52eee60 2023-10-05T19:50:38.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb6d37de700 1 -- 172.21.15.167:0/4105033536 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec028890 con 0x55f3b52eee60 2023-10-05T19:50:38.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb6d37de700 1 -- 172.21.15.167:0/4105033536 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec028a60 con 0x55f3b52eee60 2023-10-05T19:50:38.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 -- 172.21.15.167:0/4105033536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 msgr2=0x55f3b52ef230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 --2- 172.21.15.167:0/4105033536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52ef230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec002000 tx=0x7fb6ec012000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 -- 172.21.15.167:0/4105033536 shutdown_connections 2023-10-05T19:50:38.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 --2- 172.21.15.167:0/4105033536 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52ef230 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 -- 172.21.15.167:0/4105033536 >> 172.21.15.167:0/4105033536 conn(0x55f3b52ea220 msgr2=0x55f3b52e83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 -- 172.21.15.167:0/4105033536 shutdown_connections 2023-10-05T19:50:38.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 -- 172.21.15.167:0/4105033536 wait complete. 2023-10-05T19:50:38.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 Processor -- start 2023-10-05T19:50:38.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 -- start start 2023-10-05T19:50:38.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb704748e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3b52f5820 con 0x55f3b52eee60 2023-10-05T19:50:38.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb701a7c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb701a7c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52f4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45548/0 (socket says 172.21.15.167:45548) 2023-10-05T19:50:38.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb701a7c700 1 -- 172.21.15.167:0/141350944 learned_addr learned my addr 172.21.15.167:0/141350944 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.748+0000 7fb701a7c700 1 -- 172.21.15.167:0/141350944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3b529c530 con 0x55f3b52eee60 2023-10-05T19:50:38.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb701a7c700 1 --2- 172.21.15.167:0/141350944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52f4820 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55f3b52e8f40 tx=0x7fb6ec02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb6d1fdb700 1 -- 172.21.15.167:0/141350944 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec009640 con 0x55f3b52eee60 2023-10-05T19:50:38.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb6d1fdb700 1 -- 172.21.15.167:0/141350944 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec0097a0 con 0x55f3b52eee60 2023-10-05T19:50:38.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb704748e40 1 -- 172.21.15.167:0/141350944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3b52f4e20 con 0x55f3b52eee60 2023-10-05T19:50:38.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb6d1fdb700 1 -- 172.21.15.167:0/141350944 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec009910 con 0x55f3b52eee60 2023-10-05T19:50:38.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb704748e40 1 -- 172.21.15.167:0/141350944 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3b52f52c0 con 0x55f3b52eee60 2023-10-05T19:50:38.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb6d1fdb700 1 -- 172.21.15.167:0/141350944 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fb6ec009a70 con 0x55f3b52eee60 2023-10-05T19:50:38.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb6d1fdb700 1 --2- 172.21.15.167:0/141350944 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb648030c50 0x7fb648033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb6d1fdb700 1 -- 172.21.15.167:0/141350944 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fb6ec046c20 con 0x55f3b52eee60 2023-10-05T19:50:38.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb702a7e700 1 --2- 172.21.15.167:0/141350944 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb648030c50 0x7fb648033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb704748e40 5 note: GC not initialized 2023-10-05T19:50:38.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.752+0000 7fb702a7e700 1 --2- 172.21.15.167:0/141350944 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb648030c50 0x7fb648033100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55f3b52e4a10 tx=0x7fb6f400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb642ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:38.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb640ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:38.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:38.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:38.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb632ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:09 2023 2023-10-05T19:50:38.763 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:38.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb6327fc700 20 reqs_thread_entry: start 2023-10-05T19:50:38.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 20 get_system_obj_state: rctx=0x7ffdcf4daaa8 obj=default.rgw.meta:root:myfoo state=0x55f3b51750b0 s->prefetch_data=0 2023-10-05T19:50:38.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b535cd30 con 0x7fb6fc028c70 2023-10-05T19:50:38.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b535cd00 con 0x7fb6fc028c70 2023-10-05T19:50:38.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+288 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:38.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.756+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94505205085248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52b1290 con 0x55f3b52d0220 2023-10-05T19:50:38.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.760+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94505205085248] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.760+0000 7fb704748e40 20 remove_watcher() i=0 2023-10-05T19:50:38.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.760+0000 7fb704748e40 2 removed watcher, disabling cache 2023-10-05T19:50:38.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.760+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94505205090768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52db440 con 0x55f3b529ff00 2023-10-05T19:50:38.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.760+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94505205090768] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x55f3b529ff00 2023-10-05T19:50:38.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.760+0000 7fb704748e40 20 remove_watcher() i=1 2023-10-05T19:50:38.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.760+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94505205091872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52db440 con 0x55f3b52d0220 2023-10-05T19:50:38.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.764+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94505205091872] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.764+0000 7fb704748e40 20 remove_watcher() i=2 2023-10-05T19:50:38.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.764+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94505205095856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dcec0 con 0x7fb6fc028c70 2023-10-05T19:50:38.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.764+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94505205095856] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.764+0000 7fb704748e40 20 remove_watcher() i=3 2023-10-05T19:50:38.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.764+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94505205096960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dcec0 con 0x55f3b52d0220 2023-10-05T19:50:38.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.768+0000 7fb70227d700 1 -- 172.21.15.167:0/3175749908 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94505205096960] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6fc025020 con 0x55f3b52d0220 2023-10-05T19:50:38.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.768+0000 7fb704748e40 20 remove_watcher() i=4 2023-10-05T19:50:38.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.768+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94505205100192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dcec0 con 0x55f3b52d3f70 2023-10-05T19:50:38.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.768+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94505205100192] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec039020 con 0x55f3b52d3f70 2023-10-05T19:50:38.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.768+0000 7fb704748e40 20 remove_watcher() i=5 2023-10-05T19:50:38.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.768+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94505205098064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dcec0 con 0x55f3b52d3f70 2023-10-05T19:50:38.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.772+0000 7fb701a7c700 1 -- 172.21.15.167:0/3175749908 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94505205098064] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6ec039020 con 0x55f3b52d3f70 2023-10-05T19:50:38.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.772+0000 7fb704748e40 20 remove_watcher() i=6 2023-10-05T19:50:38.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.772+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94505205108640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b52dcec0 con 0x7fb6fc028c70 2023-10-05T19:50:38.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.772+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94505205108640] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb6f4033040 con 0x7fb6fc028c70 2023-10-05T19:50:38.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.772+0000 7fb704748e40 20 remove_watcher() i=7 2023-10-05T19:50:38.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.772+0000 7fb6d3fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.772+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94505205109744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3b531c3f0 con 0x55f3b529ff00 2023-10-05T19:50:38.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94505205109744] v30'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb6f404c040 con 0x55f3b529ff00 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f3b52d0220 msgr2=0x55f3b52d3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f3b52d0220 0x55f3b52d3430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f3b529ff00 msgr2=0x55f3b52cf490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f3b529ff00 0x55f3b52cf490 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb6fc028c70 msgr2=0x7fb6fc003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb6fc028c70 0x7fb6fc003aa0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f3b52d3f70 msgr2=0x55f3b52d81d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f3b52d3f70 0x55f3b52d81d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb6e4030c00 msgr2=0x7fb6e40330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb6e4030c00 0x7fb6e40330b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0030a0 tx=0x7fb6ec015000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 msgr2=0x55f3b5211440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b5211440 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000f80 tx=0x7fb6fc014000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb702a7e700 1 -- 172.21.15.167:0/3175749908 reap_dead start 2023-10-05T19:50:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 shutdown_connections 2023-10-05T19:50:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/3175749908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b529b920 0x55f3b5211440 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 >> 172.21.15.167:0/3175749908 conn(0x55f3b5297340 msgr2=0x55f3b52b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 shutdown_connections 2023-10-05T19:50:38.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/3175749908 wait complete. 2023-10-05T19:50:38.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/141350944 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb648030c50 msgr2=0x7fb648033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/141350944 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb648030c50 0x7fb648033100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55f3b52e4a10 tx=0x7fb6f400e040 comp rx=0 tx=0).stop 2023-10-05T19:50:38.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/141350944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 msgr2=0x55f3b52f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/141350944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52f4820 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x55f3b52e8f40 tx=0x7fb6ec02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/141350944 shutdown_connections 2023-10-05T19:50:38.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/141350944 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb648030c50 0x7fb648033100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 --2- 172.21.15.167:0/141350944 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f3b52eee60 0x55f3b52f4820 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/141350944 >> 172.21.15.167:0/141350944 conn(0x55f3b52ea220 msgr2=0x55f3b52e8320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/141350944 shutdown_connections 2023-10-05T19:50:38.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.776+0000 7fb704748e40 1 -- 172.21.15.167:0/141350944 wait complete. 2023-10-05T19:50:38.788 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:38.788 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "bucket:myfoo", 2023-10-05T19:50:38.788 INFO:teuthology.orchestra.run.smithi167.stdout: "ver": { 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "tag": "_xlWvfD54p_ccbJ9BGxOUZAx", 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "ver": 2 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "mtime": "2023-10-05T19:50:38.387327Z", 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "data": { 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": { 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "myfoo", 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "marker": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "tenant": "", 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "explicit_placement": { 2023-10-05T19:50:38.789 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "", 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "", 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "" 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout: "creation_time": "2023-10-05T19:50:36.660701Z", 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout: "linked": "false", 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout: "has_bucket_info": "false" 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:38.790 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:38.791 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_xlWvfD54p_ccbJ9BGxOUZAx', 'ver': 2}, 'mtime': '2023-10-05T19:50:38.387327Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'bucket_id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2023-10-05T19:50:36.660701Z', 'linked': 'false', 'has_bucket_info': 'false'}} 2023-10-05T19:50:38.792 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1'] 2023-10-05T19:50:38.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1'] 2023-10-05T19:50:38.792 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:38.834 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:38.834 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:38.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 Processor -- start 2023-10-05T19:50:38.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 -- start start 2023-10-05T19:50:38.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560f419e0ea0 0x560f419e3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560f41929bd0 con 0x560f419dc8c0 2023-10-05T19:50:38.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x560f418e6ee0 con 0x560f419e0ea0 2023-10-05T19:50:38.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2483acd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560f419e0ea0 0x560f419e3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2483acd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560f419e0ea0 0x560f419e3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45550/0 (socket says 172.21.15.167:45550) 2023-10-05T19:50:38.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f24842ce700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x560f419dc8c0 0x560f419dcc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51684/0 (socket says 172.21.15.167:51684) 2023-10-05T19:50:38.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2483acd700 1 -- 172.21.15.167:0/756304681 learned_addr learned my addr 172.21.15.167:0/756304681 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2483acd700 1 -- 172.21.15.167:0/756304681 >> v1:172.21.15.118:6789/0 conn(0x560f419dc8c0 legacy=0x560f419dcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2483acd700 1 -- 172.21.15.167:0/756304681 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f419dd4d0 con 0x560f419e0ea0 2023-10-05T19:50:38.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2483acd700 1 --2- 172.21.15.167:0/756304681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419e0ea0 0x560f419e3280 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f246c00a5c0 tx=0x7f246c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ae9d6807098a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f24832cc700 1 -- 172.21.15.167:0/756304681 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f246c00e510 con 0x560f419e0ea0 2023-10-05T19:50:38.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f24832cc700 1 -- 172.21.15.167:0/756304681 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c00e670 con 0x560f419e0ea0 2023-10-05T19:50:38.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f24832cc700 1 -- 172.21.15.167:0/756304681 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f246c00e920 con 0x560f419e0ea0 2023-10-05T19:50:38.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 -- 172.21.15.167:0/756304681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419e0ea0 msgr2=0x560f419e3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 --2- 172.21.15.167:0/756304681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419e0ea0 0x560f419e3280 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f246c00a5c0 tx=0x7f246c005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:38.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 -- 172.21.15.167:0/756304681 shutdown_connections 2023-10-05T19:50:38.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 --2- 172.21.15.167:0/756304681 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419e0ea0 0x560f419e3280 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 -- 172.21.15.167:0/756304681 >> 172.21.15.167:0/756304681 conn(0x560f419d82e0 msgr2=0x560f419da6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 -- 172.21.15.167:0/756304681 shutdown_connections 2023-10-05T19:50:38.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.828+0000 7f2486799e40 1 -- 172.21.15.167:0/756304681 wait complete. 2023-10-05T19:50:38.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 Processor -- start 2023-10-05T19:50:38.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 -- start start 2023-10-05T19:50:38.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f419fbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f418aae30 con 0x560f419dc8c0 2023-10-05T19:50:38.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f24842ce700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f419fbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f24842ce700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f419fbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45552/0 (socket says 172.21.15.167:45552) 2023-10-05T19:50:38.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f24842ce700 1 -- 172.21.15.167:0/782046817 learned_addr learned my addr 172.21.15.167:0/782046817 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f24842ce700 1 -- 172.21.15.167:0/782046817 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c00a180 con 0x560f419dc8c0 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f24842ce700 1 --2- 172.21.15.167:0/782046817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f419fbb10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f247c001cf0 tx=0x7f247c0018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b765e2de26910b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f24822ca700 1 -- 172.21.15.167:0/782046817 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f247c014070 con 0x560f419dc8c0 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f24822ca700 1 -- 172.21.15.167:0/782046817 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c00be10 con 0x560f419dc8c0 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f24822ca700 1 -- 172.21.15.167:0/782046817 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f247c00f590 con 0x560f419dc8c0 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 -- 172.21.15.167:0/782046817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 msgr2=0x560f419fbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 --2- 172.21.15.167:0/782046817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f419fbb10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f247c001cf0 tx=0x7f247c0018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 -- 172.21.15.167:0/782046817 shutdown_connections 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 --2- 172.21.15.167:0/782046817 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f419fbb10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 -- 172.21.15.167:0/782046817 >> 172.21.15.167:0/782046817 conn(0x560f419d82e0 msgr2=0x560f419f7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 -- 172.21.15.167:0/782046817 shutdown_connections 2023-10-05T19:50:38.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 -- 172.21.15.167:0/782046817 wait complete. 2023-10-05T19:50:38.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 Processor -- start 2023-10-05T19:50:38.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.832+0000 7f2486799e40 1 -- start start 2023-10-05T19:50:38.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2486799e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f41a04b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2486799e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f4187ded0 con 0x560f419dc8c0 2023-10-05T19:50:38.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f24842ce700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f41a04b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f24842ce700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f41a04b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45554/0 (socket says 172.21.15.167:45554) 2023-10-05T19:50:38.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 learned_addr learned my addr 172.21.15.167:0/1282591613 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f41929bd0 con 0x560f419dc8c0 2023-10-05T19:50:38.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f24842ce700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f41a04b20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f247c0018e0 tx=0x7f247c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2480ac7700 1 -- 172.21.15.167:0/1282591613 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f247c01c670 con 0x560f419dc8c0 2023-10-05T19:50:38.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f41a05060 con 0x560f419dc8c0 2023-10-05T19:50:38.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2480ac7700 1 -- 172.21.15.167:0/1282591613 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c01c7f0 con 0x560f419dc8c0 2023-10-05T19:50:38.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2480ac7700 1 -- 172.21.15.167:0/1282591613 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f247c01cae0 con 0x560f419dc8c0 2023-10-05T19:50:38.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f41a054a0 con 0x560f419dc8c0 2023-10-05T19:50:38.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2480ac7700 1 -- 172.21.15.167:0/1282591613 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f247c023020 con 0x560f419dc8c0 2023-10-05T19:50:38.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2480ac7700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2464030c00 0x7f24640330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2480ac7700 1 -- 172.21.15.167:0/1282591613 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f247c008030 con 0x560f419dc8c0 2023-10-05T19:50:38.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.836+0000 7f2483acd700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2464030c00 0x7f24640330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2483acd700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2464030c00 0x7f24640330b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f246c000f80 tx=0x7f246c013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560f419e0ea0 0x560f41a10540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a10c70 con 0x560f419e0ea0 2023-10-05T19:50:38.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2484acf700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560f419e0ea0 0x560f41a10540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2484acf700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560f419e0ea0 0x560f41a10540 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f247400a500 con 0x560f419e0ea0 2023-10-05T19:50:38.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 20 realm 2023-10-05T19:50:38.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a0db20 con 0x560f419e0ea0 2023-10-05T19:50:38.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f247400a500 con 0x560f419e0ea0 2023-10-05T19:50:38.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:38.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a11750 con 0x560f419e0ea0 2023-10-05T19:50:38.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f247400a500 con 0x560f419e0ea0 2023-10-05T19:50:38.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560f41a12580 0x560f41a14960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a14ea0 con 0x560f41a12580 2023-10-05T19:50:38.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.840+0000 7f24842ce700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560f41a12580 0x560f41a14960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f24842ce700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560f41a12580 0x560f41a14960 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a15740 con 0x560f419e0ea0 2023-10-05T19:50:38.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f247400a500 con 0x560f419e0ea0 2023-10-05T19:50:38.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2486799e40 20 searching for the correct realm 2023-10-05T19:50:38.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2486799e40 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560f41a17500 0x560f41a198e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a17500 2023-10-05T19:50:38.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2483acd700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560f41a17500 0x560f41a198e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2483acd700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560f41a17500 0x560f41a198e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.844+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a12580 2023-10-05T19:50:38.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f24842ce700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f247c01a070 0x7f247c0253d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x7f247c01a070 2023-10-05T19:50:38.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f247c01a070 0x7f247c0253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f247c01a070 0x7f247c0253d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x7f247c01a070 2023-10-05T19:50:38.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a17500 2023-10-05T19:50:38.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a12580 2023-10-05T19:50:38.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.848+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a12580 2023-10-05T19:50:38.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x7f247c01a070 2023-10-05T19:50:38.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x7f247c01a070 2023-10-05T19:50:38.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x7f247c01a070 2023-10-05T19:50:38.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x7f247c01a070 2023-10-05T19:50:38.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a12580 2023-10-05T19:50:38.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.852+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a17500 2023-10-05T19:50:38.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a12580 2023-10-05T19:50:38.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a17500 2023-10-05T19:50:38.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.856+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a17500 2023-10-05T19:50:38.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x7f247c01a070 2023-10-05T19:50:38.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x7f247c01a070 2023-10-05T19:50:38.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f419e0ea0 2023-10-05T19:50:38.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x7f247c01a070 2023-10-05T19:50:38.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x7f247c01a070 2023-10-05T19:50:38.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a17500 2023-10-05T19:50:38.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x7f247c01a070 2023-10-05T19:50:38.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x7f247c01a070 2023-10-05T19:50:38.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a12580 2023-10-05T19:50:38.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.860+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a12580 2023-10-05T19:50:38.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a17500 2023-10-05T19:50:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a12580 2023-10-05T19:50:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a19e20 con 0x560f41a12580 2023-10-05T19:50:38.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2486799e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2486799e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2486799e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2486799e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a162b0 con 0x560f419e0ea0 2023-10-05T19:50:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.864+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a16c00 con 0x560f41a12580 2023-10-05T19:50:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a1d0 con 0x560f41a12580 2023-10-05T19:50:38.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a580 con 0x560f41a17500 2023-10-05T19:50:38.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a16770 con 0x560f41a12580 2023-10-05T19:50:38.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.868+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1c1e0 con 0x560f41a17500 2023-10-05T19:50:38.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1c1e0 con 0x560f41a12580 2023-10-05T19:50:38.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1c1e0 con 0x7f247c01a070 2023-10-05T19:50:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x7f247c01a070 2023-10-05T19:50:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a17500 2023-10-05T19:50:38.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.872+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a12580 2023-10-05T19:50:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a12580 2023-10-05T19:50:38.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x7f247c01a070 2023-10-05T19:50:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x7f247c01a070 2023-10-05T19:50:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.876+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x7f247c01a070 2023-10-05T19:50:38.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x7f247c01a070 2023-10-05T19:50:38.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a12580 2023-10-05T19:50:38.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a17500 2023-10-05T19:50:38.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a12580 2023-10-05T19:50:38.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.880+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a17500 2023-10-05T19:50:38.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474014040 con 0x560f419e0ea0 2023-10-05T19:50:38.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a17500 2023-10-05T19:50:38.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x7f247c01a070 2023-10-05T19:50:38.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.884+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f419e0ea0 2023-10-05T19:50:38.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x7f247c01a070 2023-10-05T19:50:38.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a17500 2023-10-05T19:50:38.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x7f247c01a070 2023-10-05T19:50:38.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a12580 2023-10-05T19:50:38.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a12580 2023-10-05T19:50:38.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.888+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a17500 2023-10-05T19:50:38.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a12580 2023-10-05T19:50:38.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1a930 con 0x560f41a12580 2023-10-05T19:50:38.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2486799e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:38.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2486799e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:38.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2486799e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:38.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2486799e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:38.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1b1d0 con 0x560f41a12580 2023-10-05T19:50:38.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.892+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1b5d0 con 0x560f419e0ea0 2023-10-05T19:50:38.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:38.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1ae00 con 0x560f41a12580 2023-10-05T19:50:38.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:38.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1bec0 con 0x560f41a12580 2023-10-05T19:50:38.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:38.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1bec0 con 0x7f247c01a070 2023-10-05T19:50:38.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 zone default found 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 4 Realm: () 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 zonegroup default 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1bec0 con 0x7f247c01a070 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.896+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1bec0 con 0x560f41a17500 2023-10-05T19:50:38.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1df60 con 0x560f41a17500 2023-10-05T19:50:38.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f2486799e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:38.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f2486799e40 20 started sync module instance, tier type = 2023-10-05T19:50:38.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f2486799e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:38.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1d620 con 0x560f41a12580 2023-10-05T19:50:38.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.900+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.904+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94623525616080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1d620 con 0x560f41a12580 2023-10-05T19:50:38.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.904+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1e800 con 0x560f419e0ea0 2023-10-05T19:50:38.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.904+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.904+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94623525626640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1ec50 con 0x560f419e0ea0 2023-10-05T19:50:38.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.904+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94623525616080] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.904+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1f4f0 con 0x560f41a12580 2023-10-05T19:50:38.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.908+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94623525626640] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.908+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.908+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94623525624416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1ec50 con 0x560f41a12580 2023-10-05T19:50:38.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.908+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1f6a0 con 0x7f247c01a070 2023-10-05T19:50:38.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.908+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.908+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94623525624416] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.908+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94623525630320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1f5c0 con 0x7f247c01a070 2023-10-05T19:50:38.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.908+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1ff90 con 0x560f41a12580 2023-10-05T19:50:38.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.912+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94623525630320] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.912+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.912+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94623525627744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1ff90 con 0x560f41a12580 2023-10-05T19:50:38.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.912+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a209a0 con 0x560f41a17500 2023-10-05T19:50:38.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.912+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.912+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94623525635248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a21240 con 0x560f41a17500 2023-10-05T19:50:38.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.912+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a21c50 con 0x560f41a17500 2023-10-05T19:50:38.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.912+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94623525627744] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94623525635248] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94623525640032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a22000 con 0x560f41a17500 2023-10-05T19:50:38.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a228a0 con 0x7f247c01a070 2023-10-05T19:50:38.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94623525640032] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f246c017050 con 0x560f41a17500 2023-10-05T19:50:38.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94623525643184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a22cf0 con 0x7f247c01a070 2023-10-05T19:50:38.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 20 add_watcher() i=0 2023-10-05T19:50:38.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 20 add_watcher() i=1 2023-10-05T19:50:38.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 20 add_watcher() i=2 2023-10-05T19:50:38.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 20 add_watcher() i=3 2023-10-05T19:50:38.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 20 add_watcher() i=4 2023-10-05T19:50:38.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 20 add_watcher() i=5 2023-10-05T19:50:38.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 20 add_watcher() i=6 2023-10-05T19:50:38.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94623525643184] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 20 add_watcher() i=7 2023-10-05T19:50:38.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:38.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.916+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a25d90 con 0x560f419e0ea0 2023-10-05T19:50:38.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94623525644288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a23140 con 0x560f419e0ea0 2023-10-05T19:50:38.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94623525644288] v30'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2455fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2486799e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:38.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2486799e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:38.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2486799e40 1 Processor -- start 2023-10-05T19:50:38.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2486799e40 1 -- start start 2023-10-05T19:50:38.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2486799e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a30980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2486799e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f41a30ec0 con 0x560f41a305b0 2023-10-05T19:50:38.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2483acd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a30980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2483acd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a30980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45564/0 (socket says 172.21.15.167:45564) 2023-10-05T19:50:38.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.920+0000 7f2483acd700 1 -- 172.21.15.167:0/874107142 learned_addr learned my addr 172.21.15.167:0/874107142 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2483acd700 1 -- 172.21.15.167:0/874107142 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f41a31000 con 0x560f41a305b0 2023-10-05T19:50:38.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2483acd700 1 --2- 172.21.15.167:0/874107142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a30980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x560f419dd940 tx=0x7f246c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b6cdea5e38f8c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f24557e2700 1 -- 172.21.15.167:0/874107142 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f246c02d040 con 0x560f41a305b0 2023-10-05T19:50:38.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f24557e2700 1 -- 172.21.15.167:0/874107142 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c010a60 con 0x560f41a305b0 2023-10-05T19:50:38.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f24557e2700 1 -- 172.21.15.167:0/874107142 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f246c010c30 con 0x560f41a305b0 2023-10-05T19:50:38.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 -- 172.21.15.167:0/874107142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 msgr2=0x560f41a30980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 --2- 172.21.15.167:0/874107142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a30980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x560f419dd940 tx=0x7f246c010000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 -- 172.21.15.167:0/874107142 shutdown_connections 2023-10-05T19:50:38.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 --2- 172.21.15.167:0/874107142 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a30980 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 -- 172.21.15.167:0/874107142 >> 172.21.15.167:0/874107142 conn(0x560f41a2b970 msgr2=0x560f41a29ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 -- 172.21.15.167:0/874107142 shutdown_connections 2023-10-05T19:50:38.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 -- 172.21.15.167:0/874107142 wait complete. 2023-10-05T19:50:38.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 Processor -- start 2023-10-05T19:50:38.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 -- start start 2023-10-05T19:50:38.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a36040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2486799e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f41a37040 con 0x560f41a305b0 2023-10-05T19:50:38.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2483acd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a36040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2483acd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a36040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45580/0 (socket says 172.21.15.167:45580) 2023-10-05T19:50:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.924+0000 7f2483acd700 1 -- 172.21.15.167:0/1950525778 learned_addr learned my addr 172.21.15.167:0/1950525778 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f2483acd700 1 -- 172.21.15.167:0/1950525778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f419dd4d0 con 0x560f41a305b0 2023-10-05T19:50:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f2483acd700 1 --2- 172.21.15.167:0/1950525778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a36040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f246c00ea70 tx=0x7f246c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f23cf7fe700 1 -- 172.21.15.167:0/1950525778 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f246c033430 con 0x560f41a305b0 2023-10-05T19:50:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f23cf7fe700 1 -- 172.21.15.167:0/1950525778 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c033590 con 0x560f41a305b0 2023-10-05T19:50:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f2486799e40 1 -- 172.21.15.167:0/1950525778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f41a36640 con 0x560f41a305b0 2023-10-05T19:50:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f23cf7fe700 1 -- 172.21.15.167:0/1950525778 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f246c033740 con 0x560f41a305b0 2023-10-05T19:50:38.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f2486799e40 1 -- 172.21.15.167:0/1950525778 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f41a36a80 con 0x560f41a305b0 2023-10-05T19:50:38.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f23cf7fe700 1 -- 172.21.15.167:0/1950525778 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f246c0338a0 con 0x560f41a305b0 2023-10-05T19:50:38.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f23cf7fe700 1 --2- 172.21.15.167:0/1950525778 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f23c4030ca0 0x7f23c4033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:38.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f23cf7fe700 1 -- 172.21.15.167:0/1950525778 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f246c046c20 con 0x560f41a305b0 2023-10-05T19:50:38.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f2484acf700 1 --2- 172.21.15.167:0/1950525778 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f23c4030ca0 0x7f23c4033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:38.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f2486799e40 5 note: GC not initialized 2023-10-05T19:50:38.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.928+0000 7f2484acf700 1 --2- 172.21.15.167:0/1950525778 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f23c4030ca0 0x7f23c4033150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x560f41a25e90 tx=0x7f247400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:38.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f23ccff9700 20 reqs_thread_entry: start 2023-10-05T19:50:38.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f23c27fc700 20 reqs_thread_entry: start 2023-10-05T19:50:38.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 20 get_system_obj_state: rctx=0x7ffe691fbad8 obj=default.rgw.meta:users.uid:fud state=0x560f418b60b0 s->prefetch_data=0 2023-10-05T19:50:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T19:50:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f23c0ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:09 2023 2023-10-05T19:50:38.940 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a9e8d0 con 0x7f247c01a070 2023-10-05T19:50:38.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f23affff700 20 reqs_thread_entry: start 2023-10-05T19:50:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T19:50:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:38.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aa1360 con 0x7f247c01a070 2023-10-05T19:50:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T19:50:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T19:50:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 20 get_system_obj_state: rctx=0x7ffe691fae80 obj=default.rgw.meta:root:myfoo state=0x560f418b60b0 s->prefetch_data=0 2023-10-05T19:50:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:50:38.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.932+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aa0b70 con 0x7f247c01a070 2023-10-05T19:50:38.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:50:38.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:50:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aa2d60 con 0x7f247c01a070 2023-10-05T19:50:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T19:50:38.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 get_system_obj_state: rctx=0x7ffe691fae80 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x560f4188c2b0 s->prefetch_data=0 2023-10-05T19:50:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : miss 2023-10-05T19:50:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aa20c0 con 0x560f419e0ea0 2023-10-05T19:50:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(106 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x16 2023-10-05T19:50:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:38.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aa4dc0 con 0x560f419e0ea0 2023-10-05T19:50:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(107 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv2 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x13 2023-10-05T19:50:38.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 get_system_obj_state: rctx=0x7ffe691fae18 obj=default.rgw.meta:users.uid:fud state=0x560f4188c2b0 s->prefetch_data=0 2023-10-05T19:50:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x16, cached=0x13) 2023-10-05T19:50:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aa4d90 con 0x7f247c01a070 2023-10-05T19:50:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(108 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T19:50:38.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:38.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:38.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:38.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:38.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x17) 2023-10-05T19:50:38.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.936+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aa4dc0 con 0x7f247c01a070 2023-10-05T19:50:38.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.940+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(109 foo.buckets [call] v30'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.940+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aad2e0 con 0x560f419e0ea0 2023-10-05T19:50:38.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.940+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(110 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'3 uv3 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.940+0000 7f2486799e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x17 2023-10-05T19:50:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.940+0000 7f2486799e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.940+0000 7f2486799e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.940+0000 7f2486799e40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1, ofs0, ns] 2023-10-05T19:50:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.940+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [notify cookie 94623526212176 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aac130 con 0x7f247c01a070 2023-10-05T19:50:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== watch-notify(notify (1) cookie 94623525643184 notify 128849018889 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f247403c4c0 con 0x7f247c01a070 2023-10-05T19:50:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f24822ca700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94623525643184 notifier 4463 bl.length()=725 2023-10-05T19:50:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f24822ca700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x17 2023-10-05T19:50:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f24822ca700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:38.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(111 notify.7 [notify cookie 94623526212176 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f24822ca700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f24822ca700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2468003d90 con 0x7f247c01a070 2023-10-05T19:50:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(112 notify.7 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 28 ==== watch-notify(notify_complete (2) cookie 94623526212176 notify 128849018889 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f247403c0d0 con 0x7f247c01a070 2023-10-05T19:50:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2486799e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_sources= new_sources= 2023-10-05T19:50:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2486799e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential sources added=[] removed=[] 2023-10-05T19:50:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2486799e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_dests= new_dests= 2023-10-05T19:50:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2486799e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential dests added=[] removed=[] 2023-10-05T19:50:38.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aac130 con 0x560f419e0ea0 2023-10-05T19:50:38.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 fud.buckets [call] v30'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.944+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aad140 con 0x7f247c01a070 2023-10-05T19:50:38.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 29 ==== osd_op_reply(114 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2486799e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T19:50:38.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2486799e40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:38.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2486799e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T19:50:38.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94623526155888 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41aad140 con 0x560f41a17500 2023-10-05T19:50:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== watch-notify(notify (1) cookie 94623525640032 notify 128849018883 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x560f41a36a80 con 0x560f41a17500 2023-10-05T19:50:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(115 notify.6 [notify cookie 94623526155888 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f246c042070 con 0x560f41a17500 2023-10-05T19:50:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f24822ca700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94623525640032 notifier 4463 bl.length()=314 2023-10-05T19:50:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f24822ca700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T19:50:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f24822ca700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f24822ca700 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2468003d90 con 0x560f41a17500 2023-10-05T19:50:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== watch-notify(notify_complete (2) cookie 94623526155888 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560f41a36640 con 0x560f41a17500 2023-10-05T19:50:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(116 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f246c042070 con 0x560f41a17500 2023-10-05T19:50:38.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.948+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:117 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94623525616080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f419f2260 con 0x560f41a12580 2023-10-05T19:50:38.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.952+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(117 notify.0 [watch unwatch cookie 94623525616080] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.952+0000 7f2486799e40 20 remove_watcher() i=0 2023-10-05T19:50:38.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.952+0000 7f2486799e40 2 removed watcher, disabling cache 2023-10-05T19:50:38.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.952+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94623525626640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f419f2260 con 0x560f419e0ea0 2023-10-05T19:50:38.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.952+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(118 notify.1 [watch unwatch cookie 94623525626640] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.952+0000 7f2486799e40 20 remove_watcher() i=1 2023-10-05T19:50:38.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.952+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94623525624416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f419f2260 con 0x560f41a12580 2023-10-05T19:50:38.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.956+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(119 notify.2 [watch unwatch cookie 94623525624416] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.956+0000 7f2486799e40 20 remove_watcher() i=2 2023-10-05T19:50:38.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.956+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:120 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94623525630320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f419f2260 con 0x7f247c01a070 2023-10-05T19:50:38.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.956+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 30 ==== osd_op_reply(120 notify.3 [watch unwatch cookie 94623525630320] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.956+0000 7f2486799e40 20 remove_watcher() i=3 2023-10-05T19:50:38.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.956+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94623525627744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f419f2260 con 0x560f41a12580 2023-10-05T19:50:38.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.960+0000 7f24842ce700 1 -- 172.21.15.167:0/1282591613 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(121 notify.4 [watch unwatch cookie 94623525627744] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f247c016070 con 0x560f41a12580 2023-10-05T19:50:38.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.960+0000 7f2486799e40 20 remove_watcher() i=4 2023-10-05T19:50:38.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.960+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:122 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94623525635248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1e800 con 0x560f41a17500 2023-10-05T19:50:38.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.960+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(122 notify.5 [watch unwatch cookie 94623525635248] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f246c042070 con 0x560f41a17500 2023-10-05T19:50:38.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.960+0000 7f2486799e40 20 remove_watcher() i=5 2023-10-05T19:50:38.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.960+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:123 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94623525640032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1e800 con 0x560f41a17500 2023-10-05T19:50:38.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.964+0000 7f2483acd700 1 -- 172.21.15.167:0/1282591613 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(123 notify.6 [watch unwatch cookie 94623525640032] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f246c042070 con 0x560f41a17500 2023-10-05T19:50:38.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.964+0000 7f2486799e40 20 remove_watcher() i=6 2023-10-05T19:50:38.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.964+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:124 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94623525643184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1e800 con 0x7f247c01a070 2023-10-05T19:50:38.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.964+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.2 v2:172.21.15.167:6816/26774 31 ==== osd_op_reply(124 notify.7 [watch unwatch cookie 94623525643184] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2474033040 con 0x7f247c01a070 2023-10-05T19:50:38.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.964+0000 7f2486799e40 20 remove_watcher() i=7 2023-10-05T19:50:38.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.964+0000 7f2455fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:38.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.964+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:125 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94623525644288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560f41a1e800 con 0x560f419e0ea0 2023-10-05T19:50:38.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(125 data_loggenerations_metadata [watch unwatch cookie 94623525644288] v30'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2474033040 con 0x560f419e0ea0 2023-10-05T19:50:38.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560f41a12580 msgr2=0x560f41a14960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560f41a12580 0x560f41a14960 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560f419e0ea0 msgr2=0x560f41a10540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560f419e0ea0 0x560f41a10540 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f247c01a070 msgr2=0x7f247c0253d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f247c01a070 0x7f247c0253d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560f41a17500 msgr2=0x560f41a198e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560f41a17500 0x560f41a198e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2464030c00 msgr2=0x7f24640330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2464030c00 0x7f24640330b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f246c000f80 tx=0x7f246c013000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 msgr2=0x560f41a04b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1282591613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f419dc8c0 0x560f41a04b20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f247c0018e0 tx=0x7f247c016000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 reap_dead start 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2484acf700 1 -- 172.21.15.167:0/1282591613 reap_dead start 2023-10-05T19:50:38.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 shutdown_connections 2023-10-05T19:50:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 >> 172.21.15.167:0/1282591613 conn(0x560f419d82e0 msgr2=0x560f419f60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 shutdown_connections 2023-10-05T19:50:38.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1282591613 wait complete. 2023-10-05T19:50:38.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1950525778 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f23c4030ca0 msgr2=0x7f23c4033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1950525778 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f23c4030ca0 0x7f23c4033150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x560f41a25e90 tx=0x7f247400e040 comp rx=0 tx=0).stop 2023-10-05T19:50:38.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1950525778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 msgr2=0x560f41a36040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:38.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1950525778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a36040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f246c00ea70 tx=0x7f246c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:38.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1950525778 shutdown_connections 2023-10-05T19:50:38.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1950525778 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f23c4030ca0 0x7f23c4033150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 --2- 172.21.15.167:0/1950525778 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560f41a305b0 0x560f41a36040 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:38.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1950525778 >> 172.21.15.167:0/1950525778 conn(0x560f41a2b970 msgr2=0x560f41a29a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:38.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1950525778 shutdown_connections 2023-10-05T19:50:38.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:38.968+0000 7f2486799e40 1 -- 172.21.15.167:0/1950525778 wait complete. 2023-10-05T19:50:38.983 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2023-10-05T19:50:38.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2023-10-05T19:50:38.984 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2023-10-05T19:50:39.023 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:39.023 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:39.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81f2af1e40 1 Processor -- start 2023-10-05T19:50:39.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81f2af1e40 1 -- start start 2023-10-05T19:50:39.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81f2af1e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55dd8384a120 0x55dd8384c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81f2af1e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dd83790bd0 con 0x55dd83845b50 2023-10-05T19:50:39.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81f2af1e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dd8374dee0 con 0x55dd8384a120 2023-10-05T19:50:39.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81efe25700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55dd8384a120 0x55dd8384c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81efe25700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55dd8384a120 0x55dd8384c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45596/0 (socket says 172.21.15.167:45596) 2023-10-05T19:50:39.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81efe25700 1 -- 172.21.15.167:0/722917454 learned_addr learned my addr 172.21.15.167:0/722917454 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81f0626700 1 --1- 172.21.15.167:0/722917454 >> v1:172.21.15.118:6789/0 conn(0x55dd83845b50 0x55dd83845f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51698/0 (socket says 172.21.15.167:51698) 2023-10-05T19:50:39.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81efe25700 1 -- 172.21.15.167:0/722917454 >> v1:172.21.15.118:6789/0 conn(0x55dd83845b50 legacy=0x55dd83845f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81ef624700 1 -- 172.21.15.167:0/722917454 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622501740 0 0) 0x55dd83790bd0 con 0x55dd83845b50 2023-10-05T19:50:39.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.016+0000 7f81efe25700 1 -- 172.21.15.167:0/722917454 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd83846760 con 0x55dd8384a120 2023-10-05T19:50:39.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81efe25700 1 --2- 172.21.15.167:0/722917454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd8384a120 0x55dd8384c500 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f81d800a5c0 tx=0x7f81d8005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83d3a009663cfd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81ef624700 1 -- 172.21.15.167:0/722917454 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81d800e510 con 0x55dd8384a120 2023-10-05T19:50:39.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81ef624700 1 -- 172.21.15.167:0/722917454 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d800e670 con 0x55dd8384a120 2023-10-05T19:50:39.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81ef624700 1 -- 172.21.15.167:0/722917454 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81d800e920 con 0x55dd8384a120 2023-10-05T19:50:39.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81f2af1e40 1 -- 172.21.15.167:0/722917454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd8384a120 msgr2=0x55dd8384c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/722917454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd8384a120 0x55dd8384c500 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f81d800a5c0 tx=0x7f81d8005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:39.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81f2af1e40 1 -- 172.21.15.167:0/722917454 shutdown_connections 2023-10-05T19:50:39.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/722917454 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd8384a120 0x55dd8384c500 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81f2af1e40 1 -- 172.21.15.167:0/722917454 >> 172.21.15.167:0/722917454 conn(0x55dd837b95c0 msgr2=0x55dd837b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81f2af1e40 1 -- 172.21.15.167:0/722917454 shutdown_connections 2023-10-05T19:50:39.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81f2af1e40 1 -- 172.21.15.167:0/722917454 wait complete. 2023-10-05T19:50:39.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81f2af1e40 1 Processor -- start 2023-10-05T19:50:39.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.020+0000 7f81f2af1e40 1 -- start start 2023-10-05T19:50:39.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd83864990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd83711e30 con 0x55dd83845b50 2023-10-05T19:50:39.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f0626700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd83864990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f0626700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd83864990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45602/0 (socket says 172.21.15.167:45602) 2023-10-05T19:50:39.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f0626700 1 -- 172.21.15.167:0/2087475450 learned_addr learned my addr 172.21.15.167:0/2087475450 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f0626700 1 -- 172.21.15.167:0/2087475450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d800a180 con 0x55dd83845b50 2023-10-05T19:50:39.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f0626700 1 --2- 172.21.15.167:0/2087475450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd83864990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f81e0001e80 tx=0x7f81e0001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2336c065327515c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81ee622700 1 -- 172.21.15.167:0/2087475450 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81e0014070 con 0x55dd83845b50 2023-10-05T19:50:39.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81ee622700 1 -- 172.21.15.167:0/2087475450 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e000f450 con 0x55dd83845b50 2023-10-05T19:50:39.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81ee622700 1 -- 172.21.15.167:0/2087475450 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81e000f740 con 0x55dd83845b50 2023-10-05T19:50:39.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 -- 172.21.15.167:0/2087475450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 msgr2=0x55dd83864990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/2087475450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd83864990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f81e0001e80 tx=0x7f81e0001850 comp rx=0 tx=0).stop 2023-10-05T19:50:39.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 -- 172.21.15.167:0/2087475450 shutdown_connections 2023-10-05T19:50:39.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/2087475450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd83864990 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 -- 172.21.15.167:0/2087475450 >> 172.21.15.167:0/2087475450 conn(0x55dd837b95c0 msgr2=0x55dd83860550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 -- 172.21.15.167:0/2087475450 shutdown_connections 2023-10-05T19:50:39.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 -- 172.21.15.167:0/2087475450 wait complete. 2023-10-05T19:50:39.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 Processor -- start 2023-10-05T19:50:39.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 -- start start 2023-10-05T19:50:39.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd8386b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.024+0000 7f81f2af1e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd836e4ed0 con 0x55dd83845b50 2023-10-05T19:50:39.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81f0626700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd8386b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81f0626700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd8386b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45612/0 (socket says 172.21.15.167:45612) 2023-10-05T19:50:39.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 learned_addr learned my addr 172.21.15.167:0/892104982 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0001b30 con 0x55dd83845b50 2023-10-05T19:50:39.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81f0626700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd8386b790 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f81e00011e0 tx=0x7f81e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81ece1f700 1 -- 172.21.15.167:0/892104982 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81e000fe50 con 0x55dd83845b50 2023-10-05T19:50:39.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81ece1f700 1 -- 172.21.15.167:0/892104982 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e001cb40 con 0x55dd83845b50 2023-10-05T19:50:39.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81ece1f700 1 -- 172.21.15.167:0/892104982 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81e001ce30 con 0x55dd83845b50 2023-10-05T19:50:39.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd8386bcd0 con 0x55dd83845b50 2023-10-05T19:50:39.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd8386c110 con 0x55dd83845b50 2023-10-05T19:50:39.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.028+0000 7f81ece1f700 1 -- 172.21.15.167:0/892104982 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f81e0023020 con 0x55dd83845b50 2023-10-05T19:50:39.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81ece1f700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81d4030c50 0x7f81d4033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81ece1f700 1 -- 172.21.15.167:0/892104982 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f81e0008030 con 0x55dd83845b50 2023-10-05T19:50:39.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81efe25700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81d4030c50 0x7f81d4033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd8384a120 0x55dd83877250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83877950 con 0x55dd8384a120 2023-10-05T19:50:39.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f0e27700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd8384a120 0x55dd83877250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81efe25700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81d4030c50 0x7f81d4033100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81d8005e40 tx=0x7f81d8013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f0e27700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd8384a120 0x55dd83877250 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f81e800a500 con 0x55dd8384a120 2023-10-05T19:50:39.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 20 realm 2023-10-05T19:50:39.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838748b0 con 0x55dd8384a120 2023-10-05T19:50:39.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f81e800a500 con 0x55dd8384a120 2023-10-05T19:50:39.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:39.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83878430 con 0x55dd8384a120 2023-10-05T19:50:39.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f81e800a500 con 0x55dd8384a120 2023-10-05T19:50:39.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd83879260 0x55dd8387b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.032+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd8387bb80 con 0x55dd83879260 2023-10-05T19:50:39.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f0626700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd83879260 0x55dd8387b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f0626700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd83879260 0x55dd8387b640 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd8387c420 con 0x55dd8384a120 2023-10-05T19:50:39.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f81e800a500 con 0x55dd8384a120 2023-10-05T19:50:39.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:39.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f2af1e40 20 searching for the correct realm 2023-10-05T19:50:39.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd8387e1e0 0x55dd838805c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8387e1e0 2023-10-05T19:50:39.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81efe25700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd8387e1e0 0x55dd838805c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81efe25700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd8387e1e0 0x55dd838805c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.036+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd83879260 2023-10-05T19:50:39.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0626700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f81e003f040 0x7f81e00439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x7f81e003f040 2023-10-05T19:50:39.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0e27700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f81e003f040 0x7f81e00439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0e27700 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f81e003f040 0x7f81e00439a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x7f81e003f040 2023-10-05T19:50:39.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8387e1e0 2023-10-05T19:50:39.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.040+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd83879260 2023-10-05T19:50:39.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd83879260 2023-10-05T19:50:39.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x7f81e003f040 2023-10-05T19:50:39.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x7f81e003f040 2023-10-05T19:50:39.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.044+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x7f81e003f040 2023-10-05T19:50:39.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x7f81e003f040 2023-10-05T19:50:39.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd83879260 2023-10-05T19:50:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8387e1e0 2023-10-05T19:50:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd83879260 2023-10-05T19:50:39.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8387e1e0 2023-10-05T19:50:39.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.048+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8387e1e0 2023-10-05T19:50:39.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x7f81e003f040 2023-10-05T19:50:39.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x7f81e003f040 2023-10-05T19:50:39.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8384a120 2023-10-05T19:50:39.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x7f81e003f040 2023-10-05T19:50:39.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x7f81e003f040 2023-10-05T19:50:39.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8387e1e0 2023-10-05T19:50:39.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.052+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x7f81e003f040 2023-10-05T19:50:39.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x7f81e003f040 2023-10-05T19:50:39.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd83879260 2023-10-05T19:50:39.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd83879260 2023-10-05T19:50:39.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd8387e1e0 2023-10-05T19:50:39.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd83879260 2023-10-05T19:50:39.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.056+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880b00 con 0x55dd83879260 2023-10-05T19:50:39.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:39.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:39.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:39.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:39.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd8387cf90 con 0x55dd8384a120 2023-10-05T19:50:39.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd8387d8e0 con 0x55dd83879260 2023-10-05T19:50:39.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f81e0016070 con 0x55dd83879260 2023-10-05T19:50:39.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83880f40 con 0x55dd83879260 2023-10-05T19:50:39.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:39.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838812f0 con 0x55dd8387e1e0 2023-10-05T19:50:39.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.060+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd8387d420 con 0x55dd83879260 2023-10-05T19:50:39.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882f50 con 0x55dd8387e1e0 2023-10-05T19:50:39.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882f50 con 0x55dd83879260 2023-10-05T19:50:39.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882f50 con 0x7f81e003f040 2023-10-05T19:50:39.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x7f81e003f040 2023-10-05T19:50:39.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.064+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8387e1e0 2023-10-05T19:50:39.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd83879260 2023-10-05T19:50:39.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd83879260 2023-10-05T19:50:39.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.068+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x7f81e003f040 2023-10-05T19:50:39.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x7f81e003f040 2023-10-05T19:50:39.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x7f81e003f040 2023-10-05T19:50:39.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x7f81e003f040 2023-10-05T19:50:39.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd83879260 2023-10-05T19:50:39.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8387e1e0 2023-10-05T19:50:39.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.072+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd83879260 2023-10-05T19:50:39.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8387e1e0 2023-10-05T19:50:39.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8014040 con 0x55dd8384a120 2023-10-05T19:50:39.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8387e1e0 2023-10-05T19:50:39.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x7f81e003f040 2023-10-05T19:50:39.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.076+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8384a120 2023-10-05T19:50:39.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x7f81e003f040 2023-10-05T19:50:39.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8387e1e0 2023-10-05T19:50:39.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x7f81e003f040 2023-10-05T19:50:39.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd83879260 2023-10-05T19:50:39.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd83879260 2023-10-05T19:50:39.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.080+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd8387e1e0 2023-10-05T19:50:39.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd83879260 2023-10-05T19:50:39.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838816a0 con 0x55dd83879260 2023-10-05T19:50:39.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81e004b040 con 0x55dd83879260 2023-10-05T19:50:39.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:39.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:39.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:39.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:39.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83881f40 con 0x55dd83879260 2023-10-05T19:50:39.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882340 con 0x55dd8384a120 2023-10-05T19:50:39.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:39.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.084+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882c30 con 0x55dd83879260 2023-10-05T19:50:39.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882c30 con 0x55dd83879260 2023-10-05T19:50:39.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:39.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882c30 con 0x7f81e003f040 2023-10-05T19:50:39.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 zone default found 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 4 Realm: () 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 zonegroup default 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882c30 con 0x7f81e003f040 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882c30 con 0x55dd8387e1e0 2023-10-05T19:50:39.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.088+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83884c10 con 0x55dd8387e1e0 2023-10-05T19:50:39.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f2af1e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f2af1e40 20 started sync module instance, tier type = 2023-10-05T19:50:39.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f2af1e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:39.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838842d0 con 0x55dd83879260 2023-10-05T19:50:39.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94409882871616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838842d0 con 0x55dd83879260 2023-10-05T19:50:39.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.092+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838854b0 con 0x55dd8384a120 2023-10-05T19:50:39.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.096+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.096+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94409882871616] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.096+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94409882879696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838854b0 con 0x55dd8384a120 2023-10-05T19:50:39.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.096+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83885d50 con 0x55dd83879260 2023-10-05T19:50:39.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.096+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94409882879696] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.096+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.100+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94409882882272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83885a20 con 0x55dd83879260 2023-10-05T19:50:39.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.100+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838864a0 con 0x7f81e003f040 2023-10-05T19:50:39.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.100+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94409882882272] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.100+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.100+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94409882886000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83885a20 con 0x7f81e003f040 2023-10-05T19:50:39.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.100+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83886d90 con 0x55dd83879260 2023-10-05T19:50:39.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.104+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94409882886000] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.104+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.104+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94409882883936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83886d90 con 0x55dd83879260 2023-10-05T19:50:39.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.104+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838877a0 con 0x55dd8387e1e0 2023-10-05T19:50:39.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.104+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.104+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94409882890928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83888040 con 0x55dd8387e1e0 2023-10-05T19:50:39.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.104+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94409882883936] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.104+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83888a50 con 0x55dd8387e1e0 2023-10-05T19:50:39.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94409882890928] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94409882895712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83888e00 con 0x55dd8387e1e0 2023-10-05T19:50:39.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838896a0 con 0x7f81e003f040 2023-10-05T19:50:39.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94409882895712] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81d8017050 con 0x55dd8387e1e0 2023-10-05T19:50:39.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94409882898864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83889af0 con 0x7f81e003f040 2023-10-05T19:50:39.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 20 add_watcher() i=0 2023-10-05T19:50:39.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 20 add_watcher() i=1 2023-10-05T19:50:39.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 20 add_watcher() i=2 2023-10-05T19:50:39.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 20 add_watcher() i=3 2023-10-05T19:50:39.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 20 add_watcher() i=4 2023-10-05T19:50:39.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 20 add_watcher() i=5 2023-10-05T19:50:39.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 20 add_watcher() i=6 2023-10-05T19:50:39.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94409882898864] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 20 add_watcher() i=7 2023-10-05T19:50:39.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:39.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd8388cc30 con 0x55dd8384a120 2023-10-05T19:50:39.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.108+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94409882899968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83889f40 con 0x55dd8384a120 2023-10-05T19:50:39.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94409882899968] v30'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81c0ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:39.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81f2af1e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:39.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81f2af1e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:39.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81f2af1e40 1 Processor -- start 2023-10-05T19:50:39.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81f2af1e40 1 -- start start 2023-10-05T19:50:39.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81f2af1e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd83897820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81f2af1e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd83897d60 con 0x55dd83897450 2023-10-05T19:50:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81efe25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd83897820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81efe25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd83897820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45622/0 (socket says 172.21.15.167:45622) 2023-10-05T19:50:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81efe25700 1 -- 172.21.15.167:0/1765816509 learned_addr learned my addr 172.21.15.167:0/1765816509 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81efe25700 1 -- 172.21.15.167:0/1765816509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd83897ea0 con 0x55dd83897450 2023-10-05T19:50:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.112+0000 7f81efe25700 1 --2- 172.21.15.167:0/1765816509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd83897820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f81d8003000 tx=0x7f81d800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15af6afb8873f718 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f813bfff700 1 -- 172.21.15.167:0/1765816509 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81d8010a00 con 0x55dd83897450 2023-10-05T19:50:39.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f813bfff700 1 -- 172.21.15.167:0/1765816509 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d802f040 con 0x55dd83897450 2023-10-05T19:50:39.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f813bfff700 1 -- 172.21.15.167:0/1765816509 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81d8010be0 con 0x55dd83897450 2023-10-05T19:50:39.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1765816509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 msgr2=0x55dd83897820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1765816509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd83897820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f81d8003000 tx=0x7f81d800f000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1765816509 shutdown_connections 2023-10-05T19:50:39.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1765816509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd83897820 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1765816509 >> 172.21.15.167:0/1765816509 conn(0x55dd83892810 msgr2=0x55dd83890960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1765816509 shutdown_connections 2023-10-05T19:50:39.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1765816509 wait complete. 2023-10-05T19:50:39.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 Processor -- start 2023-10-05T19:50:39.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 -- start start 2023-10-05T19:50:39.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd8389ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81f2af1e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd8389ded0 con 0x55dd83897450 2023-10-05T19:50:39.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81efe25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd8389ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81efe25700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd8389ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45624/0 (socket says 172.21.15.167:45624) 2023-10-05T19:50:39.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81efe25700 1 -- 172.21.15.167:0/1426359865 learned_addr learned my addr 172.21.15.167:0/1426359865 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81efe25700 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd83846760 con 0x55dd83897450 2023-10-05T19:50:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.116+0000 7f81efe25700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd8389ced0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55dd838914d0 tx=0x7f81d802b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f813a7fc700 1 -- 172.21.15.167:0/1426359865 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81d8010a00 con 0x55dd83897450 2023-10-05T19:50:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f813a7fc700 1 -- 172.21.15.167:0/1426359865 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8029ba0 con 0x55dd83897450 2023-10-05T19:50:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd8389d4d0 con 0x55dd83897450 2023-10-05T19:50:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f813a7fc700 1 -- 172.21.15.167:0/1426359865 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81d8029d70 con 0x55dd83897450 2023-10-05T19:50:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd8389d910 con 0x55dd83897450 2023-10-05T19:50:39.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f813a7fc700 1 -- 172.21.15.167:0/1426359865 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f81d803d400 con 0x55dd83897450 2023-10-05T19:50:39.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f813a7fc700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8130030c50 0x7f8130033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f813a7fc700 1 -- 172.21.15.167:0/1426359865 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f81d8048c20 con 0x55dd83897450 2023-10-05T19:50:39.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f81f0e27700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8130030c50 0x7f8130033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd838a7ac0 0x55dd838a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838aa520 con 0x55dd838a7ac0 2023-10-05T19:50:39.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f81f0e27700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8130030c50 0x7f8130033100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55dd8388cce0 tx=0x7f81e800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f81f0626700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd838a7ac0 0x55dd838a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.120+0000 7f81f0626700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd838a7ac0 0x55dd838a9ed0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.124+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.124+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55dd838ab1f0 0x55dd838ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.124+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838add00 con 0x55dd838ab1f0 2023-10-05T19:50:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.124+0000 7f81efe25700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55dd838ab1f0 0x55dd838ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.124+0000 7f81efe25700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55dd838ab1f0 0x55dd838ad5d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.124+0000 7f81efe25700 1 -- 172.21.15.167:0/1426359865 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81d8039020 con 0x55dd838ab1f0 2023-10-05T19:50:39.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.124+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd838ae9d0 0x55dd838b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.128+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b1510 con 0x55dd838ae9d0 2023-10-05T19:50:39.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.128+0000 7f81f0e27700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd838ae9d0 0x55dd838b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.128+0000 7f81f0e27700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd838ae9d0 0x55dd838b0de0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.128+0000 7f81f0e27700 1 -- 172.21.15.167:0/1426359865 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd838ae9d0 2023-10-05T19:50:39.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.128+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd838b21e0 0x55dd838b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.128+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b4d20 con 0x55dd838b21e0 2023-10-05T19:50:39.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.128+0000 7f81f0626700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd838b21e0 0x55dd838b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.128+0000 7f81f0626700 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd838b21e0 0x55dd838b45f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.132+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'113 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838b21e0 2023-10-05T19:50:39.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.132+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b5370 con 0x55dd838a7ac0 2023-10-05T19:50:39.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.132+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'34 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.132+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b5990 con 0x55dd838ae9d0 2023-10-05T19:50:39.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.136+0000 7f81f0e27700 1 -- 172.21.15.167:0/1426359865 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd838ae9d0 2023-10-05T19:50:39.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.136+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b5fb0 con 0x55dd838a7ac0 2023-10-05T19:50:39.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.136+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.136+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b5fb0 con 0x55dd838b21e0 2023-10-05T19:50:39.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.140+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838b21e0 2023-10-05T19:50:39.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.140+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b5fb0 con 0x55dd838a7ac0 2023-10-05T19:50:39.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.144+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.144+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6040 con 0x55dd838a7ac0 2023-10-05T19:50:39.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.144+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.144+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b60d0 con 0x55dd838a7ac0 2023-10-05T19:50:39.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.148+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'35 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.148+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b60d0 con 0x55dd838ae9d0 2023-10-05T19:50:39.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.148+0000 7f81f0e27700 1 -- 172.21.15.167:0/1426359865 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd838ae9d0 2023-10-05T19:50:39.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.148+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b66f0 con 0x55dd838a7ac0 2023-10-05T19:50:39.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.152+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.152+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838b21e0 2023-10-05T19:50:39.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.152+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'30 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838b21e0 2023-10-05T19:50:39.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.152+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838b21e0 2023-10-05T19:50:39.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.156+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'114 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838b21e0 2023-10-05T19:50:39.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.156+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838a7ac0 2023-10-05T19:50:39.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.160+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.160+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838a7ac0 2023-10-05T19:50:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.160+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'36 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.160+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838ae9d0 2023-10-05T19:50:39.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.164+0000 7f81f0e27700 1 -- 172.21.15.167:0/1426359865 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd838ae9d0 2023-10-05T19:50:39.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.164+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838a7ac0 2023-10-05T19:50:39.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.164+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.164+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838b21e0 2023-10-05T19:50:39.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.168+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'115 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838b21e0 2023-10-05T19:50:39.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.168+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838a7ac0 2023-10-05T19:50:39.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.172+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.172+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838a7ac0 2023-10-05T19:50:39.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.172+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.172+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6750 con 0x55dd838ae9d0 2023-10-05T19:50:39.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.176+0000 7f81f0e27700 1 -- 172.21.15.167:0/1426359865 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd838ae9d0 2023-10-05T19:50:39.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.176+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b67b0 con 0x55dd838a7ac0 2023-10-05T19:50:39.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.176+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.180+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b67e0 con 0x55dd838ae9d0 2023-10-05T19:50:39.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.180+0000 7f81f0e27700 1 -- 172.21.15.167:0/1426359865 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd838ae9d0 2023-10-05T19:50:39.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.180+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6870 con 0x55dd838ae9d0 2023-10-05T19:50:39.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.184+0000 7f81f0e27700 1 -- 172.21.15.167:0/1426359865 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'25 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd838ae9d0 2023-10-05T19:50:39.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.184+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6900 con 0x55dd838ae9d0 2023-10-05T19:50:39.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.184+0000 7f81f0e27700 1 -- 172.21.15.167:0/1426359865 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd838ae9d0 2023-10-05T19:50:39.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.184+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6900 con 0x55dd838a7ac0 2023-10-05T19:50:39.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.188+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.188+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6900 con 0x55dd838b21e0 2023-10-05T19:50:39.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.188+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'23 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838b21e0 2023-10-05T19:50:39.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.188+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6900 con 0x55dd838a7ac0 2023-10-05T19:50:39.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.192+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838a7ac0 2023-10-05T19:50:39.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.192+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6900 con 0x55dd838b21e0 2023-10-05T19:50:39.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.192+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'31 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd838b21e0 2023-10-05T19:50:39.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.192+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838b6900 con 0x55dd838ab1f0 2023-10-05T19:50:39.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.196+0000 7f81efe25700 1 -- 172.21.15.167:0/1426359865 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f81d8039020 con 0x55dd838ab1f0 2023-10-05T19:50:39.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f812f7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:39.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f812d7fa700 20 reqs_thread_entry: start 2023-10-05T19:50:39.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:39.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:39.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f811b7fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:09 2023 2023-10-05T19:50:39.208 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:39.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f811affd700 20 reqs_thread_entry: start 2023-10-05T19:50:39.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 20 get_system_obj_state: rctx=0x7ffddacfd3f8 obj=default.rgw.meta:users.uid:fud state=0x55dd8371d0b0 s->prefetch_data=0 2023-10-05T19:50:39.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T19:50:39.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83915840 con 0x7f81e003f040 2023-10-05T19:50:39.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T19:50:39.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:39.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:39.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:39.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.200+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd839182d0 con 0x7f81e003f040 2023-10-05T19:50:39.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.204+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.204+0000 7f81f2af1e40 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T19:50:39.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.204+0000 7f81f2af1e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T19:50:39.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.204+0000 7f81f2af1e40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:39.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.204+0000 7f81f2af1e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.204+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd839182d0 con 0x55dd8384a120 2023-10-05T19:50:39.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.204+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.212 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2023-10-05T19:50:39.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.204+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94409882871616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838d3df0 con 0x55dd83879260 2023-10-05T19:50:39.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.208+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94409882871616] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.208+0000 7f81f2af1e40 20 remove_watcher() i=0 2023-10-05T19:50:39.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.208+0000 7f81f2af1e40 2 removed watcher, disabling cache 2023-10-05T19:50:39.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.208+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94409882879696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882740 con 0x55dd8384a120 2023-10-05T19:50:39.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.208+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94409882879696] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x55dd8384a120 2023-10-05T19:50:39.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.208+0000 7f81f2af1e40 20 remove_watcher() i=1 2023-10-05T19:50:39.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.208+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94409882882272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882740 con 0x55dd83879260 2023-10-05T19:50:39.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.212+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94409882882272] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.212+0000 7f81f2af1e40 20 remove_watcher() i=2 2023-10-05T19:50:39.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.212+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94409882886000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882740 con 0x7f81e003f040 2023-10-05T19:50:39.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.212+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94409882886000] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.212+0000 7f81f2af1e40 20 remove_watcher() i=3 2023-10-05T19:50:39.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.212+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94409882883936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83885f70 con 0x55dd83879260 2023-10-05T19:50:39.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.216+0000 7f81f0626700 1 -- 172.21.15.167:0/892104982 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94409882883936] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e0054040 con 0x55dd83879260 2023-10-05T19:50:39.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.216+0000 7f81f2af1e40 20 remove_watcher() i=4 2023-10-05T19:50:39.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.216+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94409882890928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882740 con 0x55dd8387e1e0 2023-10-05T19:50:39.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.216+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94409882890928] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81d8039020 con 0x55dd8387e1e0 2023-10-05T19:50:39.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.216+0000 7f81f2af1e40 20 remove_watcher() i=5 2023-10-05T19:50:39.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.216+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94409882895712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83885760 con 0x55dd8387e1e0 2023-10-05T19:50:39.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.220+0000 7f81efe25700 1 -- 172.21.15.167:0/892104982 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94409882895712] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81d8039020 con 0x55dd8387e1e0 2023-10-05T19:50:39.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.220+0000 7f81f2af1e40 20 remove_watcher() i=6 2023-10-05T19:50:39.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.220+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94409882898864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd838872b0 con 0x7f81e003f040 2023-10-05T19:50:39.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.220+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94409882898864] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81e8033040 con 0x7f81e003f040 2023-10-05T19:50:39.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.220+0000 7f81f2af1e40 20 remove_watcher() i=7 2023-10-05T19:50:39.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81c0ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:39.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94409882899968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dd83882740 con 0x55dd8384a120 2023-10-05T19:50:39.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94409882899968] v30'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f81e805b040 con 0x55dd8384a120 2023-10-05T19:50:39.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd83879260 msgr2=0x55dd8387b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd83879260 0x55dd8387b640 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd8384a120 msgr2=0x55dd83877250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd8384a120 0x55dd83877250 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f81e003f040 msgr2=0x7f81e00439a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f81e003f040 0x7f81e00439a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd8387e1e0 msgr2=0x55dd838805c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd8387e1e0 0x55dd838805c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81d4030c50 msgr2=0x7f81d4033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81d4030c50 0x7f81d4033100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f81d8005e40 tx=0x7f81d8013000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 msgr2=0x55dd8386b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/892104982 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83845b50 0x55dd8386b790 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f81e00011e0 tx=0x7f81e0016000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f0e27700 1 -- 172.21.15.167:0/892104982 reap_dead start 2023-10-05T19:50:39.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 shutdown_connections 2023-10-05T19:50:39.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 >> 172.21.15.167:0/892104982 conn(0x55dd837b95c0 msgr2=0x55dd8385efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 shutdown_connections 2023-10-05T19:50:39.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.224+0000 7f81f2af1e40 1 -- 172.21.15.167:0/892104982 wait complete. 2023-10-05T19:50:39.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd838a7ac0 msgr2=0x55dd838a9ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55dd838a7ac0 0x55dd838a9ed0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd838b21e0 msgr2=0x55dd838b45f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55dd838b21e0 0x55dd838b45f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55dd838ab1f0 msgr2=0x55dd838ad5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55dd838ab1f0 0x55dd838ad5d0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd838ae9d0 msgr2=0x55dd838b0de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55dd838ae9d0 0x55dd838b0de0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8130030c50 msgr2=0x7f8130033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8130030c50 0x7f8130033100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55dd8388cce0 tx=0x7f81e800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f0626700 1 -- 172.21.15.167:0/1426359865 reap_dead start 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 msgr2=0x55dd8389ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd8389ced0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55dd838914d0 tx=0x7f81d802b000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 shutdown_connections 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 --2- 172.21.15.167:0/1426359865 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55dd83897450 0x55dd8389ced0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 >> 172.21.15.167:0/1426359865 conn(0x55dd83892810 msgr2=0x55dd838908b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 shutdown_connections 2023-10-05T19:50:39.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.228+0000 7f81f2af1e40 1 -- 172.21.15.167:0/1426359865 wait complete. 2023-10-05T19:50:39.240 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-10-05T19:50:39.240 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2023-10-05T19:50:39.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2023-10-05T19:50:39.241 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2023-10-05T19:50:39.324 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:39.324 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:39.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.316+0000 7f5d696dfe40 1 Processor -- start 2023-10-05T19:50:39.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.316+0000 7f5d696dfe40 1 -- start start 2023-10-05T19:50:39.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.316+0000 7f5d696dfe40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a55ea26120 0x55a55ea28500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.316+0000 7f5d696dfe40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a55e96cbd0 con 0x55a55ea21ba0 2023-10-05T19:50:39.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.316+0000 7f5d696dfe40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a55e929ee0 con 0x55a55ea26120 2023-10-05T19:50:39.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.316+0000 7f5d66a13700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a55ea26120 0x55a55ea28500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.316+0000 7f5d66a13700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a55ea26120 0x55a55ea28500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45628/0 (socket says 172.21.15.167:45628) 2023-10-05T19:50:39.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.316+0000 7f5d67214700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55a55ea21ba0 0x55a55ea21f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51704/0 (socket says 172.21.15.167:51704) 2023-10-05T19:50:39.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.316+0000 7f5d66a13700 1 -- 172.21.15.167:0/262676733 learned_addr learned my addr 172.21.15.167:0/262676733 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d66212700 1 -- 172.21.15.167:0/262676733 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083814790 0 0) 0x55a55e96cbd0 con 0x55a55ea21ba0 2023-10-05T19:50:39.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d66a13700 1 -- 172.21.15.167:0/262676733 >> v1:172.21.15.118:6789/0 conn(0x55a55ea21ba0 legacy=0x55a55ea21f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d66a13700 1 -- 172.21.15.167:0/262676733 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a55ea227b0 con 0x55a55ea26120 2023-10-05T19:50:39.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d66a13700 1 --2- 172.21.15.167:0/262676733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea26120 0x55a55ea28500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000a650 tx=0x7f5d50005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7f70978777c8a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d66212700 1 -- 172.21.15.167:0/262676733 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d50008760 con 0x55a55ea26120 2023-10-05T19:50:39.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d66212700 1 -- 172.21.15.167:0/262676733 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d500088c0 con 0x55a55ea26120 2023-10-05T19:50:39.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d66212700 1 -- 172.21.15.167:0/262676733 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d50008bb0 con 0x55a55ea26120 2023-10-05T19:50:39.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 -- 172.21.15.167:0/262676733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea26120 msgr2=0x55a55ea28500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/262676733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea26120 0x55a55ea28500 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d5000a650 tx=0x7f5d50005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:39.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 -- 172.21.15.167:0/262676733 shutdown_connections 2023-10-05T19:50:39.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/262676733 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea26120 0x55a55ea28500 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 -- 172.21.15.167:0/262676733 >> 172.21.15.167:0/262676733 conn(0x55a55e995550 msgr2=0x55a55ea1fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 -- 172.21.15.167:0/262676733 shutdown_connections 2023-10-05T19:50:39.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 -- 172.21.15.167:0/262676733 wait complete. 2023-10-05T19:50:39.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 Processor -- start 2023-10-05T19:50:39.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 -- start start 2023-10-05T19:50:39.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea40a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d696dfe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a55e8ede30 con 0x55a55ea21ba0 2023-10-05T19:50:39.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d67214700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea40a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d67214700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea40a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45642/0 (socket says 172.21.15.167:45642) 2023-10-05T19:50:39.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.320+0000 7f5d67214700 1 -- 172.21.15.167:0/3540630442 learned_addr learned my addr 172.21.15.167:0/3540630442 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d67214700 1 -- 172.21.15.167:0/3540630442 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d50005db0 con 0x55a55ea21ba0 2023-10-05T19:50:39.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d67214700 1 --2- 172.21.15.167:0/3540630442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea40a00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d60001630 tx=0x7f5d600069b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c23b24ee6ac8bb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d65210700 1 -- 172.21.15.167:0/3540630442 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d60006320 con 0x55a55ea21ba0 2023-10-05T19:50:39.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d65210700 1 -- 172.21.15.167:0/3540630442 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d60013420 con 0x55a55ea21ba0 2023-10-05T19:50:39.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d65210700 1 -- 172.21.15.167:0/3540630442 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d600135d0 con 0x55a55ea21ba0 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3540630442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 msgr2=0x55a55ea40a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/3540630442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea40a00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5d60001630 tx=0x7f5d600069b0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3540630442 shutdown_connections 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/3540630442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea40a00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3540630442 >> 172.21.15.167:0/3540630442 conn(0x55a55e995550 msgr2=0x55a55ea3c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3540630442 shutdown_connections 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3540630442 wait complete. 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 Processor -- start 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 -- start start 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a55e8c0ed0 con 0x55a55ea21ba0 2023-10-05T19:50:39.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d67214700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d67214700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45648/0 (socket says 172.21.15.167:45648) 2023-10-05T19:50:39.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 learned_addr learned my addr 172.21.15.167:0/2471106631 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d60006c90 con 0x55a55ea21ba0 2023-10-05T19:50:39.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d67214700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea477e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5d60001330 tx=0x7f5d60014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d5f7fe700 1 -- 172.21.15.167:0/2471106631 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d60013590 con 0x55a55ea21ba0 2023-10-05T19:50:39.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d5f7fe700 1 -- 172.21.15.167:0/2471106631 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d60006320 con 0x55a55ea21ba0 2023-10-05T19:50:39.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d5f7fe700 1 -- 172.21.15.167:0/2471106631 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d60004d20 con 0x55a55ea21ba0 2023-10-05T19:50:39.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a55ea47d20 con 0x55a55ea21ba0 2023-10-05T19:50:39.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.324+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a55ea48160 con 0x55a55ea21ba0 2023-10-05T19:50:39.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d5f7fe700 1 -- 172.21.15.167:0/2471106631 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5d60028460 con 0x55a55ea21ba0 2023-10-05T19:50:39.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d5f7fe700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5d48030c00 0x7f5d480330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d5f7fe700 1 -- 172.21.15.167:0/2471106631 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f5d60045410 con 0x55a55ea21ba0 2023-10-05T19:50:39.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d66a13700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5d48030c00 0x7f5d480330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a55ea26120 0x55a55ea53220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea53950 con 0x55a55ea26120 2023-10-05T19:50:39.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d67a15700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a55ea26120 0x55a55ea53220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d66a13700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5d48030c00 0x7f5d480330b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d500030a0 tx=0x7f5d50015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.328+0000 7f5d67a15700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a55ea26120 0x55a55ea53220 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d5800a500 con 0x55a55ea26120 2023-10-05T19:50:39.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 realm 2023-10-05T19:50:39.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea507c0 con 0x55a55ea26120 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d5800a500 con 0x55a55ea26120 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea54430 con 0x55a55ea26120 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d5800a500 con 0x55a55ea26120 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a55ea54060 0x55a55ea57240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea57970 con 0x55a55ea54060 2023-10-05T19:50:39.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d67214700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a55ea54060 0x55a55ea57240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d67214700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a55ea54060 0x55a55ea57240 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea58210 con 0x55a55ea26120 2023-10-05T19:50:39.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5d5800a500 con 0x55a55ea26120 2023-10-05T19:50:39.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:39.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 20 searching for the correct realm 2023-10-05T19:50:39.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a55ea59fd0 0x55a55ea5c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.332+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea59fd0 2023-10-05T19:50:39.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d66a13700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a55ea59fd0 0x55a55ea5c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d66a13700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a55ea59fd0 0x55a55ea5c3b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea54060 2023-10-05T19:50:39.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d67214700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5d600123c0 0x7f5d60042440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x7f5d600123c0 2023-10-05T19:50:39.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d67a15700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5d600123c0 0x7f5d60042440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d67a15700 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5d600123c0 0x7f5d60042440 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x7f5d600123c0 2023-10-05T19:50:39.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.336+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea59fd0 2023-10-05T19:50:39.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea54060 2023-10-05T19:50:39.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea54060 2023-10-05T19:50:39.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x7f5d600123c0 2023-10-05T19:50:39.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x7f5d600123c0 2023-10-05T19:50:39.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.340+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x7f5d600123c0 2023-10-05T19:50:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x7f5d600123c0 2023-10-05T19:50:39.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea54060 2023-10-05T19:50:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea59fd0 2023-10-05T19:50:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea54060 2023-10-05T19:50:39.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea59fd0 2023-10-05T19:50:39.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.344+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea59fd0 2023-10-05T19:50:39.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x7f5d600123c0 2023-10-05T19:50:39.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x7f5d600123c0 2023-10-05T19:50:39.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea26120 2023-10-05T19:50:39.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x7f5d600123c0 2023-10-05T19:50:39.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x7f5d600123c0 2023-10-05T19:50:39.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea59fd0 2023-10-05T19:50:39.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x7f5d600123c0 2023-10-05T19:50:39.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x7f5d600123c0 2023-10-05T19:50:39.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.348+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea54060 2023-10-05T19:50:39.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea54060 2023-10-05T19:50:39.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea59fd0 2023-10-05T19:50:39.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea54060 2023-10-05T19:50:39.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5c9c0 con 0x55a55ea54060 2023-10-05T19:50:39.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d696dfe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:39.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d696dfe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:39.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d696dfe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:39.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d696dfe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:39.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.352+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea58d50 con 0x55a55ea26120 2023-10-05T19:50:39.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea58950 con 0x55a55ea54060 2023-10-05T19:50:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5ce30 con 0x55a55ea54060 2023-10-05T19:50:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d1e0 con 0x55a55ea59fd0 2023-10-05T19:50:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.356+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d9a0 con 0x55a55ea54060 2023-10-05T19:50:39.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5ede0 con 0x55a55ea59fd0 2023-10-05T19:50:39.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5ede0 con 0x55a55ea54060 2023-10-05T19:50:39.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5ede0 con 0x7f5d600123c0 2023-10-05T19:50:39.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x7f5d600123c0 2023-10-05T19:50:39.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea59fd0 2023-10-05T19:50:39.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.360+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea54060 2023-10-05T19:50:39.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea54060 2023-10-05T19:50:39.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x7f5d600123c0 2023-10-05T19:50:39.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x7f5d600123c0 2023-10-05T19:50:39.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.364+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x7f5d600123c0 2023-10-05T19:50:39.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x7f5d600123c0 2023-10-05T19:50:39.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea54060 2023-10-05T19:50:39.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea59fd0 2023-10-05T19:50:39.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea54060 2023-10-05T19:50:39.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.368+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea59fd0 2023-10-05T19:50:39.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58014040 con 0x55a55ea26120 2023-10-05T19:50:39.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea59fd0 2023-10-05T19:50:39.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x7f5d600123c0 2023-10-05T19:50:39.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea26120 2023-10-05T19:50:39.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.372+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x7f5d600123c0 2023-10-05T19:50:39.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea59fd0 2023-10-05T19:50:39.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x7f5d600123c0 2023-10-05T19:50:39.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea54060 2023-10-05T19:50:39.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea54060 2023-10-05T19:50:39.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea59fd0 2023-10-05T19:50:39.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.376+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea54060 2023-10-05T19:50:39.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5d590 con 0x55a55ea54060 2023-10-05T19:50:39.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:39.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:39.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:39.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:39.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5ddd0 con 0x55a55ea54060 2023-10-05T19:50:39.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5e1d0 con 0x55a55ea26120 2023-10-05T19:50:39.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:39.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.380+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5eac0 con 0x55a55ea54060 2023-10-05T19:50:39.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5eac0 con 0x55a55ea54060 2023-10-05T19:50:39.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:39.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5eac0 con 0x7f5d600123c0 2023-10-05T19:50:39.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 zone default found 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 4 Realm: () 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 zonegroup default 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5eac0 con 0x7f5d600123c0 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea5eac0 con 0x55a55ea59fd0 2023-10-05T19:50:39.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea60b60 con 0x55a55ea59fd0 2023-10-05T19:50:39.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.384+0000 7f5d696dfe40 20 started sync module instance, tier type = 2023-10-05T19:50:39.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.388+0000 7f5d696dfe40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:39.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.388+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea60220 con 0x55a55ea54060 2023-10-05T19:50:39.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.388+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.388+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94168745895376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea60220 con 0x55a55ea54060 2023-10-05T19:50:39.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.388+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea61400 con 0x55a55ea26120 2023-10-05T19:50:39.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.392+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.392+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94168745905936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea61850 con 0x55a55ea26120 2023-10-05T19:50:39.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.392+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea62130 con 0x55a55ea54060 2023-10-05T19:50:39.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.392+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94168745895376] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.392+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94168745905936] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.392+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.392+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94168745903568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea61850 con 0x55a55ea54060 2023-10-05T19:50:39.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.392+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea62a20 con 0x7f5d600123c0 2023-10-05T19:50:39.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.396+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94168745903568] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.396+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.396+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94168745907040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea617b0 con 0x7f5d600123c0 2023-10-05T19:50:39.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.396+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea62f10 con 0x55a55ea54060 2023-10-05T19:50:39.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.396+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94168745907040] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.396+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.396+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94168745911232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea62d00 con 0x55a55ea54060 2023-10-05T19:50:39.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.396+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea63710 con 0x55a55ea59fd0 2023-10-05T19:50:39.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.400+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.400+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94168745914912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea64000 con 0x55a55ea59fd0 2023-10-05T19:50:39.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.400+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea64a80 con 0x55a55ea59fd0 2023-10-05T19:50:39.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.400+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94168745911232] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.400+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94168745914912] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.400+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.400+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94168745912336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea64e80 con 0x55a55ea59fd0 2023-10-05T19:50:39.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.400+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea65720 con 0x7f5d600123c0 2023-10-05T19:50:39.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94168745912336] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d50012450 con 0x55a55ea59fd0 2023-10-05T19:50:39.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94168745923120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea65b70 con 0x7f5d600123c0 2023-10-05T19:50:39.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 add_watcher() i=0 2023-10-05T19:50:39.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 add_watcher() i=1 2023-10-05T19:50:39.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 add_watcher() i=2 2023-10-05T19:50:39.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 add_watcher() i=3 2023-10-05T19:50:39.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 add_watcher() i=4 2023-10-05T19:50:39.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 add_watcher() i=5 2023-10-05T19:50:39.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 add_watcher() i=6 2023-10-05T19:50:39.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94168745923120] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 add_watcher() i=7 2023-10-05T19:50:39.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:39.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea68bd0 con 0x55a55ea26120 2023-10-05T19:50:39.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94168745924224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea65fc0 con 0x55a55ea26120 2023-10-05T19:50:39.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94168745924224] v30'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d38fe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:39.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:39.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.404+0000 7f5d696dfe40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:39.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 Processor -- start 2023-10-05T19:50:39.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 -- start start 2023-10-05T19:50:39.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea73810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a55ea73d50 con 0x55a55ea73440 2023-10-05T19:50:39.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d66a13700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea73810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d66a13700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea73810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45664/0 (socket says 172.21.15.167:45664) 2023-10-05T19:50:39.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d66a13700 1 -- 172.21.15.167:0/1778593457 learned_addr learned my addr 172.21.15.167:0/1778593457 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d66a13700 1 -- 172.21.15.167:0/1778593457 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a55ea73e90 con 0x55a55ea73440 2023-10-05T19:50:39.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d66a13700 1 --2- 172.21.15.167:0/1778593457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea73810 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5d50002000 tx=0x7f5d50012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59db778dc79f9bd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5cb3fff700 1 -- 172.21.15.167:0/1778593457 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d5002d040 con 0x55a55ea73440 2023-10-05T19:50:39.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5cb3fff700 1 -- 172.21.15.167:0/1778593457 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d50028890 con 0x55a55ea73440 2023-10-05T19:50:39.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5cb3fff700 1 -- 172.21.15.167:0/1778593457 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d50028a40 con 0x55a55ea73440 2023-10-05T19:50:39.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 -- 172.21.15.167:0/1778593457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 msgr2=0x55a55ea73810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/1778593457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea73810 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5d50002000 tx=0x7f5d50012000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 -- 172.21.15.167:0/1778593457 shutdown_connections 2023-10-05T19:50:39.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/1778593457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea73810 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 -- 172.21.15.167:0/1778593457 >> 172.21.15.167:0/1778593457 conn(0x55a55ea6e800 msgr2=0x55a55ea6c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 -- 172.21.15.167:0/1778593457 shutdown_connections 2023-10-05T19:50:39.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 -- 172.21.15.167:0/1778593457 wait complete. 2023-10-05T19:50:39.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 Processor -- start 2023-10-05T19:50:39.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.408+0000 7f5d696dfe40 1 -- start start 2023-10-05T19:50:39.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d696dfe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea78f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d696dfe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a55ea79f30 con 0x55a55ea73440 2023-10-05T19:50:39.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d66a13700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea78f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d66a13700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea78f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45666/0 (socket says 172.21.15.167:45666) 2023-10-05T19:50:39.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d66a13700 1 -- 172.21.15.167:0/3429168567 learned_addr learned my addr 172.21.15.167:0/3429168567 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d66a13700 1 -- 172.21.15.167:0/3429168567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a55ea227b0 con 0x55a55ea73440 2023-10-05T19:50:39.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d66a13700 1 --2- 172.21.15.167:0/3429168567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea78f30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55a55ea6d4c0 tx=0x7f5d5002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5cb27fc700 1 -- 172.21.15.167:0/3429168567 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d50009640 con 0x55a55ea73440 2023-10-05T19:50:39.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5cb27fc700 1 -- 172.21.15.167:0/3429168567 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d500097e0 con 0x55a55ea73440 2023-10-05T19:50:39.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3429168567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a55ea79530 con 0x55a55ea73440 2023-10-05T19:50:39.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5cb27fc700 1 -- 172.21.15.167:0/3429168567 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d50009990 con 0x55a55ea73440 2023-10-05T19:50:39.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3429168567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a55ea799d0 con 0x55a55ea73440 2023-10-05T19:50:39.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5cb27fc700 1 -- 172.21.15.167:0/3429168567 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5d50009af0 con 0x55a55ea73440 2023-10-05T19:50:39.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5cb27fc700 1 --2- 172.21.15.167:0/3429168567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5ca8030c50 0x7f5ca8033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5cb27fc700 1 -- 172.21.15.167:0/3429168567 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f5d50046c20 con 0x55a55ea73440 2023-10-05T19:50:39.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d67a15700 1 --2- 172.21.15.167:0/3429168567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5ca8030c50 0x7f5ca8033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.412+0000 7f5d696dfe40 5 note: GC not initialized 2023-10-05T19:50:39.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d67a15700 1 --2- 172.21.15.167:0/3429168567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5ca8030c50 0x7f5ca8033100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55a55ea68ca0 tx=0x7f5d5800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5ca77fe700 20 reqs_thread_entry: start 2023-10-05T19:50:39.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:39.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5ca57fa700 20 reqs_thread_entry: start 2023-10-05T19:50:39.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:39.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 20 get_system_obj_state: rctx=0x7fff61197e08 obj=default.rgw.meta:users.uid:fud state=0x55a55e8f90b0 s->prefetch_data=0 2023-10-05T19:50:39.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T19:50:39.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae16c0 con 0x7f5d600123c0 2023-10-05T19:50:39.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5c92ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:39.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5c937fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:09 2023 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.416+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae4150 con 0x7f5d600123c0 2023-10-05T19:50:39.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T19:50:39.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 get_system_obj_state: rctx=0x7fff61197e50 obj=default.rgw.meta:root:myfoo state=0x55a55e8f90b0 s->prefetch_data=0 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae3960 con 0x7f5d600123c0 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae5b50 con 0x7f5d600123c0 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 get_system_obj_state: rctx=0x7fff61197e50 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x55a55e8cf2b0 s->prefetch_data=0 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : miss 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae4e60 con 0x55a55ea26120 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(106 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x16 2023-10-05T19:50:39.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:39.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:39.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:39.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:39.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:39.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae7bc0 con 0x55a55ea26120 2023-10-05T19:50:39.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(107 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:39.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x13 2023-10-05T19:50:39.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:39.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:39.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 20 get_system_obj_state: rctx=0x7fff61197de8 obj=default.rgw.meta:users.uid:fud state=0x55a55e8cf2b0 s->prefetch_data=0 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x16, cached=0x13) 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.420+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae7900 con 0x7f5d600123c0 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(108 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x17) 2023-10-05T19:50:39.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae7900 con 0x55a55ea26120 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(109 fud.buckets [call] v30'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 20 get_system_obj_state: rctx=0x7fff61197f28 obj=default.rgw.meta:root:myfoo state=0x55a55e8cf2b0 s->prefetch_data=0 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x16, cached=0x13) 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae7900 con 0x7f5d600123c0 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(110 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x13, cached=0x17) 2023-10-05T19:50:39.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.424+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eaec710 con 0x7f5d600123c0 2023-10-05T19:50:39.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(111 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d696dfe40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-10-05T19:50:39.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d696dfe40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:39.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d696dfe40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T19:50:39.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94168746459616 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55eae9df0 con 0x55a55ea59fd0 2023-10-05T19:50:39.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== watch-notify(notify (1) cookie 94168745912336 notify 128849018884 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x55a55ea799d0 con 0x55a55ea59fd0 2023-10-05T19:50:39.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d64a0f700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94168745912336 notifier 4475 bl.length()=338 2023-10-05T19:50:39.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d64a0f700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-10-05T19:50:39.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d64a0f700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:39.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d64a0f700 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d4c003d90 con 0x55a55ea59fd0 2023-10-05T19:50:39.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(112 notify.6 [notify cookie 94168746459616 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5d50039020 con 0x55a55ea59fd0 2023-10-05T19:50:39.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== watch-notify(notify_complete (2) cookie 94168746459616 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a55ea79530 con 0x55a55ea59fd0 2023-10-05T19:50:39.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(113 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d50039020 con 0x55a55ea59fd0 2023-10-05T19:50:39.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.428+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94168745895376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea372e0 con 0x55a55ea54060 2023-10-05T19:50:39.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.432+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94168745895376] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.432+0000 7f5d696dfe40 20 remove_watcher() i=0 2023-10-05T19:50:39.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.432+0000 7f5d696dfe40 2 removed watcher, disabling cache 2023-10-05T19:50:39.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.432+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94168745905936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea372e0 con 0x55a55ea26120 2023-10-05T19:50:39.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.432+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94168745905936] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.432+0000 7f5d696dfe40 20 remove_watcher() i=1 2023-10-05T19:50:39.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.432+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94168745903568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea372e0 con 0x55a55ea54060 2023-10-05T19:50:39.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.436+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94168745903568] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.436+0000 7f5d696dfe40 20 remove_watcher() i=2 2023-10-05T19:50:39.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.436+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94168745907040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea372e0 con 0x7f5d600123c0 2023-10-05T19:50:39.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.436+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94168745907040] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.436+0000 7f5d696dfe40 20 remove_watcher() i=3 2023-10-05T19:50:39.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.436+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94168745911232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea372e0 con 0x55a55ea54060 2023-10-05T19:50:39.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.440+0000 7f5d67214700 1 -- 172.21.15.167:0/2471106631 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94168745911232] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d60024020 con 0x55a55ea54060 2023-10-05T19:50:39.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.440+0000 7f5d696dfe40 20 remove_watcher() i=4 2023-10-05T19:50:39.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.440+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94168745914912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea372e0 con 0x55a55ea59fd0 2023-10-05T19:50:39.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.440+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94168745914912] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d50039020 con 0x55a55ea59fd0 2023-10-05T19:50:39.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.440+0000 7f5d696dfe40 20 remove_watcher() i=5 2023-10-05T19:50:39.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.440+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94168745912336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea372e0 con 0x55a55ea59fd0 2023-10-05T19:50:39.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.444+0000 7f5d66a13700 1 -- 172.21.15.167:0/2471106631 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94168745912336] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d50039020 con 0x55a55ea59fd0 2023-10-05T19:50:39.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.444+0000 7f5d696dfe40 20 remove_watcher() i=6 2023-10-05T19:50:39.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.444+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94168745923120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea372e0 con 0x7f5d600123c0 2023-10-05T19:50:39.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.444+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94168745923120] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x7f5d600123c0 2023-10-05T19:50:39.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.444+0000 7f5d696dfe40 20 remove_watcher() i=7 2023-10-05T19:50:39.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d38fe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:39.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94168745924224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a55ea372e0 con 0x55a55ea26120 2023-10-05T19:50:39.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94168745924224] v30'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5d58033040 con 0x55a55ea26120 2023-10-05T19:50:39.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a55ea54060 msgr2=0x55a55ea57240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a55ea54060 0x55a55ea57240 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a55ea26120 msgr2=0x55a55ea53220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a55ea26120 0x55a55ea53220 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5d600123c0 msgr2=0x7f5d60042440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5d600123c0 0x7f5d60042440 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a55ea59fd0 msgr2=0x55a55ea5c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a55ea59fd0 0x55a55ea5c3b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5d48030c00 msgr2=0x7f5d480330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5d48030c00 0x7f5d480330b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d500030a0 tx=0x7f5d50015000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 msgr2=0x55a55ea477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea477e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5d60001330 tx=0x7f5d60014000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d67a15700 1 -- 172.21.15.167:0/2471106631 reap_dead start 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 shutdown_connections 2023-10-05T19:50:39.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/2471106631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea21ba0 0x55a55ea477e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 >> 172.21.15.167:0/2471106631 conn(0x55a55e995550 msgr2=0x55a55ea3b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 shutdown_connections 2023-10-05T19:50:39.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.448+0000 7f5d696dfe40 1 -- 172.21.15.167:0/2471106631 wait complete. 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3429168567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5ca8030c50 msgr2=0x7f5ca8033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/3429168567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5ca8030c50 0x7f5ca8033100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55a55ea68ca0 tx=0x7f5d5800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3429168567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 msgr2=0x55a55ea78f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/3429168567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea78f30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55a55ea6d4c0 tx=0x7f5d5002c000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3429168567 shutdown_connections 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/3429168567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5ca8030c50 0x7f5ca8033100 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 --2- 172.21.15.167:0/3429168567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a55ea73440 0x55a55ea78f30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3429168567 >> 172.21.15.167:0/3429168567 conn(0x55a55ea6e800 msgr2=0x55a55ea6c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3429168567 shutdown_connections 2023-10-05T19:50:39.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.452+0000 7f5d696dfe40 1 -- 172.21.15.167:0/3429168567 wait complete. 2023-10-05T19:50:39.464 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1'] 2023-10-05T19:50:39.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1'] 2023-10-05T19:50:39.464 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:39.507 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:39.507 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:39.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4256cc9e40 1 Processor -- start 2023-10-05T19:50:39.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4256cc9e40 1 -- start start 2023-10-05T19:50:39.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4256cc9e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ff35570200 0x55ff356049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4256cc9e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ff35548bd0 con 0x55ff35571510 2023-10-05T19:50:39.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4256cc9e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ff35505ee0 con 0x55ff35570200 2023-10-05T19:50:39.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4253ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ff35570200 0x55ff356049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4253ffd700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55ff35570200 0x55ff356049f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45670/0 (socket says 172.21.15.167:45670) 2023-10-05T19:50:39.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4253ffd700 1 -- 172.21.15.167:0/210834807 learned_addr learned my addr 172.21.15.167:0/210834807 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f42547fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55ff35571510 0x55ff3556faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51720/0 (socket says 172.21.15.167:51720) 2023-10-05T19:50:39.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4253ffd700 1 -- 172.21.15.167:0/210834807 >> v1:172.21.15.118:6789/0 conn(0x55ff35571510 legacy=0x55ff3556faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f42537fc700 1 -- 172.21.15.167:0/210834807 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705455746 0 0) 0x55ff35548bd0 con 0x55ff35571510 2023-10-05T19:50:39.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.500+0000 7f4253ffd700 1 -- 172.21.15.167:0/210834807 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff355719a0 con 0x55ff35570200 2023-10-05T19:50:39.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4253ffd700 1 --2- 172.21.15.167:0/210834807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff356049f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f423c00a650 tx=0x7f423c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a77a515a010b9a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f42537fc700 1 -- 172.21.15.167:0/210834807 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f423c008760 con 0x55ff35570200 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f42537fc700 1 -- 172.21.15.167:0/210834807 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c0088c0 con 0x55ff35570200 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f42537fc700 1 -- 172.21.15.167:0/210834807 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f423c008bb0 con 0x55ff35570200 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 -- 172.21.15.167:0/210834807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 msgr2=0x55ff356049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/210834807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff356049f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f423c00a650 tx=0x7f423c005b10 comp rx=0 tx=0).stop 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 -- 172.21.15.167:0/210834807 shutdown_connections 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/210834807 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff356049f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 -- 172.21.15.167:0/210834807 >> 172.21.15.167:0/210834807 conn(0x55ff355f72e0 msgr2=0x55ff355f96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 -- 172.21.15.167:0/210834807 shutdown_connections 2023-10-05T19:50:39.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 -- 172.21.15.167:0/210834807 wait complete. 2023-10-05T19:50:39.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 Processor -- start 2023-10-05T19:50:39.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 -- start start 2023-10-05T19:50:39.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff3561cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f4256cc9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff354c9e30 con 0x55ff35570200 2023-10-05T19:50:39.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f42547fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff3561cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f42547fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff3561cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45676/0 (socket says 172.21.15.167:45676) 2023-10-05T19:50:39.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f42547fe700 1 -- 172.21.15.167:0/1491831422 learned_addr learned my addr 172.21.15.167:0/1491831422 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f42547fe700 1 -- 172.21.15.167:0/1491831422 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c005db0 con 0x55ff35570200 2023-10-05T19:50:39.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.504+0000 7f42547fe700 1 --2- 172.21.15.167:0/1491831422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff3561cb10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f424c001e80 tx=0x7f424c001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83485a17f92fee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f42527fa700 1 -- 172.21.15.167:0/1491831422 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f424c014070 con 0x55ff35570200 2023-10-05T19:50:39.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f42527fa700 1 -- 172.21.15.167:0/1491831422 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c00f450 con 0x55ff35570200 2023-10-05T19:50:39.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f42527fa700 1 -- 172.21.15.167:0/1491831422 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f424c00f740 con 0x55ff35570200 2023-10-05T19:50:39.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1491831422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 msgr2=0x55ff3561cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1491831422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff3561cb10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f424c001e80 tx=0x7f424c001850 comp rx=0 tx=0).stop 2023-10-05T19:50:39.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1491831422 shutdown_connections 2023-10-05T19:50:39.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1491831422 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff3561cb10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1491831422 >> 172.21.15.167:0/1491831422 conn(0x55ff355f72e0 msgr2=0x55ff35618650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1491831422 shutdown_connections 2023-10-05T19:50:39.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1491831422 wait complete. 2023-10-05T19:50:39.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 Processor -- start 2023-10-05T19:50:39.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 -- start start 2023-10-05T19:50:39.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff356238a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f4256cc9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff3549ced0 con 0x55ff35570200 2023-10-05T19:50:39.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f42547fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff356238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f42547fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff356238a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45682/0 (socket says 172.21.15.167:45682) 2023-10-05T19:50:39.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 learned_addr learned my addr 172.21.15.167:0/1556778253 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c001b30 con 0x55ff35570200 2023-10-05T19:50:39.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.508+0000 7f42547fe700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff356238a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f424c0011e0 tx=0x7f424c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4250ff7700 1 -- 172.21.15.167:0/1556778253 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f424c01cb40 con 0x55ff35570200 2023-10-05T19:50:39.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4250ff7700 1 -- 172.21.15.167:0/1556778253 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c01cce0 con 0x55ff35570200 2023-10-05T19:50:39.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff35623de0 con 0x55ff35570200 2023-10-05T19:50:39.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4250ff7700 1 -- 172.21.15.167:0/1556778253 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f424c01ce90 con 0x55ff35570200 2023-10-05T19:50:39.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff35624220 con 0x55ff35570200 2023-10-05T19:50:39.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4250ff7700 1 -- 172.21.15.167:0/1556778253 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f424c023020 con 0x55ff35570200 2023-10-05T19:50:39.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4250ff7700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4234030c50 0x7f4234033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4250ff7700 1 -- 172.21.15.167:0/1556778253 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f424c008030 con 0x55ff35570200 2023-10-05T19:50:39.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4253ffd700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4234030c50 0x7f4234033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ff35571510 0x55ff3562f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3562fa60 con 0x55ff35571510 2023-10-05T19:50:39.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4254fff700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ff35571510 0x55ff3562f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.512+0000 7f4253ffd700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4234030c50 0x7f4234033100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f423c0030a0 tx=0x7f423c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4254fff700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ff35571510 0x55ff3562f360 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 20 realm 2023-10-05T19:50:39.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3562c980 con 0x55ff35571510 2023-10-05T19:50:39.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35630540 con 0x55ff35571510 2023-10-05T19:50:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ff35630170 0x55ff35633350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35633a80 con 0x55ff35630170 2023-10-05T19:50:39.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f42547fe700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ff35630170 0x55ff35633350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f42547fe700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ff35630170 0x55ff35633350 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f424c016070 con 0x55ff35630170 2023-10-05T19:50:39.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.516+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35634320 con 0x55ff35571510 2023-10-05T19:50:39.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:39.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4256cc9e40 20 searching for the correct realm 2023-10-05T19:50:39.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ff356360e0 0x55ff356384c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff356360e0 2023-10-05T19:50:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4253ffd700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ff356360e0 0x55ff356384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4253ffd700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ff356360e0 0x55ff356384c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35630170 2023-10-05T19:50:39.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c016070 con 0x55ff35630170 2023-10-05T19:50:39.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f42547fe700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f424c01a070 0x7f424c018980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x7f424c01a070 2023-10-05T19:50:39.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4254fff700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f424c01a070 0x7f424c018980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4254fff700 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f424c01a070 0x7f424c018980 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.520+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff356360e0 2023-10-05T19:50:39.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35630170 2023-10-05T19:50:39.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c016070 con 0x55ff35630170 2023-10-05T19:50:39.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35630170 2023-10-05T19:50:39.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c016070 con 0x55ff35630170 2023-10-05T19:50:39.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.524+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x7f424c01a070 2023-10-05T19:50:39.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x7f424c01a070 2023-10-05T19:50:39.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35630170 2023-10-05T19:50:39.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c016070 con 0x55ff35630170 2023-10-05T19:50:39.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff356360e0 2023-10-05T19:50:39.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.528+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35630170 2023-10-05T19:50:39.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c039040 con 0x55ff35630170 2023-10-05T19:50:39.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff356360e0 2023-10-05T19:50:39.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff356360e0 2023-10-05T19:50:39.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x7f424c01a070 2023-10-05T19:50:39.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.532+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35571510 2023-10-05T19:50:39.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x7f424c01a070 2023-10-05T19:50:39.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff356360e0 2023-10-05T19:50:39.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x7f424c01a070 2023-10-05T19:50:39.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35630170 2023-10-05T19:50:39.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c039040 con 0x55ff35630170 2023-10-05T19:50:39.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35630170 2023-10-05T19:50:39.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c039040 con 0x55ff35630170 2023-10-05T19:50:39.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.536+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff356360e0 2023-10-05T19:50:39.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35630170 2023-10-05T19:50:39.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f424c039040 con 0x55ff35630170 2023-10-05T19:50:39.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638ad0 con 0x55ff35630170 2023-10-05T19:50:39.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c039040 con 0x55ff35630170 2023-10-05T19:50:39.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:39.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:39.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:39.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:39.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35634e90 con 0x55ff35571510 2023-10-05T19:50:39.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356357e0 con 0x55ff35630170 2023-10-05T19:50:39.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f424c039040 con 0x55ff35630170 2023-10-05T19:50:39.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.540+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35638f40 con 0x55ff35630170 2023-10-05T19:50:39.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:39.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356392f0 con 0x55ff356360e0 2023-10-05T19:50:39.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356396a0 con 0x55ff35571510 2023-10-05T19:50:39.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35635380 con 0x55ff35630170 2023-10-05T19:50:39.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff356360e0 2023-10-05T19:50:39.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35630170 2023-10-05T19:50:39.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.544+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x7f424c01a070 2023-10-05T19:50:39.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff356360e0 2023-10-05T19:50:39.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35630170 2023-10-05T19:50:39.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.548+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35630170 2023-10-05T19:50:39.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x7f424c01a070 2023-10-05T19:50:39.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x7f424c01a070 2023-10-05T19:50:39.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35630170 2023-10-05T19:50:39.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.552+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff356360e0 2023-10-05T19:50:39.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35630170 2023-10-05T19:50:39.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff356360e0 2023-10-05T19:50:39.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.556+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff356360e0 2023-10-05T19:50:39.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x7f424c01a070 2023-10-05T19:50:39.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35571510 2023-10-05T19:50:39.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x7f424c01a070 2023-10-05T19:50:39.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff356360e0 2023-10-05T19:50:39.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.560+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x7f424c01a070 2023-10-05T19:50:39.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35630170 2023-10-05T19:50:39.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35630170 2023-10-05T19:50:39.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff356360e0 2023-10-05T19:50:39.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35630170 2023-10-05T19:50:39.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563afa0 con 0x55ff35630170 2023-10-05T19:50:39.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4256cc9e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:39.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4256cc9e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:39.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4256cc9e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:39.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4256cc9e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:39.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.564+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35639f90 con 0x55ff35630170 2023-10-05T19:50:39.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35639f90 con 0x55ff35571510 2023-10-05T19:50:39.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:39.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563a880 con 0x55ff35630170 2023-10-05T19:50:39.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563a880 con 0x55ff35630170 2023-10-05T19:50:39.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:39.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.568+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563a880 con 0x7f424c01a070 2023-10-05T19:50:39.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 zone default found 2023-10-05T19:50:39.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 4 Realm: () 2023-10-05T19:50:39.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 zonegroup default 2023-10-05T19:50:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563a880 con 0x7f424c01a070 2023-10-05T19:50:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563a880 con 0x55ff356360e0 2023-10-05T19:50:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563ccd0 con 0x55ff356360e0 2023-10-05T19:50:39.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 started sync module instance, tier type = 2023-10-05T19:50:39.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:39.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.572+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563c390 con 0x55ff35630170 2023-10-05T19:50:39.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.576+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.576+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94554600743824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563c390 con 0x55ff35630170 2023-10-05T19:50:39.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.576+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563d570 con 0x55ff35571510 2023-10-05T19:50:39.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.576+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.576+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94554600755328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563d9c0 con 0x55ff35571510 2023-10-05T19:50:39.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.576+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94554600743824] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.576+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563c790 con 0x55ff35630170 2023-10-05T19:50:39.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.580+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94554600755328] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.580+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.580+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94554600752912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563d9c0 con 0x55ff35630170 2023-10-05T19:50:39.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.580+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563e580 con 0x7f424c01a070 2023-10-05T19:50:39.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.580+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.580+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94554600759376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563d9c0 con 0x7f424c01a070 2023-10-05T19:50:39.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.580+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563f4d0 con 0x55ff35630170 2023-10-05T19:50:39.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.580+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94554600752912] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.584+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94554600759376] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.584+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.584+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94554600756432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563d920 con 0x55ff35630170 2023-10-05T19:50:39.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.584+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563f9c0 con 0x55ff356360e0 2023-10-05T19:50:39.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.584+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.584+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94554600756432] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.584+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94554600764624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35640260 con 0x55ff356360e0 2023-10-05T19:50:39.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.584+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35640610 con 0x55ff356360e0 2023-10-05T19:50:39.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.588+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94554600764624] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.588+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.588+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94554600766832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35640eb0 con 0x55ff356360e0 2023-10-05T19:50:39.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.588+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35641750 con 0x7f424c01a070 2023-10-05T19:50:39.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.588+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94554600766832] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f423c012450 con 0x55ff356360e0 2023-10-05T19:50:39.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.588+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.588+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94554600772192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35641ba0 con 0x7f424c01a070 2023-10-05T19:50:39.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 add_watcher() i=0 2023-10-05T19:50:39.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 add_watcher() i=1 2023-10-05T19:50:39.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 add_watcher() i=2 2023-10-05T19:50:39.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 add_watcher() i=3 2023-10-05T19:50:39.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 add_watcher() i=4 2023-10-05T19:50:39.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 add_watcher() i=5 2023-10-05T19:50:39.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 add_watcher() i=6 2023-10-05T19:50:39.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94554600772192] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 add_watcher() i=7 2023-10-05T19:50:39.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:39.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35644c10 con 0x55ff35571510 2023-10-05T19:50:39.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94554600773296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff35642200 con 0x55ff35571510 2023-10-05T19:50:39.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94554600773296] v30'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4225fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:39.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:39.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:39.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 1 Processor -- start 2023-10-05T19:50:39.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.592+0000 7f4256cc9e40 1 -- start start 2023-10-05T19:50:39.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff3564f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff3564fd10 con 0x55ff3564f400 2023-10-05T19:50:39.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4253ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff3564f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4253ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff3564f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45698/0 (socket says 172.21.15.167:45698) 2023-10-05T19:50:39.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4253ffd700 1 -- 172.21.15.167:0/2410860662 learned_addr learned my addr 172.21.15.167:0/2410860662 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4253ffd700 1 -- 172.21.15.167:0/2410860662 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff3564fe50 con 0x55ff3564f400 2023-10-05T19:50:39.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4253ffd700 1 --2- 172.21.15.167:0/2410860662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff3564f7d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f423c002000 tx=0x7f423c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f65dd9e73daefa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f42257e2700 1 -- 172.21.15.167:0/2410860662 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f423c02d040 con 0x55ff3564f400 2023-10-05T19:50:39.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f42257e2700 1 -- 172.21.15.167:0/2410860662 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c028890 con 0x55ff3564f400 2023-10-05T19:50:39.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f42257e2700 1 -- 172.21.15.167:0/2410860662 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f423c028a60 con 0x55ff3564f400 2023-10-05T19:50:39.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 -- 172.21.15.167:0/2410860662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 msgr2=0x55ff3564f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/2410860662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff3564f7d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f423c002000 tx=0x7f423c012000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 -- 172.21.15.167:0/2410860662 shutdown_connections 2023-10-05T19:50:39.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/2410860662 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff3564f7d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 -- 172.21.15.167:0/2410860662 >> 172.21.15.167:0/2410860662 conn(0x55ff3564a7c0 msgr2=0x55ff35648910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 -- 172.21.15.167:0/2410860662 shutdown_connections 2023-10-05T19:50:39.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 -- 172.21.15.167:0/2410860662 wait complete. 2023-10-05T19:50:39.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 Processor -- start 2023-10-05T19:50:39.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 -- start start 2023-10-05T19:50:39.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff35654ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4256cc9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff35655ef0 con 0x55ff3564f400 2023-10-05T19:50:39.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4253ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff35654ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4253ffd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff35654ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45710/0 (socket says 172.21.15.167:45710) 2023-10-05T19:50:39.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.596+0000 7f4253ffd700 1 -- 172.21.15.167:0/1646326366 learned_addr learned my addr 172.21.15.167:0/1646326366 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f4253ffd700 1 -- 172.21.15.167:0/1646326366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff355719a0 con 0x55ff3564f400 2023-10-05T19:50:39.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f4253ffd700 1 --2- 172.21.15.167:0/1646326366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff35654ef0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55ff35649480 tx=0x7f423c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f419f7fe700 1 -- 172.21.15.167:0/1646326366 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f423c009640 con 0x55ff3564f400 2023-10-05T19:50:39.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1646326366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ff356554f0 con 0x55ff3564f400 2023-10-05T19:50:39.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f419f7fe700 1 -- 172.21.15.167:0/1646326366 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c0097a0 con 0x55ff3564f400 2023-10-05T19:50:39.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f419f7fe700 1 -- 172.21.15.167:0/1646326366 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f423c009950 con 0x55ff3564f400 2023-10-05T19:50:39.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1646326366 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff35655990 con 0x55ff3564f400 2023-10-05T19:50:39.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f419f7fe700 1 -- 172.21.15.167:0/1646326366 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f423c009bc0 con 0x55ff3564f400 2023-10-05T19:50:39.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f419f7fe700 1 --2- 172.21.15.167:0/1646326366 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4194030c00 0x7f41940330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f419f7fe700 1 -- 172.21.15.167:0/1646326366 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f423c046c20 con 0x55ff3564f400 2023-10-05T19:50:39.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f4256cc9e40 5 note: GC not initialized 2023-10-05T19:50:39.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f4254fff700 1 --2- 172.21.15.167:0/1646326366 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4194030c00 0x7f41940330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f4254fff700 1 --2- 172.21.15.167:0/1646326366 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4194030c00 0x7f41940330b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ff35642160 tx=0x7f424400d630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.600+0000 7f419cff9700 20 reqs_thread_entry: start 2023-10-05T19:50:39.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f41927fc700 20 reqs_thread_entry: start 2023-10-05T19:50:39.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:39.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:39.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4190ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:09 2023 2023-10-05T19:50:39.611 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:39.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4177fff700 20 reqs_thread_entry: start 2023-10-05T19:50:39.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 get_system_obj_state: rctx=0x7ffec07d8028 obj=default.rgw.meta:users.uid:foo state=0x55ff354d50b0 s->prefetch_data=0 2023-10-05T19:50:39.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:39.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356bd800 con 0x55ff35571510 2023-10-05T19:50:39.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:39.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:39.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356c0290 con 0x55ff35571510 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 get_system_obj_state: rctx=0x7ffec07d73d0 obj=default.rgw.meta:root:myfoo state=0x55ff354d50b0 s->prefetch_data=0 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:50:39.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356bfaa0 con 0x7f424c01a070 2023-10-05T19:50:39.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv21 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:50:39.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:39.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:50:39.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356c2040 con 0x7f424c01a070 2023-10-05T19:50:39.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 20 get_system_obj_state: rctx=0x7ffec07d73d0 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x55ff354ab2b0 s->prefetch_data=0 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : miss 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.604+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356c1500 con 0x55ff35571510 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x16 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:39.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356c4050 con 0x55ff35571510 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(107 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x13 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 20 get_system_obj_state: rctx=0x7ffec07d7368 obj=default.rgw.meta:users.uid:foo state=0x55ff354ab2b0 s->prefetch_data=0 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x16, cached=0x13) 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356c3d90 con 0x55ff35571510 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(108 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x17) 2023-10-05T19:50:39.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356c5f40 con 0x55ff35571510 2023-10-05T19:50:39.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(109 fud.buckets [call] v30'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.608+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356cc030 con 0x55ff35571510 2023-10-05T19:50:39.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(110 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'4 uv4 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x17 2023-10-05T19:50:39.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:39.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:39.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1, ofs0, ns] 2023-10-05T19:50:39.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [notify cookie 94554601340832 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356caec0 con 0x7f424c01a070 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== watch-notify(notify (1) cookie 94554600772192 notify 128849018890 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f4244047040 con 0x7f424c01a070 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f42527fa700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94554600772192 notifier 4481 bl.length()=725 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f42527fa700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x17 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f42527fa700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f42527fa700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(111 notify.7 [notify cookie 94554601340832 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f42527fa700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4238003d90 con 0x7f424c01a070 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(112 notify.7 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== watch-notify(notify_complete (2) cookie 94554601340832 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f424400deb0 con 0x7f424c01a070 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_sources= new_sources= 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential sources added=[] removed=[] 2023-10-05T19:50:39.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_dests= new_dests= 2023-10-05T19:50:39.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential dests added=[] removed=[] 2023-10-05T19:50:39.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.612+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356ca9d0 con 0x7f424c01a070 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(113 foo.buckets [call] v30'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356ca9d0 con 0x7f424c01a070 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(114 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4256cc9e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4256cc9e40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4256cc9e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94554601298720 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356cb060 con 0x55ff356360e0 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== watch-notify(notify (1) cookie 94554600766832 notify 128849018885 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x55ff35655990 con 0x55ff356360e0 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f42527fa700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94554600766832 notifier 4481 bl.length()=314 2023-10-05T19:50:39.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f42527fa700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T19:50:39.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f42527fa700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:39.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(115 notify.6 [notify cookie 94554601298720 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f423c039020 con 0x55ff356360e0 2023-10-05T19:50:39.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f42527fa700 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4238003d90 con 0x55ff356360e0 2023-10-05T19:50:39.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(116 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f423c039020 con 0x55ff356360e0 2023-10-05T19:50:39.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== watch-notify(notify_complete (2) cookie 94554601298720 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ff356554f0 con 0x55ff356360e0 2023-10-05T19:50:39.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.616+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:117 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94554600743824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356132b0 con 0x55ff35630170 2023-10-05T19:50:39.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.620+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(117 notify.0 [watch unwatch cookie 94554600743824] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.620+0000 7f4256cc9e40 20 remove_watcher() i=0 2023-10-05T19:50:39.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.620+0000 7f4256cc9e40 2 removed watcher, disabling cache 2023-10-05T19:50:39.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.620+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94554600755328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356132b0 con 0x55ff35571510 2023-10-05T19:50:39.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.620+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(118 notify.1 [watch unwatch cookie 94554600755328] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.620+0000 7f4256cc9e40 20 remove_watcher() i=1 2023-10-05T19:50:39.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.620+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94554600752912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356132b0 con 0x55ff35630170 2023-10-05T19:50:39.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.624+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(119 notify.2 [watch unwatch cookie 94554600752912] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.624+0000 7f4256cc9e40 20 remove_watcher() i=2 2023-10-05T19:50:39.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.624+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:120 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94554600759376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563c710 con 0x7f424c01a070 2023-10-05T19:50:39.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.624+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(120 notify.3 [watch unwatch cookie 94554600759376] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.624+0000 7f4256cc9e40 20 remove_watcher() i=3 2023-10-05T19:50:39.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.624+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94554600756432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356132b0 con 0x55ff35630170 2023-10-05T19:50:39.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.628+0000 7f42547fe700 1 -- 172.21.15.167:0/1556778253 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(121 notify.4 [watch unwatch cookie 94554600756432] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424c04b040 con 0x55ff35630170 2023-10-05T19:50:39.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.628+0000 7f4256cc9e40 20 remove_watcher() i=4 2023-10-05T19:50:39.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.628+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:122 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94554600764624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356132b0 con 0x55ff356360e0 2023-10-05T19:50:39.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.628+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(122 notify.5 [watch unwatch cookie 94554600764624] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f423c039020 con 0x55ff356360e0 2023-10-05T19:50:39.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.628+0000 7f4256cc9e40 20 remove_watcher() i=5 2023-10-05T19:50:39.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.628+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:123 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94554600766832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356132b0 con 0x55ff356360e0 2023-10-05T19:50:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.632+0000 7f4253ffd700 1 -- 172.21.15.167:0/1556778253 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(123 notify.6 [watch unwatch cookie 94554600766832] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f423c039020 con 0x55ff356360e0 2023-10-05T19:50:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.632+0000 7f4256cc9e40 20 remove_watcher() i=6 2023-10-05T19:50:39.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.632+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:124 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94554600772192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff3563fd70 con 0x7f424c01a070 2023-10-05T19:50:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.632+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.2 v2:172.21.15.167:6816/26774 28 ==== osd_op_reply(124 notify.7 [watch unwatch cookie 94554600772192] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x7f424c01a070 2023-10-05T19:50:39.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.632+0000 7f4256cc9e40 20 remove_watcher() i=7 2023-10-05T19:50:39.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.632+0000 7f4225fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:39.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.632+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:125 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94554600773296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55ff356132b0 con 0x55ff35571510 2023-10-05T19:50:39.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(125 data_loggenerations_metadata [watch unwatch cookie 94554600773296] v30'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f424400a5a0 con 0x55ff35571510 2023-10-05T19:50:39.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ff35630170 msgr2=0x55ff35633350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55ff35630170 0x55ff35633350 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ff35571510 msgr2=0x55ff3562f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55ff35571510 0x55ff3562f360 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f424c01a070 msgr2=0x7f424c018980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f424c01a070 0x7f424c018980 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ff356360e0 msgr2=0x55ff356384c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55ff356360e0 0x55ff356384c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4234030c50 msgr2=0x7f4234033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4234030c50 0x7f4234033100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f423c0030a0 tx=0x7f423c015000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 msgr2=0x55ff356238a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff356238a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f424c0011e0 tx=0x7f424c016000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4254fff700 1 -- 172.21.15.167:0/1556778253 reap_dead start 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 shutdown_connections 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1556778253 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff35570200 0x55ff356238a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 >> 172.21.15.167:0/1556778253 conn(0x55ff355f72e0 msgr2=0x55ff356170d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 shutdown_connections 2023-10-05T19:50:39.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1556778253 wait complete. 2023-10-05T19:50:39.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1646326366 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4194030c00 msgr2=0x7f41940330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1646326366 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4194030c00 0x7f41940330b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ff35642160 tx=0x7f424400d630 comp rx=0 tx=0).stop 2023-10-05T19:50:39.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1646326366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 msgr2=0x55ff35654ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1646326366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff35654ef0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55ff35649480 tx=0x7f423c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1646326366 shutdown_connections 2023-10-05T19:50:39.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1646326366 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4194030c00 0x7f41940330b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 --2- 172.21.15.167:0/1646326366 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55ff3564f400 0x55ff35654ef0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1646326366 >> 172.21.15.167:0/1646326366 conn(0x55ff3564a7c0 msgr2=0x55ff35648860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1646326366 shutdown_connections 2023-10-05T19:50:39.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.636+0000 7f4256cc9e40 1 -- 172.21.15.167:0/1646326366 wait complete. 2023-10-05T19:50:39.651 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2023-10-05T19:50:39.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2023-10-05T19:50:39.652 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2023-10-05T19:50:39.692 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:39.693 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:39.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.684+0000 7f2194516e40 1 Processor -- start 2023-10-05T19:50:39.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.684+0000 7f2194516e40 1 -- start start 2023-10-05T19:50:39.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.684+0000 7f2194516e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x562c45162b90 0x562c45162f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.684+0000 7f2194516e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562c450adbd0 con 0x562c451634a0 2023-10-05T19:50:39.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.684+0000 7f2194516e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x562c4506aee0 con 0x562c45162b90 2023-10-05T19:50:39.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.684+0000 7f219204b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x562c45162b90 0x562c45162f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f219204b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x562c45162b90 0x562c45162f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45718/0 (socket says 172.21.15.167:45718) 2023-10-05T19:50:39.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f219204b700 1 -- 172.21.15.167:0/1938549287 learned_addr learned my addr 172.21.15.167:0/1938549287 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f219184a700 1 --1- 172.21.15.167:0/1938549287 >> v1:172.21.15.118:6789/0 conn(0x562c451634a0 0x562c45163ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51734/0 (socket says 172.21.15.167:51734) 2023-10-05T19:50:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f219204b700 1 -- 172.21.15.167:0/1938549287 >> v1:172.21.15.118:6789/0 conn(0x562c451634a0 legacy=0x562c45163ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f219204b700 1 -- 172.21.15.167:0/1938549287 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c451645f0 con 0x562c45162b90 2023-10-05T19:50:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f219204b700 1 --2- 172.21.15.167:0/1938549287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45162f60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f218c00a5c0 tx=0x7f218c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe59091b9569cd21 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2191049700 1 -- 172.21.15.167:0/1938549287 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218c00e510 con 0x562c45162b90 2023-10-05T19:50:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2191049700 1 -- 172.21.15.167:0/1938549287 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00e670 con 0x562c45162b90 2023-10-05T19:50:39.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2191049700 1 -- 172.21.15.167:0/1938549287 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218c00e920 con 0x562c45162b90 2023-10-05T19:50:39.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 -- 172.21.15.167:0/1938549287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 msgr2=0x562c45162f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 --2- 172.21.15.167:0/1938549287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45162f60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f218c00a5c0 tx=0x7f218c005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 -- 172.21.15.167:0/1938549287 shutdown_connections 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 --2- 172.21.15.167:0/1938549287 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45162f60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 -- 172.21.15.167:0/1938549287 >> 172.21.15.167:0/1938549287 conn(0x562c450d6540 msgr2=0x562c45160e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 -- 172.21.15.167:0/1938549287 shutdown_connections 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 -- 172.21.15.167:0/1938549287 wait complete. 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 Processor -- start 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 -- start start 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45181bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f2194516e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4502ee30 con 0x562c45162b90 2023-10-05T19:50:39.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f219204b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45181bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f219204b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45181bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45726/0 (socket says 172.21.15.167:45726) 2023-10-05T19:50:39.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.688+0000 7f219204b700 1 -- 172.21.15.167:0/607584111 learned_addr learned my addr 172.21.15.167:0/607584111 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f219204b700 1 -- 172.21.15.167:0/607584111 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c00a180 con 0x562c45162b90 2023-10-05T19:50:39.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f219204b700 1 --2- 172.21.15.167:0/607584111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45181bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f218c00ad10 tx=0x7f218c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164bae052bed769d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2183fff700 1 -- 172.21.15.167:0/607584111 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218c0032f0 con 0x562c45162b90 2023-10-05T19:50:39.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2183fff700 1 -- 172.21.15.167:0/607584111 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00e7e0 con 0x562c45162b90 2023-10-05T19:50:39.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2183fff700 1 -- 172.21.15.167:0/607584111 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218c00eab0 con 0x562c45162b90 2023-10-05T19:50:39.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 -- 172.21.15.167:0/607584111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 msgr2=0x562c45181bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 --2- 172.21.15.167:0/607584111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45181bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f218c00ad10 tx=0x7f218c013000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 -- 172.21.15.167:0/607584111 shutdown_connections 2023-10-05T19:50:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 --2- 172.21.15.167:0/607584111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45181bf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 -- 172.21.15.167:0/607584111 >> 172.21.15.167:0/607584111 conn(0x562c450d6540 msgr2=0x562c4517d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 -- 172.21.15.167:0/607584111 shutdown_connections 2023-10-05T19:50:39.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 -- 172.21.15.167:0/607584111 wait complete. 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 Processor -- start 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 -- start start 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45188800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.692+0000 7f2194516e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c45001ed0 con 0x562c45162b90 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f219204b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45188800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f219204b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45188800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45734/0 (socket says 172.21.15.167:45734) 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 learned_addr learned my addr 172.21.15.167:0/2426374450 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c451645f0 con 0x562c45162b90 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f219204b700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45188800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f218c00a5c0 tx=0x7f218c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f21827fc700 1 -- 172.21.15.167:0/2426374450 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218c0109c0 con 0x562c45162b90 2023-10-05T19:50:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f21827fc700 1 -- 172.21.15.167:0/2426374450 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c010b20 con 0x562c45162b90 2023-10-05T19:50:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f21827fc700 1 -- 172.21.15.167:0/2426374450 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218c010e10 con 0x562c45162b90 2023-10-05T19:50:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c45188d40 con 0x562c45162b90 2023-10-05T19:50:39.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c45189120 con 0x562c45162b90 2023-10-05T19:50:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f21827fc700 1 -- 172.21.15.167:0/2426374450 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f218c037450 con 0x562c45162b90 2023-10-05T19:50:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f21827fc700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2174030c00 0x7f21740330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f21827fc700 1 -- 172.21.15.167:0/2426374450 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f218c046480 con 0x562c45162b90 2023-10-05T19:50:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f219184a700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2174030c00 0x7f21740330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451634a0 0x562c451942a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.696+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451949d0 con 0x562c451634a0 2023-10-05T19:50:39.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f219284c700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451634a0 0x562c451942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f219184a700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2174030c00 0x7f21740330b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f218800b300 tx=0x7f2188001470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f219284c700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451634a0 0x562c451942a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f218400a500 con 0x562c451634a0 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 20 realm 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45191880 con 0x562c451634a0 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f218400a500 con 0x562c451634a0 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451954b0 con 0x562c451634a0 2023-10-05T19:50:39.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f218400a500 con 0x562c451634a0 2023-10-05T19:50:39.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451962e0 0x562c451986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45198c00 con 0x562c451962e0 2023-10-05T19:50:39.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f219204b700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451962e0 0x562c451986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.700+0000 7f219204b700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451962e0 0x562c451986c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451994a0 con 0x562c451634a0 2023-10-05T19:50:39.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f218400a500 con 0x562c451634a0 2023-10-05T19:50:39.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:39.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f2194516e40 20 searching for the correct realm 2023-10-05T19:50:39.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4519b260 0x562c4519d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c4519b260 2023-10-05T19:50:39.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219184a700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4519b260 0x562c4519d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219184a700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4519b260 0x562c4519d640 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451962e0 2023-10-05T19:50:39.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219204b700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f218c010070 0x7f218c026740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x7f218c010070 2023-10-05T19:50:39.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.704+0000 7f219284c700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f218c010070 0x7f218c026740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219284c700 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f218c010070 0x7f218c026740 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x7f218c010070 2023-10-05T19:50:39.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c4519b260 2023-10-05T19:50:39.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451962e0 2023-10-05T19:50:39.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.708+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451962e0 2023-10-05T19:50:39.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x7f218c010070 2023-10-05T19:50:39.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x7f218c010070 2023-10-05T19:50:39.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x7f218c010070 2023-10-05T19:50:39.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x7f218c010070 2023-10-05T19:50:39.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451962e0 2023-10-05T19:50:39.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.712+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c4519b260 2023-10-05T19:50:39.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451962e0 2023-10-05T19:50:39.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c4519b260 2023-10-05T19:50:39.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.716+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c4519b260 2023-10-05T19:50:39.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x7f218c010070 2023-10-05T19:50:39.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x7f218c010070 2023-10-05T19:50:39.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451634a0 2023-10-05T19:50:39.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x7f218c010070 2023-10-05T19:50:39.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x7f218c010070 2023-10-05T19:50:39.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c4519b260 2023-10-05T19:50:39.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x7f218c010070 2023-10-05T19:50:39.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x7f218c010070 2023-10-05T19:50:39.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.720+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451962e0 2023-10-05T19:50:39.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451962e0 2023-10-05T19:50:39.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c4519b260 2023-10-05T19:50:39.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451962e0 2023-10-05T19:50:39.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519db80 con 0x562c451962e0 2023-10-05T19:50:39.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f2194516e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:39.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f2194516e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:39.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f2194516e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:39.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f2194516e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:39.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519a010 con 0x562c451634a0 2023-10-05T19:50:39.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.724+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519a960 con 0x562c451962e0 2023-10-05T19:50:39.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519df30 con 0x562c451962e0 2023-10-05T19:50:39.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:39.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e2e0 con 0x562c4519b260 2023-10-05T19:50:39.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519a530 con 0x562c451962e0 2023-10-05T19:50:39.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.728+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519ffc0 con 0x562c4519b260 2023-10-05T19:50:39.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519ffc0 con 0x562c451962e0 2023-10-05T19:50:39.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519ffc0 con 0x7f218c010070 2023-10-05T19:50:39.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x7f218c010070 2023-10-05T19:50:39.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c4519b260 2023-10-05T19:50:39.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.732+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451962e0 2023-10-05T19:50:39.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451962e0 2023-10-05T19:50:39.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x7f218c010070 2023-10-05T19:50:39.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x7f218c010070 2023-10-05T19:50:39.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.736+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x7f218c010070 2023-10-05T19:50:39.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x7f218c010070 2023-10-05T19:50:39.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451962e0 2023-10-05T19:50:39.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c4519b260 2023-10-05T19:50:39.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451962e0 2023-10-05T19:50:39.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c4519b260 2023-10-05T19:50:39.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.740+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184014040 con 0x562c451634a0 2023-10-05T19:50:39.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c4519b260 2023-10-05T19:50:39.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x7f218c010070 2023-10-05T19:50:39.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451634a0 2023-10-05T19:50:39.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x7f218c010070 2023-10-05T19:50:39.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.744+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c4519b260 2023-10-05T19:50:39.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x7f218c010070 2023-10-05T19:50:39.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451962e0 2023-10-05T19:50:39.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451962e0 2023-10-05T19:50:39.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c4519b260 2023-10-05T19:50:39.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451962e0 2023-10-05T19:50:39.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.748+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519e690 con 0x562c451962e0 2023-10-05T19:50:39.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:39.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:39.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:39.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:39.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519efb0 con 0x562c451962e0 2023-10-05T19:50:39.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519efb0 con 0x562c451634a0 2023-10-05T19:50:39.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:39.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519f850 con 0x562c451962e0 2023-10-05T19:50:39.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.752+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519f850 con 0x562c451962e0 2023-10-05T19:50:39.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:39.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519f950 con 0x7f218c010070 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 zone default found 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 4 Realm: () 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 zonegroup default 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4519f950 con 0x7f218c010070 2023-10-05T19:50:39.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a12d0 con 0x562c4519b260 2023-10-05T19:50:39.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a1680 con 0x562c4519b260 2023-10-05T19:50:39.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 started sync module instance, tier type = 2023-10-05T19:50:39.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:39.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.756+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a0990 con 0x562c451962e0 2023-10-05T19:50:39.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.760+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.760+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94748137882784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a0eb0 con 0x562c451962e0 2023-10-05T19:50:39.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.760+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a0980 con 0x562c451634a0 2023-10-05T19:50:39.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.764+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.764+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94748137889568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a2860 con 0x562c451634a0 2023-10-05T19:50:39.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.764+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94748137882784] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.764+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a32e0 con 0x562c451962e0 2023-10-05T19:50:39.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.764+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.764+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94748137889568] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.764+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94748137888304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a2370 con 0x562c451962e0 2023-10-05T19:50:39.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.764+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a3bd0 con 0x7f218c010070 2023-10-05T19:50:39.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.768+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94748137888304] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.768+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.768+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94748137893296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a2370 con 0x7f218c010070 2023-10-05T19:50:39.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.768+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a40c0 con 0x562c451962e0 2023-10-05T19:50:39.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.768+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94748137893296] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.768+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.768+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94748137895280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a3eb0 con 0x562c451962e0 2023-10-05T19:50:39.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.768+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a48c0 con 0x562c4519b260 2023-10-05T19:50:39.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.772+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94748137895280] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.772+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.772+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94748137896384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a3e10 con 0x562c4519b260 2023-10-05T19:50:39.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.772+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a5650 con 0x562c4519b260 2023-10-05T19:50:39.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.772+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94748137896384] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.772+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.772+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94748137901728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a5ef0 con 0x562c4519b260 2023-10-05T19:50:39.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.772+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a6790 con 0x7f218c010070 2023-10-05T19:50:39.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94748137901728] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94748137905200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a6570 con 0x7f218c010070 2023-10-05T19:50:39.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 20 add_watcher() i=0 2023-10-05T19:50:39.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 20 add_watcher() i=1 2023-10-05T19:50:39.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 20 add_watcher() i=2 2023-10-05T19:50:39.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 20 add_watcher() i=3 2023-10-05T19:50:39.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 20 add_watcher() i=4 2023-10-05T19:50:39.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 20 add_watcher() i=5 2023-10-05T19:50:39.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 20 add_watcher() i=6 2023-10-05T19:50:39.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94748137905200] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 20 add_watcher() i=7 2023-10-05T19:50:39.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:39.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a9bc0 con 0x562c451634a0 2023-10-05T19:50:39.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.776+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94748137906768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a6ff0 con 0x562c451634a0 2023-10-05T19:50:39.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94748137906768] v30'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f2163fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:39.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f2194516e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:39.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f2194516e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:39.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f2194516e40 1 Processor -- start 2023-10-05T19:50:39.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f2194516e40 1 -- start start 2023-10-05T19:50:39.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f2194516e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f2194516e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c451b4ab0 con 0x562c451b41a0 2023-10-05T19:50:39.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f219184a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f219184a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45738/0 (socket says 172.21.15.167:45738) 2023-10-05T19:50:39.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f219184a700 1 -- 172.21.15.167:0/3702190326 learned_addr learned my addr 172.21.15.167:0/3702190326 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f219184a700 1 -- 172.21.15.167:0/3702190326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c451b4bf0 con 0x562c451b41a0 2023-10-05T19:50:39.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f219184a700 1 --2- 172.21.15.167:0/3702190326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b4570 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x562c45199f60 tx=0x7f2188006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b311767bb2b03711 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f21637de700 1 -- 172.21.15.167:0/3702190326 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218802e740 con 0x562c451b41a0 2023-10-05T19:50:39.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f21637de700 1 -- 172.21.15.167:0/3702190326 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188024040 con 0x562c451b41a0 2023-10-05T19:50:39.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.780+0000 7f21637de700 1 -- 172.21.15.167:0/3702190326 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f218802e8c0 con 0x562c451b41a0 2023-10-05T19:50:39.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 -- 172.21.15.167:0/3702190326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 msgr2=0x562c451b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 --2- 172.21.15.167:0/3702190326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b4570 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x562c45199f60 tx=0x7f2188006000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 -- 172.21.15.167:0/3702190326 shutdown_connections 2023-10-05T19:50:39.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 --2- 172.21.15.167:0/3702190326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b4570 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 -- 172.21.15.167:0/3702190326 >> 172.21.15.167:0/3702190326 conn(0x562c451af560 msgr2=0x562c451ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 -- 172.21.15.167:0/3702190326 shutdown_connections 2023-10-05T19:50:39.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 -- 172.21.15.167:0/3702190326 wait complete. 2023-10-05T19:50:39.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 Processor -- start 2023-10-05T19:50:39.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 -- start start 2023-10-05T19:50:39.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c451bad30 con 0x562c451b41a0 2023-10-05T19:50:39.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f219184a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f219184a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45752/0 (socket says 172.21.15.167:45752) 2023-10-05T19:50:39.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f219184a700 1 -- 172.21.15.167:0/2179438097 learned_addr learned my addr 172.21.15.167:0/2179438097 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f219184a700 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188006070 con 0x562c451b41a0 2023-10-05T19:50:39.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f219184a700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b9d30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f218c00f920 tx=0x7f2188037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2161fdb700 1 -- 172.21.15.167:0/2179438097 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2188039500 con 0x562c451b41a0 2023-10-05T19:50:39.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2161fdb700 1 -- 172.21.15.167:0/2179438097 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188039660 con 0x562c451b41a0 2023-10-05T19:50:39.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2161fdb700 1 -- 172.21.15.167:0/2179438097 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21880397d0 con 0x562c451b41a0 2023-10-05T19:50:39.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c451ba330 con 0x562c451b41a0 2023-10-05T19:50:39.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.784+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c451ba770 con 0x562c451b41a0 2023-10-05T19:50:39.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f2161fdb700 1 -- 172.21.15.167:0/2179438097 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2188040040 con 0x562c451b41a0 2023-10-05T19:50:39.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f2161fdb700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f20d8030c50 0x7f20d8033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f2161fdb700 1 -- 172.21.15.167:0/2179438097 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f218804dc60 con 0x562c451b41a0 2023-10-05T19:50:39.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f219284c700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f20d8030c50 0x7f20d8033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451c4950 0x562c451c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451c73b0 con 0x562c451c4950 2023-10-05T19:50:39.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f219204b700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451c4950 0x562c451c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f219284c700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f20d8030c50 0x7f20d8033100 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x562c451a67a0 tx=0x7f218400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f219204b700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451c4950 0x562c451c6d60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.788+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.792+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x562c451c8080 0x562c451ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.792+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451cab10 con 0x562c451c8080 2023-10-05T19:50:39.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.792+0000 7f219184a700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x562c451c8080 0x562c451ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.792+0000 7f219184a700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x562c451c8080 0x562c451ca460 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.792+0000 7f219184a700 1 -- 172.21.15.167:0/2179438097 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c451c8080 2023-10-05T19:50:39.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.792+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c451cb7e0 0x562c451cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.792+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451ce320 con 0x562c451cb7e0 2023-10-05T19:50:39.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.792+0000 7f219284c700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c451cb7e0 0x562c451cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.792+0000 7f219284c700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c451cb7e0 0x562c451cdbf0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.796+0000 7f219284c700 1 -- 172.21.15.167:0/2179438097 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451cb7e0 2023-10-05T19:50:39.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.796+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451ceff0 0x562c451d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.796+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d1b00 con 0x562c451ceff0 2023-10-05T19:50:39.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.796+0000 7f219204b700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451ceff0 0x562c451d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.796+0000 7f219204b700 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451ceff0 0x562c451d13d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.796+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'122 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451ceff0 2023-10-05T19:50:39.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.796+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d2150 con 0x562c451c4950 2023-10-05T19:50:39.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.800+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'37 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.800+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d2770 con 0x562c451cb7e0 2023-10-05T19:50:39.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.800+0000 7f219284c700 1 -- 172.21.15.167:0/2179438097 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451cb7e0 2023-10-05T19:50:39.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.800+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d2d90 con 0x562c451c4950 2023-10-05T19:50:39.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.804+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.804+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3280 con 0x562c451ceff0 2023-10-05T19:50:39.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.804+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451ceff0 2023-10-05T19:50:39.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.804+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3680 con 0x562c451c4950 2023-10-05T19:50:39.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.808+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.808+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3680 con 0x562c451c4950 2023-10-05T19:50:39.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.808+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.808+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3680 con 0x562c451c4950 2023-10-05T19:50:39.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.812+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'38 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.812+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3680 con 0x562c451cb7e0 2023-10-05T19:50:39.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.816+0000 7f219284c700 1 -- 172.21.15.167:0/2179438097 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451cb7e0 2023-10-05T19:50:39.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.816+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3b70 con 0x562c451c4950 2023-10-05T19:50:39.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.816+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.816+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3b70 con 0x562c451ceff0 2023-10-05T19:50:39.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.820+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'32 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451ceff0 2023-10-05T19:50:39.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.820+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3b70 con 0x562c451ceff0 2023-10-05T19:50:39.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.820+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'123 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451ceff0 2023-10-05T19:50:39.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.820+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3b70 con 0x562c451c4950 2023-10-05T19:50:39.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.824+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.824+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3b70 con 0x562c451c4950 2023-10-05T19:50:39.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.824+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'39 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.824+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3b70 con 0x562c451cb7e0 2023-10-05T19:50:39.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.828+0000 7f219284c700 1 -- 172.21.15.167:0/2179438097 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451cb7e0 2023-10-05T19:50:39.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.828+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3c00 con 0x562c451c4950 2023-10-05T19:50:39.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.832+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.832+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d3c00 con 0x562c451ceff0 2023-10-05T19:50:39.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.832+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'124 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451ceff0 2023-10-05T19:50:39.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.832+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d40f0 con 0x562c451c4950 2023-10-05T19:50:39.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.836+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.836+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d40f0 con 0x562c451c4950 2023-10-05T19:50:39.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.836+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.836+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d40f0 con 0x562c451cb7e0 2023-10-05T19:50:39.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.840+0000 7f219284c700 1 -- 172.21.15.167:0/2179438097 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451cb7e0 2023-10-05T19:50:39.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.840+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d40f0 con 0x562c451c4950 2023-10-05T19:50:39.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.840+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.840+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d40f0 con 0x562c451cb7e0 2023-10-05T19:50:39.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.844+0000 7f219284c700 1 -- 172.21.15.167:0/2179438097 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451cb7e0 2023-10-05T19:50:39.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.844+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d40f0 con 0x562c451cb7e0 2023-10-05T19:50:39.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.844+0000 7f219284c700 1 -- 172.21.15.167:0/2179438097 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'27 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451cb7e0 2023-10-05T19:50:39.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.844+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d40f0 con 0x562c451cb7e0 2023-10-05T19:50:39.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.848+0000 7f219284c700 1 -- 172.21.15.167:0/2179438097 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451cb7e0 2023-10-05T19:50:39.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.848+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d40f0 con 0x562c451c4950 2023-10-05T19:50:39.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.848+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.852+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d40f0 con 0x562c451ceff0 2023-10-05T19:50:39.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.852+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'25 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451ceff0 2023-10-05T19:50:39.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.852+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d4060 con 0x562c451c4950 2023-10-05T19:50:39.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.856+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'31 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451c4950 2023-10-05T19:50:39.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.856+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d4060 con 0x562c451ceff0 2023-10-05T19:50:39.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.856+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'33 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451ceff0 2023-10-05T19:50:39.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.856+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451d4060 con 0x562c451c8080 2023-10-05T19:50:39.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.860+0000 7f219184a700 1 -- 172.21.15.167:0/2179438097 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c451c8080 2023-10-05T19:50:39.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f20d2ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:39.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:39.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f20d0ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f20c6ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:10 2023 2023-10-05T19:50:39.872 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f20c67fc700 20 reqs_thread_entry: start 2023-10-05T19:50:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 20 get_system_obj_state: rctx=0x7fffb0dc9588 obj=default.rgw.meta:users.uid:fud state=0x562c4503a0b0 s->prefetch_data=0 2023-10-05T19:50:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T19:50:39.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45232ea0 con 0x7f218c010070 2023-10-05T19:50:39.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T19:50:39.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:39.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:39.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:39.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:39.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45235930 con 0x7f218c010070 2023-10-05T19:50:39.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T19:50:39.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T19:50:39.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:50:39.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.864+0000 7f2194516e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:39.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45235930 con 0x562c451634a0 2023-10-05T19:50:39.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f2194516e40 10 removing key index: p5YnriCv1nAtykxBrupQ 2023-10-05T19:50:39.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f2194516e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T19:50:39.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [notify cookie 94748138488880 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45235d80 con 0x562c451962e0 2023-10-05T19:50:39.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94748137888304 notify 128849018907 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x562c45189120 con 0x562c451962e0 2023-10-05T19:50:39.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.2 [notify cookie 94748138488880 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f2183fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018907 cookie 94748137888304 notifier 4487 bl.length()=170 2023-10-05T19:50:39.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f2183fff700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2178003c50 con 0x562c451962e0 2023-10-05T19:50:39.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== watch-notify(notify_complete (2) cookie 94748138488880 notify 128849018907 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562c45188d40 con 0x562c451962e0 2023-10-05T19:50:39.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(106 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.868+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45233910 con 0x562c4519b260 2023-10-05T19:50:39.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f2194516e40 10 removing email index: 2023-10-05T19:50:39.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f2194516e40 10 removing user buckets index 2023-10-05T19:50:39.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f2194516e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2023-10-05T19:50:39.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94748138488880 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45235d80 con 0x562c4519b260 2023-10-05T19:50:39.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== watch-notify(notify (1) cookie 94748137901728 notify 128849018886 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f2188056040 con 0x562c4519b260 2023-10-05T19:50:39.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f2183fff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94748137901728 notifier 4487 bl.length()=160 2023-10-05T19:50:39.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f2183fff700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2178003c50 con 0x562c4519b260 2023-10-05T19:50:39.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(108 notify.6 [notify cookie 94748138488880 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== watch-notify(notify_complete (2) cookie 94748138488880 notify 128849018886 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562c451ba770 con 0x562c4519b260 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(109 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.872+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45233910 con 0x562c451634a0 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 fud.buckets [delete] v30'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f2194516e40 10 removing user index: fud 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f2194516e40 10 removing default.rgw.meta+users.uid+fud from cache 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f2194516e40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [notify cookie 94748138484768 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45234d70 con 0x562c4519b260 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== watch-notify(notify (1) cookie 94748137896384 notify 128849018887 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x562c451ba770 con 0x562c4519b260 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(111 notify.5 [notify cookie 94748138484768 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f21837fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94748137896384 notifier 4487 bl.length()=152 2023-10-05T19:50:39.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f21837fe700 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f20e0003270 con 0x562c4519b260 2023-10-05T19:50:39.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== watch-notify(notify_complete (2) cookie 94748138484768 notify 128849018887 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562c451ba330 con 0x562c4519b260 2023-10-05T19:50:39.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(112 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.876+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 8.e 8:75f48285:users.uid::fud:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45234920 con 0x7f218c010070 2023-10-05T19:50:39.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.880+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(113 fud [call,delete] v30'2 uv2 ondisk = 0) v8 ==== 189+0+0 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.880+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94748137882784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45178490 con 0x562c451962e0 2023-10-05T19:50:39.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.880+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94748137882784] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.880+0000 7f2194516e40 20 remove_watcher() i=0 2023-10-05T19:50:39.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.880+0000 7f2194516e40 2 removed watcher, disabling cache 2023-10-05T19:50:39.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.880+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94748137889568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45178490 con 0x562c451634a0 2023-10-05T19:50:39.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.884+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94748137889568] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.884+0000 7f2194516e40 20 remove_watcher() i=1 2023-10-05T19:50:39.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.884+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94748137888304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45178490 con 0x562c451962e0 2023-10-05T19:50:39.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.884+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94748137888304] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.884+0000 7f2194516e40 20 remove_watcher() i=2 2023-10-05T19:50:39.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.884+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94748137893296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45178490 con 0x7f218c010070 2023-10-05T19:50:39.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.884+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94748137893296] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.884+0000 7f2194516e40 20 remove_watcher() i=3 2023-10-05T19:50:39.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.884+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94748137895280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45178490 con 0x562c451962e0 2023-10-05T19:50:39.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.888+0000 7f219204b700 1 -- 172.21.15.167:0/2426374450 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94748137895280] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218c034070 con 0x562c451962e0 2023-10-05T19:50:39.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.888+0000 7f2194516e40 20 remove_watcher() i=4 2023-10-05T19:50:39.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.888+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94748137896384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c45178490 con 0x562c4519b260 2023-10-05T19:50:39.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.888+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94748137896384] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.888+0000 7f2194516e40 20 remove_watcher() i=5 2023-10-05T19:50:39.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.888+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94748137901728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a3a60 con 0x562c4519b260 2023-10-05T19:50:39.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.892+0000 7f219184a700 1 -- 172.21.15.167:0/2426374450 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94748137901728] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f218800f560 con 0x562c4519b260 2023-10-05T19:50:39.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.892+0000 7f2194516e40 20 remove_watcher() i=6 2023-10-05T19:50:39.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.892+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94748137905200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a3a60 con 0x7f218c010070 2023-10-05T19:50:39.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.892+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94748137905200] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2184033040 con 0x7f218c010070 2023-10-05T19:50:39.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.892+0000 7f2194516e40 20 remove_watcher() i=7 2023-10-05T19:50:39.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2163fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:39.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94748137906768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c451a3a60 con 0x562c451634a0 2023-10-05T19:50:39.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94748137906768] v30'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2184033040 con 0x562c451634a0 2023-10-05T19:50:39.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451962e0 msgr2=0x562c451986c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451962e0 0x562c451986c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451634a0 msgr2=0x562c451942a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451634a0 0x562c451942a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f218c010070 msgr2=0x7f218c026740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f218c010070 0x7f218c026740 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4519b260 msgr2=0x562c4519d640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4519b260 0x562c4519d640 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2174030c00 msgr2=0x7f21740330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2174030c00 0x7f21740330b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f218800b300 tx=0x7f2188001470 comp rx=0 tx=0).stop 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f219284c700 1 -- 172.21.15.167:0/2426374450 reap_dead start 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 msgr2=0x562c45188800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45188800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f218c00a5c0 tx=0x7f218c01c000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 shutdown_connections 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 --2- 172.21.15.167:0/2426374450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c45162b90 0x562c45188800 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 >> 172.21.15.167:0/2426374450 conn(0x562c450d6540 msgr2=0x562c4517c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 shutdown_connections 2023-10-05T19:50:39.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.896+0000 7f2194516e40 1 -- 172.21.15.167:0/2426374450 wait complete. 2023-10-05T19:50:39.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451c4950 msgr2=0x562c451c6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c451c4950 0x562c451c6d60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451ceff0 msgr2=0x562c451d13d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c451ceff0 0x562c451d13d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x562c451c8080 msgr2=0x562c451ca460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x562c451c8080 0x562c451ca460 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c451cb7e0 msgr2=0x562c451cdbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c451cb7e0 0x562c451cdbf0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f20d8030c50 msgr2=0x7f20d8033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f20d8030c50 0x7f20d8033100 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x562c451a67a0 tx=0x7f218400e040 comp rx=0 tx=0).stop 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 msgr2=0x562c451b9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f219204b700 1 -- 172.21.15.167:0/2179438097 reap_dead start 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b9d30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f218c00f920 tx=0x7f2188037000 comp rx=0 tx=0).stop 2023-10-05T19:50:39.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 shutdown_connections 2023-10-05T19:50:39.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 --2- 172.21.15.167:0/2179438097 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c451b41a0 0x562c451b9d30 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 >> 172.21.15.167:0/2179438097 conn(0x562c451af560 msgr2=0x562c451ad600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 shutdown_connections 2023-10-05T19:50:39.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.900+0000 7f2194516e40 1 -- 172.21.15.167:0/2179438097 wait complete. 2023-10-05T19:50:39.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-10-05T19:50:39.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-10-05T19:50:39.913 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2023-10-05T19:50:39.964 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:39.964 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:39.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c24cd4e40 1 Processor -- start 2023-10-05T19:50:39.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c24cd4e40 1 -- start start 2023-10-05T19:50:39.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c24cd4e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5592c45aeea0 0x5592c45b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c24cd4e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5592c44f7bd0 con 0x5592c45aa8c0 2023-10-05T19:50:39.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c24cd4e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5592c44b4ee0 con 0x5592c45aeea0 2023-10-05T19:50:39.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c22008700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5592c45aeea0 0x5592c45b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c22008700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5592c45aeea0 0x5592c45b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45754/0 (socket says 172.21.15.167:45754) 2023-10-05T19:50:39.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c22008700 1 -- 172.21.15.167:0/3177473324 learned_addr learned my addr 172.21.15.167:0/3177473324 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c22809700 1 --1- 172.21.15.167:0/3177473324 >> v1:172.21.15.118:6789/0 conn(0x5592c45aa8c0 0x5592c45aac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51740/0 (socket says 172.21.15.167:51740) 2023-10-05T19:50:39.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c22008700 1 -- 172.21.15.167:0/3177473324 >> v1:172.21.15.118:6789/0 conn(0x5592c45aa8c0 legacy=0x5592c45aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.956+0000 7f5c22008700 1 -- 172.21.15.167:0/3177473324 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c45ab4d0 con 0x5592c45aeea0 2023-10-05T19:50:39.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c22008700 1 --2- 172.21.15.167:0/3177473324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 0x5592c45b1280 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00a5c0 tx=0x7f5c0c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2668681a877451db server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c21807700 1 -- 172.21.15.167:0/3177473324 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c00e510 con 0x5592c45aeea0 2023-10-05T19:50:39.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c21807700 1 -- 172.21.15.167:0/3177473324 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c00e670 con 0x5592c45aeea0 2023-10-05T19:50:39.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c21807700 1 -- 172.21.15.167:0/3177473324 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c00e920 con 0x5592c45aeea0 2023-10-05T19:50:39.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3177473324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 msgr2=0x5592c45b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/3177473324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 0x5592c45b1280 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00a5c0 tx=0x7f5c0c005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:39.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3177473324 shutdown_connections 2023-10-05T19:50:39.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/3177473324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 0x5592c45b1280 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3177473324 >> 172.21.15.167:0/3177473324 conn(0x5592c45a62e0 msgr2=0x5592c45a86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3177473324 shutdown_connections 2023-10-05T19:50:39.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3177473324 wait complete. 2023-10-05T19:50:39.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 Processor -- start 2023-10-05T19:50:39.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 -- start start 2023-10-05T19:50:39.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aa8c0 0x5592c45ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c24cd4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c4478e30 con 0x5592c45aa8c0 2023-10-05T19:50:39.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c22809700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aa8c0 0x5592c45ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c22809700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aa8c0 0x5592c45ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45760/0 (socket says 172.21.15.167:45760) 2023-10-05T19:50:39.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c22809700 1 -- 172.21.15.167:0/3034530485 learned_addr learned my addr 172.21.15.167:0/3034530485 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c22809700 1 -- 172.21.15.167:0/3034530485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c00a180 con 0x5592c45aa8c0 2023-10-05T19:50:39.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c22809700 1 --2- 172.21.15.167:0/3034530485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aa8c0 0x5592c45ce530 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5c14001cf0 tx=0x7f5c140018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e67fa275f12e389 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.960+0000 7f5c20805700 1 -- 172.21.15.167:0/3034530485 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c14014070 con 0x5592c45aa8c0 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c20805700 1 -- 172.21.15.167:0/3034530485 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1400be10 con 0x5592c45aa8c0 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c20805700 1 -- 172.21.15.167:0/3034530485 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c1400f590 con 0x5592c45aa8c0 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3034530485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aa8c0 msgr2=0x5592c45ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/3034530485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aa8c0 0x5592c45ce530 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5c14001cf0 tx=0x7f5c140018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3034530485 shutdown_connections 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/3034530485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aa8c0 0x5592c45ce530 secure :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5c14001cf0 tx=0x7f5c140018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3034530485 >> 172.21.15.167:0/3034530485 conn(0x5592c45a62e0 msgr2=0x5592c451eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3034530485 shutdown_connections 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3034530485 wait complete. 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 Processor -- start 2023-10-05T19:50:39.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 -- start start 2023-10-05T19:50:39.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 0x5592c45d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c444bed0 con 0x5592c45aeea0 2023-10-05T19:50:39.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c22809700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 0x5592c45d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c22809700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 0x5592c45d2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45774/0 (socket says 172.21.15.167:45774) 2023-10-05T19:50:39.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 learned_addr learned my addr 172.21.15.167:0/682609459 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:39.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c44f7bd0 con 0x5592c45aeea0 2023-10-05T19:50:39.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c22809700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 0x5592c45d2c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5c140018e0 tx=0x7f5c14016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c1affd700 1 -- 172.21.15.167:0/682609459 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c1401c670 con 0x5592c45aeea0 2023-10-05T19:50:39.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5592c45d3180 con 0x5592c45aeea0 2023-10-05T19:50:39.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c1affd700 1 -- 172.21.15.167:0/682609459 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1401c7d0 con 0x5592c45aeea0 2023-10-05T19:50:39.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c1affd700 1 -- 172.21.15.167:0/682609459 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c1401cac0 con 0x5592c45aeea0 2023-10-05T19:50:39.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.964+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592c45d35c0 con 0x5592c45aeea0 2023-10-05T19:50:39.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c1affd700 1 -- 172.21.15.167:0/682609459 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5c14023020 con 0x5592c45aeea0 2023-10-05T19:50:39.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c1affd700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c04030c50 0x7f5c04033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c1affd700 1 -- 172.21.15.167:0/682609459 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f5c14008030 con 0x5592c45aeea0 2023-10-05T19:50:39.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c22008700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c04030c50 0x7f5c04033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5592c45dc6f0 0x5592c45dead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45df140 con 0x5592c45dc6f0 2023-10-05T19:50:39.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c22008700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c04030c50 0x7f5c04033100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c000f80 tx=0x7f5c0c013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c2300a700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5592c45dc6f0 0x5592c45dead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c2300a700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5592c45dc6f0 0x5592c45dead0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c1c00a500 con 0x5592c45dc6f0 2023-10-05T19:50:39.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c24cd4e40 20 realm 2023-10-05T19:50:39.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.968+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45dbd60 con 0x5592c45dc6f0 2023-10-05T19:50:39.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c1c00a500 con 0x5592c45dc6f0 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45dfc20 con 0x5592c45dc6f0 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c1c00a500 con 0x5592c45dc6f0 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5592c45e0a50 0x5592c45e2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e3370 con 0x5592c45e0a50 2023-10-05T19:50:39.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c22809700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5592c45e0a50 0x5592c45e2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c22809700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5592c45e0a50 0x5592c45e2e30 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5c14016070 con 0x5592c45e0a50 2023-10-05T19:50:39.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:39.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:39.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e3c10 con 0x5592c45dc6f0 2023-10-05T19:50:39.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5c1c00a500 con 0x5592c45dc6f0 2023-10-05T19:50:39.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:39.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 20 searching for the correct realm 2023-10-05T19:50:39.982 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5592c45e59d0 0x5592c45e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45e59d0 2023-10-05T19:50:39.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c22008700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5592c45e59d0 0x5592c45e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.972+0000 7f5c22008700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5592c45e59d0 0x5592c45e7db0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:39.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45e0a50 2023-10-05T19:50:39.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14016070 con 0x5592c45e0a50 2023-10-05T19:50:39.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c22809700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5c1401a070 0x7f5c1400e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:39.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x7f5c1401a070 2023-10-05T19:50:39.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c2300a700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5c1401a070 0x7f5c1400e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:39.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c2300a700 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5c1401a070 0x7f5c1400e5d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:39.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x7f5c1401a070 2023-10-05T19:50:39.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45dc6f0 2023-10-05T19:50:39.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45dc6f0 2023-10-05T19:50:39.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45e59d0 2023-10-05T19:50:39.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:39.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.976+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45dc6f0 2023-10-05T19:50:39.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45e0a50 2023-10-05T19:50:39.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:39.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45e0a50 2023-10-05T19:50:39.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:39.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45dc6f0 2023-10-05T19:50:39.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x7f5c1401a070 2023-10-05T19:50:39.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x7f5c1401a070 2023-10-05T19:50:39.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45dc6f0 2023-10-05T19:50:39.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x7f5c1401a070 2023-10-05T19:50:39.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x7f5c1401a070 2023-10-05T19:50:39.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.980+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e82f0 con 0x5592c45e0a50 2023-10-05T19:50:39.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:39.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e59d0 2023-10-05T19:50:39.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:39.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45dc6f0 2023-10-05T19:50:39.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e0a50 2023-10-05T19:50:39.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:39.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e59d0 2023-10-05T19:50:39.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:39.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45dc6f0 2023-10-05T19:50:39.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.984+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45dc6f0 2023-10-05T19:50:39.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45dc6f0 2023-10-05T19:50:39.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e59d0 2023-10-05T19:50:39.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:39.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x7f5c1401a070 2023-10-05T19:50:39.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x7f5c1401a070 2023-10-05T19:50:39.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45dc6f0 2023-10-05T19:50:39.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:39.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x7f5c1401a070 2023-10-05T19:50:39.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x7f5c1401a070 2023-10-05T19:50:39.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e59d0 2023-10-05T19:50:39.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:39.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.988+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x7f5c1401a070 2023-10-05T19:50:39.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x7f5c1401a070 2023-10-05T19:50:39.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e0a50 2023-10-05T19:50:39.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:39.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e0a50 2023-10-05T19:50:39.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e59d0 2023-10-05T19:50:40.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e0a50 2023-10-05T19:50:40.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c1403d040 con 0x5592c45e0a50 2023-10-05T19:50:40.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c24cd4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c24cd4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c24cd4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c24cd4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.992+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e4780 con 0x5592c45dc6f0 2023-10-05T19:50:40.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:40.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e50d0 con 0x5592c45e0a50 2023-10-05T19:50:40.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e86a0 con 0x5592c45e0a50 2023-10-05T19:50:40.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8a50 con 0x5592c45e59d0 2023-10-05T19:50:40.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:40.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:39.996+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e4c40 con 0x5592c45e0a50 2023-10-05T19:50:40.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c24cd4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ea6b0 con 0x5592c45e59d0 2023-10-05T19:50:40.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ea6b0 con 0x5592c45e0a50 2023-10-05T19:50:40.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ea6b0 con 0x7f5c1401a070 2023-10-05T19:50:40.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x7f5c1401a070 2023-10-05T19:50:40.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:40.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:40.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.000+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e59d0 2023-10-05T19:50:40.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:40.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e0a50 2023-10-05T19:50:40.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e0a50 2023-10-05T19:50:40.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:40.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x7f5c1401a070 2023-10-05T19:50:40.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x7f5c1401a070 2023-10-05T19:50:40.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:40.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.004+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x7f5c1401a070 2023-10-05T19:50:40.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x7f5c1401a070 2023-10-05T19:50:40.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e0a50 2023-10-05T19:50:40.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e59d0 2023-10-05T19:50:40.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:40.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e0a50 2023-10-05T19:50:40.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e59d0 2023-10-05T19:50:40.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.008+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c014040 con 0x5592c45dc6f0 2023-10-05T19:50:40.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e59d0 2023-10-05T19:50:40.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x7f5c1401a070 2023-10-05T19:50:40.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45dc6f0 2023-10-05T19:50:40.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x7f5c1401a070 2023-10-05T19:50:40.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e59d0 2023-10-05T19:50:40.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.012+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x7f5c1401a070 2023-10-05T19:50:40.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e0a50 2023-10-05T19:50:40.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e0a50 2023-10-05T19:50:40.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e59d0 2023-10-05T19:50:40.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e0a50 2023-10-05T19:50:40.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.016+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e8e00 con 0x5592c45e0a50 2023-10-05T19:50:40.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e96a0 con 0x5592c45e0a50 2023-10-05T19:50:40.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e96a0 con 0x5592c45dc6f0 2023-10-05T19:50:40.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:40.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e9f90 con 0x5592c45e0a50 2023-10-05T19:50:40.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e9f90 con 0x5592c45e0a50 2023-10-05T19:50:40.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e9aa0 con 0x7f5c1401a070 2023-10-05T19:50:40.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.020+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 zone default found 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 4 Realm: () 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 zonegroup default 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e9aa0 con 0x7f5c1401a070 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e9aa0 con 0x5592c45e59d0 2023-10-05T19:50:40.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45e9ea0 con 0x5592c45e59d0 2023-10-05T19:50:40.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 started sync module instance, tier type = 2023-10-05T19:50:40.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:40.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.024+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ebaf0 con 0x5592c45e0a50 2023-10-05T19:50:40.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.028+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.028+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94088848123120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ebfe0 con 0x5592c45e0a50 2023-10-05T19:50:40.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.028+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ec880 con 0x5592c45dc6f0 2023-10-05T19:50:40.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.028+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.028+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94088848130016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ec9e0 con 0x5592c45dc6f0 2023-10-05T19:50:40.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.028+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ed540 con 0x5592c45e0a50 2023-10-05T19:50:40.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.028+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94088848123120] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.032+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94088848130016] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.032+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.032+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94088848128752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ed010 con 0x5592c45e0a50 2023-10-05T19:50:40.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.032+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ede30 con 0x7f5c1401a070 2023-10-05T19:50:40.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.032+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.032+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94088848136512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ed010 con 0x7f5c1401a070 2023-10-05T19:50:40.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.032+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ee770 con 0x5592c45e0a50 2023-10-05T19:50:40.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.032+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94088848128752] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94088848136512] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94088848131184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ee280 con 0x5592c45e0a50 2023-10-05T19:50:40.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45eeb20 con 0x5592c45e59d0 2023-10-05T19:50:40.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94088848139440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45ef3c0 con 0x5592c45e59d0 2023-10-05T19:50:40.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45efdd0 con 0x5592c45e59d0 2023-10-05T19:50:40.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94088848131184] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94088848139440] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.036+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94088848144608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45f01d0 con 0x5592c45e59d0 2023-10-05T19:50:40.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45f0a70 con 0x7f5c1401a070 2023-10-05T19:50:40.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94088848144608] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c0c017050 con 0x5592c45e59d0 2023-10-05T19:50:40.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94088848147840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45f0ec0 con 0x7f5c1401a070 2023-10-05T19:50:40.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 20 add_watcher() i=0 2023-10-05T19:50:40.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 20 add_watcher() i=1 2023-10-05T19:50:40.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 20 add_watcher() i=2 2023-10-05T19:50:40.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 20 add_watcher() i=3 2023-10-05T19:50:40.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 20 add_watcher() i=4 2023-10-05T19:50:40.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 20 add_watcher() i=5 2023-10-05T19:50:40.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 20 add_watcher() i=6 2023-10-05T19:50:40.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94088848147840] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 20 add_watcher() i=7 2023-10-05T19:50:40.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:40.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45f3fd0 con 0x5592c45dc6f0 2023-10-05T19:50:40.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.040+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94088848148944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45f1310 con 0x5592c45dc6f0 2023-10-05T19:50:40.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94088848148944] v30'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5b6ffff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c24cd4e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:40.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c24cd4e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:40.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c24cd4e40 1 Processor -- start 2023-10-05T19:50:40.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c24cd4e40 1 -- start start 2023-10-05T19:50:40.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c24cd4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c45fec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c24cd4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c45ff170 con 0x5592c45fe860 2023-10-05T19:50:40.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c22008700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c45fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c22008700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c45fec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45786/0 (socket says 172.21.15.167:45786) 2023-10-05T19:50:40.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c22008700 1 -- 172.21.15.167:0/3104116763 learned_addr learned my addr 172.21.15.167:0/3104116763 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.044+0000 7f5c22008700 1 -- 172.21.15.167:0/3104116763 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c45ff2b0 con 0x5592c45fe860 2023-10-05T19:50:40.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c22008700 1 --2- 172.21.15.167:0/3104116763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c45fec30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c003000 tx=0x7f5c0c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e546a5c56d43b8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5b6f7fe700 1 -- 172.21.15.167:0/3104116763 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c037070 con 0x5592c45fe860 2023-10-05T19:50:40.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5b6f7fe700 1 -- 172.21.15.167:0/3104116763 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c010b30 con 0x5592c45fe860 2023-10-05T19:50:40.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5b6f7fe700 1 -- 172.21.15.167:0/3104116763 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c02d040 con 0x5592c45fe860 2023-10-05T19:50:40.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3104116763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 msgr2=0x5592c45fec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/3104116763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c45fec30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c003000 tx=0x7f5c0c010000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3104116763 shutdown_connections 2023-10-05T19:50:40.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/3104116763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c45fec30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3104116763 >> 172.21.15.167:0/3104116763 conn(0x5592c45f9c20 msgr2=0x5592c45f7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3104116763 shutdown_connections 2023-10-05T19:50:40.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/3104116763 wait complete. 2023-10-05T19:50:40.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 Processor -- start 2023-10-05T19:50:40.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 -- start start 2023-10-05T19:50:40.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c4604310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c24cd4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592c4605310 con 0x5592c45fe860 2023-10-05T19:50:40.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c22008700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c4604310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c22008700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c4604310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45792/0 (socket says 172.21.15.167:45792) 2023-10-05T19:50:40.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c22008700 1 -- 172.21.15.167:0/1081341273 learned_addr learned my addr 172.21.15.167:0/1081341273 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c22008700 1 -- 172.21.15.167:0/1081341273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592c45ab4d0 con 0x5592c45fe860 2023-10-05T19:50:40.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.048+0000 7f5c22008700 1 --2- 172.21.15.167:0/1081341273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c4604310 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00ea70 tx=0x7f5c0c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5b6dffb700 1 -- 172.21.15.167:0/1081341273 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c037050 con 0x5592c45fe860 2023-10-05T19:50:40.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5b6dffb700 1 -- 172.21.15.167:0/1081341273 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c03c440 con 0x5592c45fe860 2023-10-05T19:50:40.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5b6dffb700 1 -- 172.21.15.167:0/1081341273 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c0c03c5d0 con 0x5592c45fe860 2023-10-05T19:50:40.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/1081341273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5592c4604910 con 0x5592c45fe860 2023-10-05T19:50:40.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/1081341273 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592c4604d50 con 0x5592c45fe860 2023-10-05T19:50:40.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5b6dffb700 1 -- 172.21.15.167:0/1081341273 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5c0c03c730 con 0x5592c45fe860 2023-10-05T19:50:40.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5b6dffb700 1 --2- 172.21.15.167:0/1081341273 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5b60030c50 0x7f5b60033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5b6dffb700 1 -- 172.21.15.167:0/1081341273 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f5c0c046c40 con 0x5592c45fe860 2023-10-05T19:50:40.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5c2300a700 1 --2- 172.21.15.167:0/1081341273 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5b60030c50 0x7f5b60033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5c24cd4e40 5 note: GC not initialized 2023-10-05T19:50:40.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.052+0000 7f5c2300a700 1 --2- 172.21.15.167:0/1081341273 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5b60030c50 0x7f5b60033100 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5592c45f40f0 tx=0x7f5c1c00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5b5effd700 20 reqs_thread_entry: start 2023-10-05T19:50:40.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5b5cff9700 20 reqs_thread_entry: start 2023-10-05T19:50:40.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:40.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:40.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5b56ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:10 2023 2023-10-05T19:50:40.063 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:40.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 20 get_system_obj_state: rctx=0x7ffd9cace1b8 obj=default.rgw.meta:users.uid:testx$tenanteduser state=0x5592c44840b0 s->prefetch_data=0 2023-10-05T19:50:40.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2023-10-05T19:50:40.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c466cae0 con 0x5592c45e59d0 2023-10-05T19:50:40.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5b567fc700 20 reqs_thread_entry: start 2023-10-05T19:50:40.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(102 testx$tenanteduser [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7f5c0c042070 con 0x5592c45e59d0 2023-10-05T19:50:40.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2023-10-05T19:50:40.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T19:50:40.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 20 get_system_obj_state: rctx=0x7ffd9cacdea8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x5592c44840b0 s->prefetch_data=0 2023-10-05T19:50:40.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-10-05T19:50:40.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:103 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c466cae0 con 0x5592c45e59d0 2023-10-05T19:50:40.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(103 p5YnriCv1nAtykxBrupQ [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f5c0c042070 con 0x5592c45e59d0 2023-10-05T19:50:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-10-05T19:50:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:50:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 20 get_system_obj_state: rctx=0x7ffd9cacd748 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x5592c44840b0 s->prefetch_data=0 2023-10-05T19:50:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T19:50:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 20 get_system_obj_state: rctx=0x7ffd9cacdde8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x5592c44840b0 s->prefetch_data=0 2023-10-05T19:50:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T19:50:40.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~385 in=385b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c466f1e0 con 0x5592c45e59d0 2023-10-05T19:50:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.056+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(104 testx$tenanteduser [delete,create,call,writefull 0~385] v30'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7f5c0c042070 con 0x5592c45e59d0 2023-10-05T19:50:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c24cd4e40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2023-10-05T19:50:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c24cd4e40 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T19:50:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c24cd4e40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2023-10-05T19:50:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [notify cookie 94088848662640 in=588b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c466e9b0 con 0x7f5c1401a070 2023-10-05T19:50:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== watch-notify(notify (1) cookie 94088848136512 notify 128849018891 ret 0) v3 ==== 618+0+0 (crc 0 0 0) 0x7f5c1c002450 con 0x7f5c1401a070 2023-10-05T19:50:40.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c1bfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94088848136512 notifier 4493 bl.length()=576 2023-10-05T19:50:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c1bfff700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2023-10-05T19:50:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c1bfff700 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T19:50:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(105 notify.3 [notify cookie 94088848662640 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c1bfff700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c08003d90 con 0x7f5c1401a070 2023-10-05T19:50:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(106 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== watch-notify(notify_complete (2) cookie 94088848662640 notify 128849018891 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5c1c01b420 con 0x7f5c1401a070 2023-10-05T19:50:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c466d550 con 0x5592c45e59d0 2023-10-05T19:50:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f5c0c042070 con 0x5592c45e59d0 2023-10-05T19:50:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c24cd4e40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T19:50:40.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c24cd4e40 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:50:40.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c24cd4e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T19:50:40.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.060+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94088848658528 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c466d4b0 con 0x5592c45e0a50 2023-10-05T19:50:40.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94088848128752 notify 128849018908 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x5592c45d35c0 con 0x5592c45e0a50 2023-10-05T19:50:40.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c1bfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018908 cookie 94088848128752 notifier 4493 bl.length()=192 2023-10-05T19:50:40.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c1bfff700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T19:50:40.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c1bfff700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:50:40.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c1bfff700 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c08003d90 con 0x5592c45e0a50 2023-10-05T19:50:40.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(108 notify.2 [notify cookie 94088848658528 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94088848658528 notify 128849018908 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5592c45d3180 con 0x5592c45e0a50 2023-10-05T19:50:40.072 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "testx$tenanteduser", 2023-10-05T19:50:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "tenanted-user", 2023-10-05T19:50:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "", 2023-10-05T19:50:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 1, 2023-10-05T19:50:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "testx$tenanteduser", 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:40.075 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:40.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94088848123120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45c02f0 con 0x5592c45e0a50 2023-10-05T19:50:40.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94088848123120] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c24cd4e40 20 remove_watcher() i=0 2023-10-05T19:50:40.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c24cd4e40 2 removed watcher, disabling cache 2023-10-05T19:50:40.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.064+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94088848130016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45c02f0 con 0x5592c45dc6f0 2023-10-05T19:50:40.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.068+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94088848130016] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.068+0000 7f5c24cd4e40 20 remove_watcher() i=1 2023-10-05T19:50:40.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.068+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94088848128752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45c02f0 con 0x5592c45e0a50 2023-10-05T19:50:40.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.072+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94088848128752] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.072+0000 7f5c24cd4e40 20 remove_watcher() i=2 2023-10-05T19:50:40.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.072+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94088848136512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45c02f0 con 0x7f5c1401a070 2023-10-05T19:50:40.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.072+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94088848136512] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.072+0000 7f5c24cd4e40 20 remove_watcher() i=3 2023-10-05T19:50:40.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.072+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94088848131184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45c02f0 con 0x5592c45e0a50 2023-10-05T19:50:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.076+0000 7f5c22809700 1 -- 172.21.15.167:0/682609459 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94088848131184] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c14039040 con 0x5592c45e0a50 2023-10-05T19:50:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.076+0000 7f5c24cd4e40 20 remove_watcher() i=4 2023-10-05T19:50:40.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.076+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94088848139440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45c02f0 con 0x5592c45e59d0 2023-10-05T19:50:40.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.076+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94088848139440] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c0c042070 con 0x5592c45e59d0 2023-10-05T19:50:40.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.076+0000 7f5c24cd4e40 20 remove_watcher() i=5 2023-10-05T19:50:40.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.076+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94088848144608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45c02f0 con 0x5592c45e59d0 2023-10-05T19:50:40.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.076+0000 7f5c22008700 1 -- 172.21.15.167:0/682609459 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94088848144608] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c0c042070 con 0x5592c45e59d0 2023-10-05T19:50:40.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.076+0000 7f5c24cd4e40 20 remove_watcher() i=6 2023-10-05T19:50:40.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.076+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94088848147840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45c02f0 con 0x7f5c1401a070 2023-10-05T19:50:40.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.080+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94088848147840] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x7f5c1401a070 2023-10-05T19:50:40.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.080+0000 7f5c24cd4e40 20 remove_watcher() i=7 2023-10-05T19:50:40.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.080+0000 7f5b6ffff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.080+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94088848148944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5592c45c02f0 con 0x5592c45dc6f0 2023-10-05T19:50:40.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94088848148944] v30'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5c1c033040 con 0x5592c45dc6f0 2023-10-05T19:50:40.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5592c45e0a50 msgr2=0x5592c45e2e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5592c45e0a50 0x5592c45e2e30 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5592c45dc6f0 msgr2=0x5592c45dead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5592c45dc6f0 0x5592c45dead0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5c1401a070 msgr2=0x7f5c1400e5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f5c1401a070 0x7f5c1400e5d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5592c45e59d0 msgr2=0x5592c45e7db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5592c45e59d0 0x5592c45e7db0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c04030c50 msgr2=0x7f5c04033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5c04030c50 0x7f5c04033100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c000f80 tx=0x7f5c0c013000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c2300a700 1 -- 172.21.15.167:0/682609459 reap_dead start 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 msgr2=0x5592c45d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 0x5592c45d2c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5c140018e0 tx=0x7f5c14016000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 shutdown_connections 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/682609459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45aeea0 0x5592c45d2c40 secure :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5c140018e0 tx=0x7f5c14016000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 >> 172.21.15.167:0/682609459 conn(0x5592c45a62e0 msgr2=0x5592c451ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 shutdown_connections 2023-10-05T19:50:40.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/682609459 wait complete. 2023-10-05T19:50:40.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/1081341273 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5b60030c50 msgr2=0x7f5b60033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/1081341273 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5b60030c50 0x7f5b60033100 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5592c45f40f0 tx=0x7f5c1c00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:40.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/1081341273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 msgr2=0x5592c4604310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/1081341273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c4604310 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00ea70 tx=0x7f5c0c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/1081341273 shutdown_connections 2023-10-05T19:50:40.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/1081341273 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5b60030c50 0x7f5b60033100 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 --2- 172.21.15.167:0/1081341273 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5592c45fe860 0x5592c4604310 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/1081341273 >> 172.21.15.167:0/1081341273 conn(0x5592c45f9c20 msgr2=0x5592c45f7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/1081341273 shutdown_connections 2023-10-05T19:50:40.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.084+0000 7f5c24cd4e40 1 -- 172.21.15.167:0/1081341273 wait complete. 2023-10-05T19:50:40.100 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:40.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-10-05T19:50:40.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-10-05T19:50:40.100 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2023-10-05T19:50:40.140 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:40.141 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:40.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.132+0000 7fc9a67c4e40 1 Processor -- start 2023-10-05T19:50:40.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.132+0000 7fc9a67c4e40 1 -- start start 2023-10-05T19:50:40.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.132+0000 7fc9a67c4e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x562c46546af0 0x562c46546ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.132+0000 7fc9a67c4e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562c46491bd0 con 0x562c46547400 2023-10-05T19:50:40.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.132+0000 7fc9a67c4e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x562c4644eee0 con 0x562c46546af0 2023-10-05T19:50:40.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a3af8700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x562c46547400 0x562c46547e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51748/0 (socket says 172.21.15.167:51748) 2023-10-05T19:50:40.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a42f9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x562c46546af0 0x562c46546ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a3af8700 1 -- 172.21.15.167:0/21573972 learned_addr learned my addr 172.21.15.167:0/21573972 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:40.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a32f7700 1 -- 172.21.15.167:0/21573972 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001152799 0 0) 0x562c46491bd0 con 0x562c46547400 2023-10-05T19:50:40.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a32f7700 1 -- 172.21.15.167:0/21573972 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc984001e10 con 0x562c46547400 2023-10-05T19:50:40.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a42f9700 1 -- 172.21.15.167:0/21573972 >> v1:172.21.15.118:6789/0 conn(0x562c46547400 legacy=0x562c46547e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a42f9700 1 -- 172.21.15.167:0/21573972 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c465485a0 con 0x562c46546af0 2023-10-05T19:50:40.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a42f9700 1 --2- 172.21.15.167:0/21573972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c46546ec0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00a5d0 tx=0x7fc99c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298d884eefaa81c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a32f7700 1 -- 172.21.15.167:0/21573972 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc99c007610 con 0x562c46546af0 2023-10-05T19:50:40.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a32f7700 1 -- 172.21.15.167:0/21573972 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c007770 con 0x562c46546af0 2023-10-05T19:50:40.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a32f7700 1 -- 172.21.15.167:0/21573972 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc99c007a40 con 0x562c46546af0 2023-10-05T19:50:40.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/21573972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 msgr2=0x562c46546ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/21573972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c46546ec0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00a5d0 tx=0x7fc99c005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:40.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/21573972 shutdown_connections 2023-10-05T19:50:40.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/21573972 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c46546ec0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/21573972 >> 172.21.15.167:0/21573972 conn(0x562c464ba560 msgr2=0x562c464ba960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/21573972 shutdown_connections 2023-10-05T19:50:40.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/21573972 wait complete. 2023-10-05T19:50:40.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 Processor -- start 2023-10-05T19:50:40.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 -- start start 2023-10-05T19:50:40.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c465659f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.136+0000 7fc9a67c4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c46412e30 con 0x562c46546af0 2023-10-05T19:50:40.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a42f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c465659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a42f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c465659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45804/0 (socket says 172.21.15.167:45804) 2023-10-05T19:50:40.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2809942204 learned_addr learned my addr 172.21.15.167:0/2809942204 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2809942204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c005cf0 con 0x562c46546af0 2023-10-05T19:50:40.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a42f9700 1 --2- 172.21.15.167:0/2809942204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c465659f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc99c000c00 tx=0x7fc99c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffd81657880c77e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a22f5700 1 -- 172.21.15.167:0/2809942204 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc99c0078e0 con 0x562c46546af0 2023-10-05T19:50:40.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a22f5700 1 -- 172.21.15.167:0/2809942204 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c007a40 con 0x562c46546af0 2023-10-05T19:50:40.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a22f5700 1 -- 172.21.15.167:0/2809942204 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc99c007bd0 con 0x562c46546af0 2023-10-05T19:50:40.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2809942204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 msgr2=0x562c465659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2809942204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c465659f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc99c000c00 tx=0x7fc99c014000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2809942204 shutdown_connections 2023-10-05T19:50:40.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2809942204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c465659f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2809942204 >> 172.21.15.167:0/2809942204 conn(0x562c464ba560 msgr2=0x562c46561530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2809942204 shutdown_connections 2023-10-05T19:50:40.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2809942204 wait complete. 2023-10-05T19:50:40.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.140+0000 7fc9a67c4e40 1 Processor -- start 2023-10-05T19:50:40.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a67c4e40 1 -- start start 2023-10-05T19:50:40.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a67c4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c4656c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a67c4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c463e5ed0 con 0x562c46546af0 2023-10-05T19:50:40.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a42f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c4656c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a42f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c4656c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45810/0 (socket says 172.21.15.167:45810) 2023-10-05T19:50:40.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 learned_addr learned my addr 172.21.15.167:0/2439596873 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c465485a0 con 0x562c46546af0 2023-10-05T19:50:40.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a42f9700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c4656c6f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc99c01f040 tx=0x7fc99c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a0af2700 1 -- 172.21.15.167:0/2439596873 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc99c007e50 con 0x562c46546af0 2023-10-05T19:50:40.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a0af2700 1 -- 172.21.15.167:0/2439596873 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c029070 con 0x562c46546af0 2023-10-05T19:50:40.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c4656cc30 con 0x562c46546af0 2023-10-05T19:50:40.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a0af2700 1 -- 172.21.15.167:0/2439596873 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc99c030480 con 0x562c46546af0 2023-10-05T19:50:40.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.144+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c4656d070 con 0x562c46546af0 2023-10-05T19:50:40.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a0af2700 1 -- 172.21.15.167:0/2439596873 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fc99c012400 con 0x562c46546af0 2023-10-05T19:50:40.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a0af2700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc988030c40 0x7fc9880330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a0af2700 1 -- 172.21.15.167:0/2439596873 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fc99c02b070 con 0x562c46546af0 2023-10-05T19:50:40.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a3af8700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc988030c40 0x7fc9880330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c46547400 0x562c465781b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46578820 con 0x562c46547400 2023-10-05T19:50:40.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a3af8700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc988030c40 0x7fc9880330f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0044f0 tx=0x7fc98c006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a4afa700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c46547400 0x562c465781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a4afa700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c46547400 0x562c465781b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc99400a500 con 0x562c46547400 2023-10-05T19:50:40.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 20 realm 2023-10-05T19:50:40.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46575810 con 0x562c46547400 2023-10-05T19:50:40.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc99400a500 con 0x562c46547400 2023-10-05T19:50:40.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:40.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46579300 con 0x562c46547400 2023-10-05T19:50:40.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.148+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc99400a500 con 0x562c46547400 2023-10-05T19:50:40.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c4657a130 0x562c4657c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4657ca50 con 0x562c4657a130 2023-10-05T19:50:40.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a42f9700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c4657a130 0x562c4657c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a42f9700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c4657a130 0x562c4657c510 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc99c01c7f0 con 0x562c4657a130 2023-10-05T19:50:40.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4657d2f0 con 0x562c46547400 2023-10-05T19:50:40.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc99400a500 con 0x562c46547400 2023-10-05T19:50:40.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:40.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 20 searching for the correct realm 2023-10-05T19:50:40.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4657f0b0 0x562c46581490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c465819d0 con 0x562c4657f0b0 2023-10-05T19:50:40.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a3af8700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4657f0b0 0x562c46581490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a3af8700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4657f0b0 0x562c46581490 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c004520 con 0x562c4657f0b0 2023-10-05T19:50:40.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.152+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c465819d0 con 0x562c4657a130 2023-10-05T19:50:40.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c01c7f0 con 0x562c4657a130 2023-10-05T19:50:40.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a42f9700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc99c007030 0x7fc99c000ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x7fc99c007030 2023-10-05T19:50:40.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc99c007030 0x7fc99c000ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc99c007030 0x7fc99c000ed0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x7fc99c007030 2023-10-05T19:50:40.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657f0b0 2023-10-05T19:50:40.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c004520 con 0x562c4657f0b0 2023-10-05T19:50:40.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.156+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657a130 2023-10-05T19:50:40.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c01c7f0 con 0x562c4657a130 2023-10-05T19:50:40.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657a130 2023-10-05T19:50:40.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c01c7f0 con 0x562c4657a130 2023-10-05T19:50:40.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x7fc99c007030 2023-10-05T19:50:40.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x7fc99c007030 2023-10-05T19:50:40.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x7fc99c007030 2023-10-05T19:50:40.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x7fc99c007030 2023-10-05T19:50:40.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657a130 2023-10-05T19:50:40.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c01c7f0 con 0x562c4657a130 2023-10-05T19:50:40.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657f0b0 2023-10-05T19:50:40.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c004520 con 0x562c4657f0b0 2023-10-05T19:50:40.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.160+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657a130 2023-10-05T19:50:40.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c01c7f0 con 0x562c4657a130 2023-10-05T19:50:40.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657f0b0 2023-10-05T19:50:40.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.164+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657f0b0 2023-10-05T19:50:40.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x7fc99c007030 2023-10-05T19:50:40.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x7fc99c007030 2023-10-05T19:50:40.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c46547400 2023-10-05T19:50:40.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x7fc99c007030 2023-10-05T19:50:40.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x7fc99c007030 2023-10-05T19:50:40.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657f0b0 2023-10-05T19:50:40.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x7fc99c007030 2023-10-05T19:50:40.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x7fc99c007030 2023-10-05T19:50:40.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657a130 2023-10-05T19:50:40.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c01c7f0 con 0x562c4657a130 2023-10-05T19:50:40.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657a130 2023-10-05T19:50:40.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c01c7f0 con 0x562c4657a130 2023-10-05T19:50:40.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.168+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657f0b0 2023-10-05T19:50:40.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657a130 2023-10-05T19:50:40.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fc99c01c7f0 con 0x562c4657a130 2023-10-05T19:50:40.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc99c045040 con 0x562c4657a130 2023-10-05T19:50:40.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4657de60 con 0x562c46547400 2023-10-05T19:50:40.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4657e7b0 con 0x562c4657a130 2023-10-05T19:50:40.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.172+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46581e10 con 0x562c4657a130 2023-10-05T19:50:40.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c465821c0 con 0x562c4657f0b0 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4657e2f0 con 0x562c4657a130 2023-10-05T19:50:40.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4657e2c0 con 0x562c4657f0b0 2023-10-05T19:50:40.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4657e2c0 con 0x562c4657a130 2023-10-05T19:50:40.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.176+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46581e10 con 0x7fc99c007030 2023-10-05T19:50:40.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x7fc99c007030 2023-10-05T19:50:40.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657f0b0 2023-10-05T19:50:40.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657a130 2023-10-05T19:50:40.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657a130 2023-10-05T19:50:40.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.180+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x7fc99c007030 2023-10-05T19:50:40.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x7fc99c007030 2023-10-05T19:50:40.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x7fc99c007030 2023-10-05T19:50:40.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x7fc99c007030 2023-10-05T19:50:40.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657a130 2023-10-05T19:50:40.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.184+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657f0b0 2023-10-05T19:50:40.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657a130 2023-10-05T19:50:40.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657f0b0 2023-10-05T19:50:40.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994014040 con 0x562c46547400 2023-10-05T19:50:40.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.188+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657f0b0 2023-10-05T19:50:40.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x7fc99c007030 2023-10-05T19:50:40.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c46547400 2023-10-05T19:50:40.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x7fc99c007030 2023-10-05T19:50:40.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657f0b0 2023-10-05T19:50:40.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x7fc99c007030 2023-10-05T19:50:40.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.192+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657a130 2023-10-05T19:50:40.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657a130 2023-10-05T19:50:40.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657f0b0 2023-10-05T19:50:40.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657a130 2023-10-05T19:50:40.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582570 con 0x562c4657a130 2023-10-05T19:50:40.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a67c4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a67c4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a67c4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a67c4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.196+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4657e2c0 con 0x562c4657a130 2023-10-05T19:50:40.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46581e10 con 0x562c46547400 2023-10-05T19:50:40.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:40.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582e10 con 0x562c4657a130 2023-10-05T19:50:40.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46582e10 con 0x562c4657a130 2023-10-05T19:50:40.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46583030 con 0x7fc99c007030 2023-10-05T19:50:40.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 zone default found 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 4 Realm: () 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 zonegroup default 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.200+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46583030 con 0x7fc99c007030 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c465849b0 con 0x562c4657f0b0 2023-10-05T19:50:40.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46584d60 con 0x562c4657f0b0 2023-10-05T19:50:40.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 20 started sync module instance, tier type = 2023-10-05T19:50:40.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:40.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.204+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46584070 con 0x562c4657a130 2023-10-05T19:50:40.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.208+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.208+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94748158737280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46584590 con 0x562c4657a130 2023-10-05T19:50:40.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.208+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46585af0 con 0x562c46547400 2023-10-05T19:50:40.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.208+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94748158737280] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.208+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.208+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94748158742800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46584590 con 0x562c46547400 2023-10-05T19:50:40.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.208+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c465860b0 con 0x562c4657a130 2023-10-05T19:50:40.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.212+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94748158742800] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.212+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.212+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94748158743904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c465860b0 con 0x562c4657a130 2023-10-05T19:50:40.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.212+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46586950 con 0x7fc99c007030 2023-10-05T19:50:40.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.212+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.212+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94748158743904] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.212+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94748158747088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46586d50 con 0x7fc99c007030 2023-10-05T19:50:40.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.212+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c465875f0 con 0x562c4657a130 2023-10-05T19:50:40.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.216+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94748158747088] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.216+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.216+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94748158748192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46587240 con 0x562c4657a130 2023-10-05T19:50:40.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.216+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46587c50 con 0x562c4657f0b0 2023-10-05T19:50:40.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.216+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.216+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94748158752608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c465884f0 con 0x562c4657f0b0 2023-10-05T19:50:40.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.216+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46588f00 con 0x562c4657f0b0 2023-10-05T19:50:40.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.216+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94748158748192] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94748158752608] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94748158757392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c465892b0 con 0x562c4657f0b0 2023-10-05T19:50:40.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46589b50 con 0x7fc99c007030 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94748158757392] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94748158760544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46589fa0 con 0x7fc99c007030 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 20 add_watcher() i=0 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 20 add_watcher() i=1 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 20 add_watcher() i=2 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 20 add_watcher() i=3 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 20 add_watcher() i=4 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 20 add_watcher() i=5 2023-10-05T19:50:40.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.220+0000 7fc9a67c4e40 20 add_watcher() i=6 2023-10-05T19:50:40.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94748158760544] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc9a67c4e40 20 add_watcher() i=7 2023-10-05T19:50:40.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc9a67c4e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:40.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4658d010 con 0x562c46547400 2023-10-05T19:50:40.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94748158761648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4658a5a0 con 0x562c46547400 2023-10-05T19:50:40.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94748158761648] v30'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc974ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc9a67c4e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:40.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.224+0000 7fc9a67c4e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:40.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 Processor -- start 2023-10-05T19:50:40.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 -- start start 2023-10-05T19:50:40.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c46597c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c46598150 con 0x562c46597840 2023-10-05T19:50:40.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a3af8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c46597c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a3af8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c46597c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45820/0 (socket says 172.21.15.167:45820) 2023-10-05T19:50:40.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2061419595 learned_addr learned my addr 172.21.15.167:0/2061419595 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2061419595 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c46598290 con 0x562c46597840 2023-10-05T19:50:40.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a3af8700 1 --2- 172.21.15.167:0/2061419595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c46597c10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x562c46578ea0 tx=0x7fc98c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2afec200cb25be9 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc8effff700 1 -- 172.21.15.167:0/2061419595 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c01a040 con 0x562c46597840 2023-10-05T19:50:40.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc8effff700 1 -- 172.21.15.167:0/2061419595 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c01b040 con 0x562c46597840 2023-10-05T19:50:40.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc8effff700 1 -- 172.21.15.167:0/2061419595 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c0049b0 con 0x562c46597840 2023-10-05T19:50:40.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2061419595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 msgr2=0x562c46597c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2061419595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c46597c10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x562c46578ea0 tx=0x7fc98c006000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2061419595 shutdown_connections 2023-10-05T19:50:40.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2061419595 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c46597c10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2061419595 >> 172.21.15.167:0/2061419595 conn(0x562c46592c00 msgr2=0x562c46590d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2061419595 shutdown_connections 2023-10-05T19:50:40.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.228+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2061419595 wait complete. 2023-10-05T19:50:40.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a67c4e40 1 Processor -- start 2023-10-05T19:50:40.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a67c4e40 1 -- start start 2023-10-05T19:50:40.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a67c4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c4659d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a67c4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4659e330 con 0x562c46597840 2023-10-05T19:50:40.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a3af8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c4659d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a3af8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c4659d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45826/0 (socket says 172.21.15.167:45826) 2023-10-05T19:50:40.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a3af8700 1 -- 172.21.15.167:0/1524559308 learned_addr learned my addr 172.21.15.167:0/1524559308 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a3af8700 1 -- 172.21.15.167:0/1524559308 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc984001e10 con 0x562c46597840 2023-10-05T19:50:40.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a3af8700 1 --2- 172.21.15.167:0/1524559308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c4659d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc98c03a040 tx=0x7fc98c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc8ee7fc700 1 -- 172.21.15.167:0/1524559308 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c01a040 con 0x562c46597840 2023-10-05T19:50:40.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc8ee7fc700 1 -- 172.21.15.167:0/1524559308 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c004260 con 0x562c46597840 2023-10-05T19:50:40.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc8ee7fc700 1 -- 172.21.15.167:0/1524559308 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c02c940 con 0x562c46597840 2023-10-05T19:50:40.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/1524559308 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562c4659d930 con 0x562c46597840 2023-10-05T19:50:40.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/1524559308 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c4659ddd0 con 0x562c46597840 2023-10-05T19:50:40.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc8ee7fc700 1 -- 172.21.15.167:0/1524559308 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fc98c02cb70 con 0x562c46597840 2023-10-05T19:50:40.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc8ee7fc700 1 --2- 172.21.15.167:0/1524559308 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc8e4030c00 0x7fc8e40330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.232+0000 7fc8ee7fc700 1 -- 172.21.15.167:0/1524559308 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fc98c027040 con 0x562c46597840 2023-10-05T19:50:40.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a4afa700 1 --2- 172.21.15.167:0/1524559308 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc8e4030c00 0x7fc8e40330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 5 note: GC not initialized 2023-10-05T19:50:40.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a4afa700 1 --2- 172.21.15.167:0/1524559308 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc8e4030c00 0x7fc8e40330b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x562c4658a500 tx=0x7fc99400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc8e37fe700 20 reqs_thread_entry: start 2023-10-05T19:50:40.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc8e17fa700 20 reqs_thread_entry: start 2023-10-05T19:50:40.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:40.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:40.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc8cf7fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:10 2023 2023-10-05T19:50:40.246 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:40.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc8ceffd700 20 reqs_thread_entry: start 2023-10-05T19:50:40.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 20 get_system_obj_state: rctx=0x7fffb6cae5a8 obj=default.rgw.meta:users.uid:testx$tenanteduser state=0x562c4641e0b0 s->prefetch_data=0 2023-10-05T19:50:40.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2023-10-05T19:50:40.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46605b60 con 0x562c4657f0b0 2023-10-05T19:50:40.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(102 testx$tenanteduser [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+139 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x16 2023-10-05T19:50:40.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T19:50:40.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.236+0000 7fc9a67c4e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:40.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:40.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:103 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c466085f0 con 0x562c4657f0b0 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(103 testx$tenanteduser [call,call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 288+0+508 (crc 0 0 0) 0x7fc98c01d040 con 0x562c4657f0b0 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 get_system_obj_state: rctx=0x7fffb6cad950 obj=default.rgw.meta:root:myfoo state=0x562c4641e0b0 s->prefetch_data=0 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46607e00 con 0x7fc99c007030 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv23 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:50:40.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:40.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:50:40.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4660a3a0 con 0x7fc99c007030 2023-10-05T19:50:40.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(105 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:40.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T19:50:40.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:40.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 get_system_obj_state: rctx=0x7fffb6cad950 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x562c463f42b0 s->prefetch_data=0 2023-10-05T19:50:40.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : miss 2023-10-05T19:50:40.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46609ae0 con 0x562c46547400 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(106 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x16 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:40.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4660c5e0 con 0x562c46547400 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(107 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv4 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x13 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 20 get_system_obj_state: rctx=0x7fffb6cad8e8 obj=default.rgw.meta:users.uid:testx$tenanteduser state=0x562c463f42b0 s->prefetch_data=0 2023-10-05T19:50:40.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : type miss (requested=0x16, cached=0x13) 2023-10-05T19:50:40.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.240+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4660cc00 con 0x562c4657f0b0 2023-10-05T19:50:40.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(108 testx$tenanteduser [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+139 (crc 0 0 0) 0x7fc98c0510a0 con 0x562c4657f0b0 2023-10-05T19:50:40.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a67c4e40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x16 2023-10-05T19:50:40.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a67c4e40 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T19:50:40.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a67c4e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a67c4e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a67c4e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:40.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a67c4e40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x17) 2023-10-05T19:50:40.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4660f110 con 0x7fc99c007030 2023-10-05T19:50:40.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(109 foo.buckets [call] v30'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.244+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 8.8 8:15d87132:root::.bucket.meta.testx%3amyfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46612830 con 0x562c46547400 2023-10-05T19:50:40.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(110 .bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [create,call,writefull 0~371,setxattr (203)] v30'3 uv3 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x7 2023-10-05T19:50:40.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:40.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T19:50:40.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1, ofs0, ns] 2023-10-05T19:50:40.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94748159320336 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c466101a0 con 0x562c4657f0b0 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== watch-notify(notify (1) cookie 94748158757392 notify 128849018888 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x562c4659ddd0 con 0x562c4657f0b0 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a22f5700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94748158757392 notifier 4499 bl.length()=806 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a22f5700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x7 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a22f5700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a22f5700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(111 notify.6 [notify cookie 94748159320336 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc98c0510a0 con 0x562c4657f0b0 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a22f5700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc97c003d90 con 0x562c4657f0b0 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(112 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc98c0510a0 con 0x562c4657f0b0 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== watch-notify(notify_complete (2) cookie 94748159320336 notify 128849018888 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562c4659d930 con 0x562c4657f0b0 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 20 handle_bi_update(): bucket=testx:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_sources= new_sources= 2023-10-05T19:50:40.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 20 handle_bi_update(): bucket=testx:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential sources added=[] removed=[] 2023-10-05T19:50:40.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 20 handle_bi_update(): bucket=testx:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_dests= new_dests= 2023-10-05T19:50:40.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 20 handle_bi_update(): bucket=testx:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential dests added=[] removed=[] 2023-10-05T19:50:40.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4660ec20 con 0x562c46547400 2023-10-05T19:50:40.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.248+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:114 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46610120 con 0x562c46547400 2023-10-05T19:50:40.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(114 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a67c4e40 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2023-10-05T19:50:40.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a67c4e40 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2023-10-05T19:50:40.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a67c4e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2023-10-05T19:50:40.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:115 7.d 7:b4812045:::notify.4:head [notify cookie 94748159307104 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c466101c0 con 0x562c4657a130 2023-10-05T19:50:40.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94748158748192 notify 128849018909 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x562c4656d070 con 0x562c4657a130 2023-10-05T19:50:40.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a1af4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018909 cookie 94748158748192 notifier 4499 bl.length()=348 2023-10-05T19:50:40.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(115 notify.4 [notify cookie 94748159307104 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a1af4700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2023-10-05T19:50:40.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a1af4700 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2023-10-05T19:50:40.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a1af4700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc8f4003410 con 0x562c4657a130 2023-10-05T19:50:40.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.252+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(116 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94748159307104 notify 128849018909 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562c4656cc30 con 0x562c4657a130 2023-10-05T19:50:40.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a67c4e40 10 removing default.rgw.meta+root+myfoo from cache 2023-10-05T19:50:40.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a67c4e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T19:50:40.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94748159273216 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46607240 con 0x562c4657f0b0 2023-10-05T19:50:40.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== watch-notify(notify (1) cookie 94748158757392 notify 128849018889 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x562c4659d930 con 0x562c4657f0b0 2023-10-05T19:50:40.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a1af4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94748158757392 notifier 4499 bl.length()=149 2023-10-05T19:50:40.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(117 notify.6 [notify cookie 94748159273216 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc98c0510a0 con 0x562c4657f0b0 2023-10-05T19:50:40.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a1af4700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:118 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc8f4003410 con 0x562c4657f0b0 2023-10-05T19:50:40.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(118 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc98c0510a0 con 0x562c4657f0b0 2023-10-05T19:50:40.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== watch-notify(notify_complete (2) cookie 94748159273216 notify 128849018889 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc984001e10 con 0x562c4657f0b0 2023-10-05T19:50:40.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:119 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4660e240 con 0x7fc99c007030 2023-10-05T19:50:40.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(119 myfoo [call,delete] v30'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a67c4e40 10 removing default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 from cache 2023-10-05T19:50:40.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a67c4e40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1, ofs0, ns] 2023-10-05T19:50:40.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:120 7.9 7:93e5b521:::notify.7:head [notify cookie 94748159288016 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46611570 con 0x7fc99c007030 2023-10-05T19:50:40.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== watch-notify(notify (1) cookie 94748158760544 notify 128849018892 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7fc994002470 con 0x7fc99c007030 2023-10-05T19:50:40.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a22f5700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94748158760544 notifier 4499 bl.length()=206 2023-10-05T19:50:40.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a22f5700 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc97c003d90 con 0x7fc99c007030 2023-10-05T19:50:40.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.256+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(120 notify.7 [notify cookie 94748159288016 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.260+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== watch-notify(notify_complete (2) cookie 94748159288016 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc99404b020 con 0x7fc99c007030 2023-10-05T19:50:40.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.260+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(121 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.260+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c46606900 con 0x562c46547400 2023-10-05T19:50:40.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.260+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(122 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,delete] v30'5 uv5 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.260+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94748158737280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4655c250 con 0x562c4657a130 2023-10-05T19:50:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.264+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(123 notify.0 [watch unwatch cookie 94748158737280] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.264+0000 7fc9a67c4e40 20 remove_watcher() i=0 2023-10-05T19:50:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.264+0000 7fc9a67c4e40 2 removed watcher, disabling cache 2023-10-05T19:50:40.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.264+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:124 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94748158742800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4655c250 con 0x562c46547400 2023-10-05T19:50:40.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.264+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(124 notify.1 [watch unwatch cookie 94748158742800] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.264+0000 7fc9a67c4e40 20 remove_watcher() i=1 2023-10-05T19:50:40.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.264+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:125 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94748158743904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4655c250 con 0x562c4657a130 2023-10-05T19:50:40.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.268+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(125 notify.2 [watch unwatch cookie 94748158743904] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.268+0000 7fc9a67c4e40 20 remove_watcher() i=2 2023-10-05T19:50:40.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.268+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:126 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94748158747088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4655c250 con 0x7fc99c007030 2023-10-05T19:50:40.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.272+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(126 notify.3 [watch unwatch cookie 94748158747088] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.272+0000 7fc9a67c4e40 20 remove_watcher() i=3 2023-10-05T19:50:40.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.272+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:127 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94748158748192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4655c250 con 0x562c4657a130 2023-10-05T19:50:40.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.272+0000 7fc9a42f9700 1 -- 172.21.15.167:0/2439596873 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(127 notify.4 [watch unwatch cookie 94748158748192] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc99c050040 con 0x562c4657a130 2023-10-05T19:50:40.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.272+0000 7fc9a67c4e40 20 remove_watcher() i=4 2023-10-05T19:50:40.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.272+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:128 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94748158752608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4655c250 con 0x562c4657f0b0 2023-10-05T19:50:40.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.276+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== osd_op_reply(128 notify.5 [watch unwatch cookie 94748158752608] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc98c0510a0 con 0x562c4657f0b0 2023-10-05T19:50:40.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.276+0000 7fc9a67c4e40 20 remove_watcher() i=5 2023-10-05T19:50:40.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.276+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:129 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94748158757392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4655c250 con 0x562c4657f0b0 2023-10-05T19:50:40.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.276+0000 7fc9a3af8700 1 -- 172.21.15.167:0/2439596873 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== osd_op_reply(129 notify.6 [watch unwatch cookie 94748158757392] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc98c0510a0 con 0x562c4657f0b0 2023-10-05T19:50:40.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.276+0000 7fc9a67c4e40 20 remove_watcher() i=6 2023-10-05T19:50:40.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.276+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:130 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94748158760544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4655c250 con 0x7fc99c007030 2023-10-05T19:50:40.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.280+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.2 v2:172.21.15.167:6816/26774 28 ==== osd_op_reply(130 notify.7 [watch unwatch cookie 94748158760544] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc994033040 con 0x7fc99c007030 2023-10-05T19:50:40.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.280+0000 7fc9a67c4e40 20 remove_watcher() i=7 2023-10-05T19:50:40.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.280+0000 7fc974ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.280+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:131 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94748158761648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562c4655c250 con 0x562c46547400 2023-10-05T19:50:40.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.280+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(131 data_loggenerations_metadata [watch unwatch cookie 94748158761648] v30'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc994033040 con 0x562c46547400 2023-10-05T19:50:40.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c4657a130 msgr2=0x562c4657c510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562c4657a130 0x562c4657c510 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c46547400 msgr2=0x562c465781b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562c46547400 0x562c465781b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc99c007030 msgr2=0x7fc99c000ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc99c007030 0x7fc99c000ed0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4657f0b0 msgr2=0x562c46581490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562c4657f0b0 0x562c46581490 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc988030c40 msgr2=0x7fc9880330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc988030c40 0x7fc9880330f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0044f0 tx=0x7fc98c006690 comp rx=0 tx=0).stop 2023-10-05T19:50:40.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a4afa700 1 -- 172.21.15.167:0/2439596873 reap_dead start 2023-10-05T19:50:40.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 msgr2=0x562c4656c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c4656c6f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc99c01f040 tx=0x7fc99c01c000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 shutdown_connections 2023-10-05T19:50:40.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/2439596873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46546af0 0x562c4656c6f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 >> 172.21.15.167:0/2439596873 conn(0x562c464ba560 msgr2=0x562c4655ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 shutdown_connections 2023-10-05T19:50:40.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/2439596873 wait complete. 2023-10-05T19:50:40.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/1524559308 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc8e4030c00 msgr2=0x7fc8e40330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/1524559308 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc8e4030c00 0x7fc8e40330b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x562c4658a500 tx=0x7fc99400e040 comp rx=0 tx=0).stop 2023-10-05T19:50:40.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/1524559308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 msgr2=0x562c4659d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/1524559308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c4659d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc98c03a040 tx=0x7fc98c030000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/1524559308 shutdown_connections 2023-10-05T19:50:40.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/1524559308 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc8e4030c00 0x7fc8e40330b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 --2- 172.21.15.167:0/1524559308 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562c46597840 0x562c4659d330 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/1524559308 >> 172.21.15.167:0/1524559308 conn(0x562c46592c00 msgr2=0x562c46590ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/1524559308 shutdown_connections 2023-10-05T19:50:40.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.284+0000 7fc9a67c4e40 1 -- 172.21.15.167:0/1524559308 wait complete. 2023-10-05T19:50:40.298 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2023-10-05T19:50:40.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2023-10-05T19:50:40.298 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2023-10-05T19:50:40.333 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:40.333 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:40.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.324+0000 7f94eec5ee40 1 Processor -- start 2023-10-05T19:50:40.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.324+0000 7f94eec5ee40 1 -- start start 2023-10-05T19:50:40.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x564ecfc33920 0x564ecfc33cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564ecfb80bd0 con 0x564ecfc34230 2023-10-05T19:50:40.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x564ecfb3dee0 con 0x564ecfc33920 2023-10-05T19:50:40.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94ec793700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x564ecfc33920 0x564ecfc33cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94ebf92700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x564ecfc34230 0x564ecfc34cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51760/0 (socket says 172.21.15.167:51760) 2023-10-05T19:50:40.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94ebf92700 1 -- 172.21.15.167:0/941020723 learned_addr learned my addr 172.21.15.167:0/941020723 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:40.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eb791700 1 -- 172.21.15.167:0/941020723 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797466804 0 0) 0x564ecfb80bd0 con 0x564ecfc34230 2023-10-05T19:50:40.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eb791700 1 -- 172.21.15.167:0/941020723 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94cc001e10 con 0x564ecfc34230 2023-10-05T19:50:40.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94ec793700 1 -- 172.21.15.167:0/941020723 >> v1:172.21.15.118:6789/0 conn(0x564ecfc34230 legacy=0x564ecfc34cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94ec793700 1 -- 172.21.15.167:0/941020723 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ecfc353e0 con 0x564ecfc33920 2023-10-05T19:50:40.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94ec793700 1 --2- 172.21.15.167:0/941020723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc33cf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00a5d0 tx=0x7f94dc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b66d35609e083ce server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eb791700 1 -- 172.21.15.167:0/941020723 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94dc007610 con 0x564ecfc33920 2023-10-05T19:50:40.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eb791700 1 -- 172.21.15.167:0/941020723 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc007770 con 0x564ecfc33920 2023-10-05T19:50:40.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eb791700 1 -- 172.21.15.167:0/941020723 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94dc007a40 con 0x564ecfc33920 2023-10-05T19:50:40.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 -- 172.21.15.167:0/941020723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 msgr2=0x564ecfc33cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/941020723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc33cf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00a5d0 tx=0x7f94dc005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:40.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 -- 172.21.15.167:0/941020723 shutdown_connections 2023-10-05T19:50:40.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/941020723 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc33cf0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 -- 172.21.15.167:0/941020723 >> 172.21.15.167:0/941020723 conn(0x564ecfc2f340 msgr2=0x564ecfc31750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 -- 172.21.15.167:0/941020723 shutdown_connections 2023-10-05T19:50:40.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 -- 172.21.15.167:0/941020723 wait complete. 2023-10-05T19:50:40.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.328+0000 7f94eec5ee40 1 Processor -- start 2023-10-05T19:50:40.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 -- start start 2023-10-05T19:50:40.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc52820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecfb01e30 con 0x564ecfc33920 2023-10-05T19:50:40.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94ec793700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc52820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94ec793700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc52820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45850/0 (socket says 172.21.15.167:45850) 2023-10-05T19:50:40.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94ec793700 1 -- 172.21.15.167:0/2278450478 learned_addr learned my addr 172.21.15.167:0/2278450478 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94ec793700 1 -- 172.21.15.167:0/2278450478 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc005cf0 con 0x564ecfc33920 2023-10-05T19:50:40.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94ec793700 1 --2- 172.21.15.167:0/2278450478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc52820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94dc000c00 tx=0x7f94dc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d702805eee6d257f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94ea78f700 1 -- 172.21.15.167:0/2278450478 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94dc0078e0 con 0x564ecfc33920 2023-10-05T19:50:40.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94ea78f700 1 -- 172.21.15.167:0/2278450478 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc007a40 con 0x564ecfc33920 2023-10-05T19:50:40.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94ea78f700 1 -- 172.21.15.167:0/2278450478 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94dc007bd0 con 0x564ecfc33920 2023-10-05T19:50:40.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 -- 172.21.15.167:0/2278450478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 msgr2=0x564ecfc52820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/2278450478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc52820 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94dc000c00 tx=0x7f94dc014000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 -- 172.21.15.167:0/2278450478 shutdown_connections 2023-10-05T19:50:40.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/2278450478 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc52820 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 -- 172.21.15.167:0/2278450478 >> 172.21.15.167:0/2278450478 conn(0x564ecfc2f340 msgr2=0x564ecfc4e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 -- 172.21.15.167:0/2278450478 shutdown_connections 2023-10-05T19:50:40.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 -- 172.21.15.167:0/2278450478 wait complete. 2023-10-05T19:50:40.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 Processor -- start 2023-10-05T19:50:40.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 -- start start 2023-10-05T19:50:40.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc5b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94eec5ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecfad4ed0 con 0x564ecfc33920 2023-10-05T19:50:40.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.332+0000 7f94ec793700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc5b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94ec793700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc5b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45858/0 (socket says 172.21.15.167:45858) 2023-10-05T19:50:40.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 learned_addr learned my addr 172.21.15.167:0/1099932917 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ecfc353e0 con 0x564ecfc33920 2023-10-05T19:50:40.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94ec793700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc5b6e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94dc01f040 tx=0x7f94dc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94e8f8c700 1 -- 172.21.15.167:0/1099932917 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94dc007bb0 con 0x564ecfc33920 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94e8f8c700 1 -- 172.21.15.167:0/1099932917 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc029070 con 0x564ecfc33920 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564ecfc5bc20 con 0x564ecfc33920 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94e8f8c700 1 -- 172.21.15.167:0/1099932917 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94dc012610 con 0x564ecfc33920 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ecfc5c060 con 0x564ecfc33920 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94e8f8c700 1 -- 172.21.15.167:0/1099932917 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f94dc012770 con 0x564ecfc33920 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94e8f8c700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94d0030ca0 0x7f94d0033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94e8f8c700 1 -- 172.21.15.167:0/1099932917 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f94dc02b070 con 0x564ecfc33920 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564ecfc34230 0x564ecfc67120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94ebf92700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94d0030ca0 0x7f94d0033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.336+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc677d0 con 0x564ecfc34230 2023-10-05T19:50:40.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94ecf94700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564ecfc34230 0x564ecfc67120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94ebf92700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94d0030ca0 0x7f94d0033150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f94d40044f0 tx=0x7f94d4006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94ecf94700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564ecfc34230 0x564ecfc67120 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94e400a500 con 0x564ecfc34230 2023-10-05T19:50:40.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 20 realm 2023-10-05T19:50:40.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc64780 con 0x564ecfc34230 2023-10-05T19:50:40.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94e400a500 con 0x564ecfc34230 2023-10-05T19:50:40.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:40.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc682b0 con 0x564ecfc34230 2023-10-05T19:50:40.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94e400a500 con 0x564ecfc34230 2023-10-05T19:50:40.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564ecfc67ee0 0x564ecfc6b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc6b850 con 0x564ecfc67ee0 2023-10-05T19:50:40.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.340+0000 7f94ec793700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564ecfc67ee0 0x564ecfc6b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ec793700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564ecfc67ee0 0x564ecfc6b120 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc6c120 con 0x564ecfc34230 2023-10-05T19:50:40.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f94e400a500 con 0x564ecfc34230 2023-10-05T19:50:40.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:40.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94eec5ee40 20 searching for the correct realm 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564ecfc6bc90 0x564ecfc6fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc6bc90 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ebf92700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564ecfc6bc90 0x564ecfc6fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ebf92700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564ecfc6bc90 0x564ecfc6fef0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d4004520 con 0x564ecfc6bc90 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc67ee0 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ec793700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f94dc007030 0x7f94dc031490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x7f94dc007030 2023-10-05T19:50:40.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.344+0000 7f94ecf94700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f94dc007030 0x7f94dc031490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ecf94700 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f94dc007030 0x7f94dc031490 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x7f94dc007030 2023-10-05T19:50:40.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc6bc90 2023-10-05T19:50:40.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d4004520 con 0x564ecfc6bc90 2023-10-05T19:50:40.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc67ee0 2023-10-05T19:50:40.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc67ee0 2023-10-05T19:50:40.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.348+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x7f94dc007030 2023-10-05T19:50:40.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x7f94dc007030 2023-10-05T19:50:40.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x7f94dc007030 2023-10-05T19:50:40.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x7f94dc007030 2023-10-05T19:50:40.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc67ee0 2023-10-05T19:50:40.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc6bc90 2023-10-05T19:50:40.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d4004520 con 0x564ecfc6bc90 2023-10-05T19:50:40.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc67ee0 2023-10-05T19:50:40.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.352+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc6bc90 2023-10-05T19:50:40.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc6bc90 2023-10-05T19:50:40.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x7f94dc007030 2023-10-05T19:50:40.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x7f94dc007030 2023-10-05T19:50:40.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc34230 2023-10-05T19:50:40.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.356+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x7f94dc007030 2023-10-05T19:50:40.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x7f94dc007030 2023-10-05T19:50:40.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc6bc90 2023-10-05T19:50:40.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x7f94dc007030 2023-10-05T19:50:40.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x7f94dc007030 2023-10-05T19:50:40.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc67ee0 2023-10-05T19:50:40.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc67ee0 2023-10-05T19:50:40.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc704d0 con 0x564ecfc6bc90 2023-10-05T19:50:40.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.360+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f94d4021040 con 0x564ecfc67ee0 2023-10-05T19:50:40.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f94d4021040 con 0x564ecfc67ee0 2023-10-05T19:50:40.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc6cc90 con 0x564ecfc34230 2023-10-05T19:50:40.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc6d610 con 0x564ecfc67ee0 2023-10-05T19:50:40.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc6c880 con 0x564ecfc67ee0 2023-10-05T19:50:40.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.364+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc70e80 con 0x564ecfc6bc90 2023-10-05T19:50:40.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc715e0 con 0x564ecfc67ee0 2023-10-05T19:50:40.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc729a0 con 0x564ecfc6bc90 2023-10-05T19:50:40.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc729a0 con 0x564ecfc67ee0 2023-10-05T19:50:40.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.368+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc729a0 con 0x7f94dc007030 2023-10-05T19:50:40.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x7f94dc007030 2023-10-05T19:50:40.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc6bc90 2023-10-05T19:50:40.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc67ee0 2023-10-05T19:50:40.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.372+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc67ee0 2023-10-05T19:50:40.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x7f94dc007030 2023-10-05T19:50:40.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x7f94dc007030 2023-10-05T19:50:40.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x7f94dc007030 2023-10-05T19:50:40.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x7f94dc007030 2023-10-05T19:50:40.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc67ee0 2023-10-05T19:50:40.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.376+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc6bc90 2023-10-05T19:50:40.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc67ee0 2023-10-05T19:50:40.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc6bc90 2023-10-05T19:50:40.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4014040 con 0x564ecfc34230 2023-10-05T19:50:40.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.380+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc6bc90 2023-10-05T19:50:40.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x7f94dc007030 2023-10-05T19:50:40.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc34230 2023-10-05T19:50:40.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x7f94dc007030 2023-10-05T19:50:40.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc6bc90 2023-10-05T19:50:40.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.384+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x7f94dc007030 2023-10-05T19:50:40.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc67ee0 2023-10-05T19:50:40.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc67ee0 2023-10-05T19:50:40.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc6bc90 2023-10-05T19:50:40.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc67ee0 2023-10-05T19:50:40.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.388+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71230 con 0x564ecfc67ee0 2023-10-05T19:50:40.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71990 con 0x564ecfc67ee0 2023-10-05T19:50:40.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc71d40 con 0x564ecfc34230 2023-10-05T19:50:40.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:40.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc725e0 con 0x564ecfc67ee0 2023-10-05T19:50:40.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.392+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc725e0 con 0x564ecfc67ee0 2023-10-05T19:50:40.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc726e0 con 0x7f94dc007030 2023-10-05T19:50:40.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 zone default found 2023-10-05T19:50:40.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 4 Realm: () 2023-10-05T19:50:40.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:40.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:40.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:40.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 zonegroup default 2023-10-05T19:50:40.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc726e0 con 0x7f94dc007030 2023-10-05T19:50:40.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc74060 con 0x564ecfc6bc90 2023-10-05T19:50:40.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc74410 con 0x564ecfc6bc90 2023-10-05T19:50:40.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 started sync module instance, tier type = 2023-10-05T19:50:40.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:40.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.396+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc73720 con 0x564ecfc67ee0 2023-10-05T19:50:40.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.400+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.400+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94896493376048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc73c40 con 0x564ecfc67ee0 2023-10-05T19:50:40.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.400+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc751a0 con 0x564ecfc34230 2023-10-05T19:50:40.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.404+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.404+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94896493382832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc73710 con 0x564ecfc34230 2023-10-05T19:50:40.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.404+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc75c90 con 0x564ecfc67ee0 2023-10-05T19:50:40.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.404+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94896493376048] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.404+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.404+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94896493381568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc76090 con 0x564ecfc67ee0 2023-10-05T19:50:40.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.404+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc76930 con 0x7f94dc007030 2023-10-05T19:50:40.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.404+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94896493382832] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.408+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.408+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94896493387920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc75220 con 0x7f94dc007030 2023-10-05T19:50:40.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.408+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc77190 con 0x564ecfc67ee0 2023-10-05T19:50:40.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.408+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94896493381568] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.408+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94896493387920] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.408+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.408+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94896493385568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc76c60 con 0x564ecfc67ee0 2023-10-05T19:50:40.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.408+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc77670 con 0x564ecfc6bc90 2023-10-05T19:50:40.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.412+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.412+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94896493392256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc77f10 con 0x564ecfc6bc90 2023-10-05T19:50:40.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.412+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc78960 con 0x564ecfc6bc90 2023-10-05T19:50:40.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.412+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94896493385568] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.412+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94896493392256] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.412+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.412+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94896493389024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc78d60 con 0x564ecfc6bc90 2023-10-05T19:50:40.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.412+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc79600 con 0x7f94dc007030 2023-10-05T19:50:40.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94896493389024] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94896493399392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc796a0 con 0x7f94dc007030 2023-10-05T19:50:40.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 20 add_watcher() i=0 2023-10-05T19:50:40.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 20 add_watcher() i=1 2023-10-05T19:50:40.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 20 add_watcher() i=2 2023-10-05T19:50:40.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 20 add_watcher() i=3 2023-10-05T19:50:40.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 20 add_watcher() i=4 2023-10-05T19:50:40.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 20 add_watcher() i=5 2023-10-05T19:50:40.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 20 add_watcher() i=6 2023-10-05T19:50:40.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94896493399392] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 20 add_watcher() i=7 2023-10-05T19:50:40.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:40.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc7c700 con 0x564ecfc34230 2023-10-05T19:50:40.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.416+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94896493400496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc79af0 con 0x564ecfc34230 2023-10-05T19:50:40.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94896493400496] v30'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94bcff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94eec5ee40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:40.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94eec5ee40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94eec5ee40 1 Processor -- start 2023-10-05T19:50:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94eec5ee40 1 -- start start 2023-10-05T19:50:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94eec5ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc87000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94eec5ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecfc87540 con 0x564ecfc86c30 2023-10-05T19:50:40.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94ebf92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc87000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94ebf92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc87000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45870/0 (socket says 172.21.15.167:45870) 2023-10-05T19:50:40.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94ebf92700 1 -- 172.21.15.167:0/3867212991 learned_addr learned my addr 172.21.15.167:0/3867212991 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94ebf92700 1 -- 172.21.15.167:0/3867212991 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ecfc87680 con 0x564ecfc86c30 2023-10-05T19:50:40.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94ebf92700 1 --2- 172.21.15.167:0/3867212991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc87000 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x564ecfc6c7d0 tx=0x7f94d4006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4365b4fc873cfb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f9437fff700 1 -- 172.21.15.167:0/3867212991 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94d401a040 con 0x564ecfc86c30 2023-10-05T19:50:40.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f9437fff700 1 -- 172.21.15.167:0/3867212991 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d402da30 con 0x564ecfc86c30 2023-10-05T19:50:40.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f9437fff700 1 -- 172.21.15.167:0/3867212991 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94d4004980 con 0x564ecfc86c30 2023-10-05T19:50:40.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3867212991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 msgr2=0x564ecfc87000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.420+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/3867212991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc87000 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x564ecfc6c7d0 tx=0x7f94d4006000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3867212991 shutdown_connections 2023-10-05T19:50:40.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/3867212991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc87000 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3867212991 >> 172.21.15.167:0/3867212991 conn(0x564ecfc81ff0 msgr2=0x564ecfc801a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3867212991 shutdown_connections 2023-10-05T19:50:40.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3867212991 wait complete. 2023-10-05T19:50:40.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 Processor -- start 2023-10-05T19:50:40.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 -- start start 2023-10-05T19:50:40.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc8c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ecfc8d6a0 con 0x564ecfc86c30 2023-10-05T19:50:40.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94ebf92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc8c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94ebf92700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc8c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45880/0 (socket says 172.21.15.167:45880) 2023-10-05T19:50:40.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94ebf92700 1 -- 172.21.15.167:0/3667931012 learned_addr learned my addr 172.21.15.167:0/3667931012 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94ebf92700 1 -- 172.21.15.167:0/3667931012 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc001e10 con 0x564ecfc86c30 2023-10-05T19:50:40.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94ebf92700 1 --2- 172.21.15.167:0/3667931012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc8c6a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f94d40067a0 tx=0x7f94d4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94367fc700 1 -- 172.21.15.167:0/3667931012 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94d401a040 con 0x564ecfc86c30 2023-10-05T19:50:40.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94367fc700 1 -- 172.21.15.167:0/3667931012 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4004330 con 0x564ecfc86c30 2023-10-05T19:50:40.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3667931012 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564ecfc8cca0 con 0x564ecfc86c30 2023-10-05T19:50:40.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94367fc700 1 -- 172.21.15.167:0/3667931012 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94d4014950 con 0x564ecfc86c30 2023-10-05T19:50:40.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.424+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3667931012 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ecfc8d140 con 0x564ecfc86c30 2023-10-05T19:50:40.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.428+0000 7f94367fc700 1 -- 172.21.15.167:0/3667931012 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f94d4014ab0 con 0x564ecfc86c30 2023-10-05T19:50:40.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.428+0000 7f94367fc700 1 --2- 172.21.15.167:0/3667931012 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f942c030cf0 0x7f942c0331a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.428+0000 7f94367fc700 1 -- 172.21.15.167:0/3667931012 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f94d4027040 con 0x564ecfc86c30 2023-10-05T19:50:40.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.428+0000 7f94ecf94700 1 --2- 172.21.15.167:0/3667931012 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f942c030cf0 0x7f942c0331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.428+0000 7f94eec5ee40 5 note: GC not initialized 2023-10-05T19:50:40.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.428+0000 7f94ecf94700 1 --2- 172.21.15.167:0/3667931012 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f942c030cf0 0x7f942c0331a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x564ecfc7c810 tx=0x7f94e400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.428+0000 7f942b7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:40.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94297fa700 20 reqs_thread_entry: start 2023-10-05T19:50:40.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:40.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:40.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94177fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:10 2023 2023-10-05T19:50:40.439 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:40.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f9416ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:40.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 20 get_system_obj_state: rctx=0x7fff45fe1358 obj=default.rgw.meta:root:testx/myfoo state=0x564ecfb0d0b0 s->prefetch_data=0 2023-10-05T19:50:40.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfcf4c30 con 0x564ecfc34230 2023-10-05T19:50:40.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 testx/myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+139 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:40.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfcf76c0 con 0x564ecfc34230 2023-10-05T19:50:40.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 testx/myfoo [call,call out=48b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+316 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 20 rados_obj.operate() r=0 bl.length=193 2023-10-05T19:50:40.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.432+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94896493376048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc490c0 con 0x564ecfc67ee0 2023-10-05T19:50:40.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.436+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94896493376048] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.436+0000 7f94eec5ee40 20 remove_watcher() i=0 2023-10-05T19:50:40.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.436+0000 7f94eec5ee40 2 removed watcher, disabling cache 2023-10-05T19:50:40.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.436+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94896493382832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc490c0 con 0x564ecfc34230 2023-10-05T19:50:40.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.436+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94896493382832] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.436+0000 7f94eec5ee40 20 remove_watcher() i=1 2023-10-05T19:50:40.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.436+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94896493381568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc490c0 con 0x564ecfc67ee0 2023-10-05T19:50:40.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.440+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94896493381568] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.440+0000 7f94eec5ee40 20 remove_watcher() i=2 2023-10-05T19:50:40.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.440+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94896493387920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc490c0 con 0x7f94dc007030 2023-10-05T19:50:40.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.440+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94896493387920] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.440+0000 7f94eec5ee40 20 remove_watcher() i=3 2023-10-05T19:50:40.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.440+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94896493385568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc490c0 con 0x564ecfc67ee0 2023-10-05T19:50:40.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.444+0000 7f94ec793700 1 -- 172.21.15.167:0/1099932917 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94896493385568] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94dc041040 con 0x564ecfc67ee0 2023-10-05T19:50:40.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.444+0000 7f94eec5ee40 20 remove_watcher() i=4 2023-10-05T19:50:40.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.444+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94896493392256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc490c0 con 0x564ecfc6bc90 2023-10-05T19:50:40.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.448+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94896493392256] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.448+0000 7f94eec5ee40 20 remove_watcher() i=5 2023-10-05T19:50:40.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.448+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94896493389024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc490c0 con 0x564ecfc6bc90 2023-10-05T19:50:40.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.448+0000 7f94ebf92700 1 -- 172.21.15.167:0/1099932917 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94896493389024] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94d401d040 con 0x564ecfc6bc90 2023-10-05T19:50:40.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.448+0000 7f94eec5ee40 20 remove_watcher() i=6 2023-10-05T19:50:40.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.448+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94896493399392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc76580 con 0x7f94dc007030 2023-10-05T19:50:40.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.448+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94896493399392] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x7f94dc007030 2023-10-05T19:50:40.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.448+0000 7f94eec5ee40 20 remove_watcher() i=7 2023-10-05T19:50:40.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94bcff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94896493400496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ecfc76580 con 0x564ecfc34230 2023-10-05T19:50:40.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 data_loggenerations_metadata [watch unwatch cookie 94896493400496] v30'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f94e4033040 con 0x564ecfc34230 2023-10-05T19:50:40.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564ecfc67ee0 msgr2=0x564ecfc6b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564ecfc67ee0 0x564ecfc6b120 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564ecfc34230 msgr2=0x564ecfc67120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564ecfc34230 0x564ecfc67120 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f94dc007030 msgr2=0x7f94dc031490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f94dc007030 0x7f94dc031490 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564ecfc6bc90 msgr2=0x564ecfc6fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.452+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564ecfc6bc90 0x564ecfc6fef0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94d0030ca0 msgr2=0x7f94d0033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94d0030ca0 0x7f94d0033150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f94d40044f0 tx=0x7f94d4006690 comp rx=0 tx=0).stop 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94ecf94700 1 -- 172.21.15.167:0/1099932917 reap_dead start 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 msgr2=0x564ecfc5b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc5b6e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94dc01f040 tx=0x7f94dc01c000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 shutdown_connections 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/1099932917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc33920 0x564ecfc5b6e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 >> 172.21.15.167:0/1099932917 conn(0x564ecfc2f340 msgr2=0x564ecfc4ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 shutdown_connections 2023-10-05T19:50:40.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/1099932917 wait complete. 2023-10-05T19:50:40.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3667931012 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f942c030cf0 msgr2=0x7f942c0331a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/3667931012 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f942c030cf0 0x7f942c0331a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x564ecfc7c810 tx=0x7f94e400e040 comp rx=0 tx=0).stop 2023-10-05T19:50:40.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3667931012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 msgr2=0x564ecfc8c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/3667931012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc8c6a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f94d40067a0 tx=0x7f94d4030000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3667931012 shutdown_connections 2023-10-05T19:50:40.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/3667931012 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f942c030cf0 0x7f942c0331a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 --2- 172.21.15.167:0/3667931012 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564ecfc86c30 0x564ecfc8c6a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3667931012 >> 172.21.15.167:0/3667931012 conn(0x564ecfc81ff0 msgr2=0x564ecfc800f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3667931012 shutdown_connections 2023-10-05T19:50:40.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.456+0000 7f94eec5ee40 1 -- 172.21.15.167:0/3667931012 wait complete. 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "bucket:testx/myfoo", 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout: "ver": { 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout: "tag": "7BIXagwobPud1ZhwHQaOJR/8", 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout: "ver": 2 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout: "mtime": "2023-10-05T19:50:40.255039Z", 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout: "data": { 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": { 2023-10-05T19:50:40.467 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "myfoo", 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: "marker": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: "tenant": "testx", 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: "explicit_placement": { 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "", 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "", 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "" 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "testx$tenanteduser", 2023-10-05T19:50:40.468 INFO:teuthology.orchestra.run.smithi167.stdout: "creation_time": "2023-10-05T19:50:36.660701Z", 2023-10-05T19:50:40.469 INFO:teuthology.orchestra.run.smithi167.stdout: "linked": "true", 2023-10-05T19:50:40.469 INFO:teuthology.orchestra.run.smithi167.stdout: "has_bucket_info": "false" 2023-10-05T19:50:40.469 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:40.469 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:40.470 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '7BIXagwobPud1ZhwHQaOJR/8', 'ver': 2}, 'mtime': '2023-10-05T19:50:40.255039Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'bucket_id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2023-10-05T19:50:36.660701Z', 'linked': 'true', 'has_bucket_info': 'false'}} 2023-10-05T19:50:40.470 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2023-10-05T19:50:40.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2023-10-05T19:50:40.470 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2023-10-05T19:50:40.513 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:40.513 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:40.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 Processor -- start 2023-10-05T19:50:40.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 -- start start 2023-10-05T19:50:40.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55fca448eb60 0x55fca448ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fca43d9bd0 con 0x55fca448f470 2023-10-05T19:50:40.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fca4396ee0 con 0x55fca448eb60 2023-10-05T19:50:40.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059d5ec700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55fca448f470 0x55fca448ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51776/0 (socket says 172.21.15.167:51776) 2023-10-05T19:50:40.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059dded700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55fca448eb60 0x55fca448ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059d5ec700 1 -- 172.21.15.167:0/1707201657 learned_addr learned my addr 172.21.15.167:0/1707201657 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:40.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059cdeb700 1 -- 172.21.15.167:0/1707201657 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716125605 0 0) 0x55fca43d9bd0 con 0x55fca448f470 2023-10-05T19:50:40.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059cdeb700 1 -- 172.21.15.167:0/1707201657 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f058c001e10 con 0x55fca448f470 2023-10-05T19:50:40.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059dded700 1 -- 172.21.15.167:0/1707201657 >> v1:172.21.15.118:6789/0 conn(0x55fca448f470 legacy=0x55fca448ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059dded700 1 -- 172.21.15.167:0/1707201657 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca4490610 con 0x55fca448eb60 2023-10-05T19:50:40.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059dded700 1 --2- 172.21.15.167:0/1707201657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca448ef30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f059000a520 tx=0x7f0590005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8db0e6ee7e2452 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059cdeb700 1 -- 172.21.15.167:0/1707201657 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059000f590 con 0x55fca448eb60 2023-10-05T19:50:40.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059cdeb700 1 -- 172.21.15.167:0/1707201657 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059000f6f0 con 0x55fca448eb60 2023-10-05T19:50:40.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f059cdeb700 1 -- 172.21.15.167:0/1707201657 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059000f880 con 0x55fca448eb60 2023-10-05T19:50:40.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1707201657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 msgr2=0x55fca448ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1707201657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca448ef30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f059000a520 tx=0x7f0590005d40 comp rx=0 tx=0).stop 2023-10-05T19:50:40.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1707201657 shutdown_connections 2023-10-05T19:50:40.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1707201657 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca448ef30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1707201657 >> 172.21.15.167:0/1707201657 conn(0x55fca44025d0 msgr2=0x55fca44029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1707201657 shutdown_connections 2023-10-05T19:50:40.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1707201657 wait complete. 2023-10-05T19:50:40.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.508+0000 7f05a02b8e40 1 Processor -- start 2023-10-05T19:50:40.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 -- start start 2023-10-05T19:50:40.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca435ae30 con 0x55fca448eb60 2023-10-05T19:50:40.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f059dded700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f059dded700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45886/0 (socket says 172.21.15.167:45886) 2023-10-05T19:50:40.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f059dded700 1 -- 172.21.15.167:0/3244643987 learned_addr learned my addr 172.21.15.167:0/3244643987 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f059dded700 1 -- 172.21.15.167:0/3244643987 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059000a0e0 con 0x55fca448eb60 2023-10-05T19:50:40.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f059dded700 1 --2- 172.21.15.167:0/3244643987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44ad9e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0590005d80 tx=0x7f0590014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b551c5d7457573 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05977fe700 1 -- 172.21.15.167:0/3244643987 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059000f860 con 0x55fca448eb60 2023-10-05T19:50:40.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05977fe700 1 -- 172.21.15.167:0/3244643987 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059000f9c0 con 0x55fca448eb60 2023-10-05T19:50:40.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05977fe700 1 -- 172.21.15.167:0/3244643987 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059000fb70 con 0x55fca448eb60 2023-10-05T19:50:40.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 -- 172.21.15.167:0/3244643987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 msgr2=0x55fca44ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/3244643987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44ad9e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0590005d80 tx=0x7f0590014000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 -- 172.21.15.167:0/3244643987 shutdown_connections 2023-10-05T19:50:40.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/3244643987 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44ad9e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 -- 172.21.15.167:0/3244643987 >> 172.21.15.167:0/3244643987 conn(0x55fca44025d0 msgr2=0x55fca44a95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 -- 172.21.15.167:0/3244643987 shutdown_connections 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 -- 172.21.15.167:0/3244643987 wait complete. 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 Processor -- start 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 -- start start 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f05a02b8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca432ded0 con 0x55fca448eb60 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f059dded700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f059dded700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45902/0 (socket says 172.21.15.167:45902) 2023-10-05T19:50:40.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.512+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 learned_addr learned my addr 172.21.15.167:0/1394273043 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca4490610 con 0x55fca448eb60 2023-10-05T19:50:40.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f059dded700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44b46e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0590005d80 tx=0x7f059001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f0595ffb700 1 -- 172.21.15.167:0/1394273043 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059002f430 con 0x55fca448eb60 2023-10-05T19:50:40.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f0595ffb700 1 -- 172.21.15.167:0/1394273043 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059002f590 con 0x55fca448eb60 2023-10-05T19:50:40.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fca44b4c20 con 0x55fca448eb60 2023-10-05T19:50:40.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f0595ffb700 1 -- 172.21.15.167:0/1394273043 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f059002f740 con 0x55fca448eb60 2023-10-05T19:50:40.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fca44b50c0 con 0x55fca448eb60 2023-10-05T19:50:40.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f0595ffb700 1 -- 172.21.15.167:0/1394273043 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f0590010420 con 0x55fca448eb60 2023-10-05T19:50:40.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f0595ffb700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0580030ca0 0x7f0580033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f0595ffb700 1 -- 172.21.15.167:0/1394273043 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f059002b070 con 0x55fca448eb60 2023-10-05T19:50:40.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.516+0000 7f059d5ec700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0580030ca0 0x7f0580033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55fca448f470 0x55fca44c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c0820 con 0x55fca448f470 2023-10-05T19:50:40.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f059e5ee700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55fca448f470 0x55fca44c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f059d5ec700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0580030ca0 0x7f0580033150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0588004170 tx=0x7f0588001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f059e5ee700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55fca448f470 0x55fca44c01b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f059800a500 con 0x55fca448f470 2023-10-05T19:50:40.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 20 realm 2023-10-05T19:50:40.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44bd810 con 0x55fca448f470 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f059800a500 con 0x55fca448f470 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c1300 con 0x55fca448f470 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f059800a500 con 0x55fca448f470 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55fca44c2130 0x55fca44c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c4a50 con 0x55fca44c2130 2023-10-05T19:50:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f059dded700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55fca44c2130 0x55fca44c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.520+0000 7f059dded700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55fca44c2130 0x55fca44c4510 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c4f00 con 0x55fca448f470 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f059800a500 con 0x55fca448f470 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f05a02b8e40 20 searching for the correct realm 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55fca44c6e70 0x55fca44c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c6e70 2023-10-05T19:50:40.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059d5ec700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55fca44c6e70 0x55fca44c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059d5ec700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55fca44c6e70 0x55fca44c9280 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588006070 con 0x55fca44c6e70 2023-10-05T19:50:40.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c2130 2023-10-05T19:50:40.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059dded700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0590045040 0x7f05900106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x7f0590045040 2023-10-05T19:50:40.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.524+0000 7f059e5ee700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0590045040 0x7f05900106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059e5ee700 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0590045040 0x7f05900106d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x7f0590045040 2023-10-05T19:50:40.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c6e70 2023-10-05T19:50:40.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588006070 con 0x55fca44c6e70 2023-10-05T19:50:40.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c2130 2023-10-05T19:50:40.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.528+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c2130 2023-10-05T19:50:40.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x7f0590045040 2023-10-05T19:50:40.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x7f0590045040 2023-10-05T19:50:40.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x7f0590045040 2023-10-05T19:50:40.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x7f0590045040 2023-10-05T19:50:40.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c2130 2023-10-05T19:50:40.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.532+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c6e70 2023-10-05T19:50:40.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588006070 con 0x55fca44c6e70 2023-10-05T19:50:40.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c2130 2023-10-05T19:50:40.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c6e70 2023-10-05T19:50:40.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588006070 con 0x55fca44c6e70 2023-10-05T19:50:40.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.536+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c6e70 2023-10-05T19:50:40.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588006070 con 0x55fca44c6e70 2023-10-05T19:50:40.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x7f0590045040 2023-10-05T19:50:40.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x7f0590045040 2023-10-05T19:50:40.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca448f470 2023-10-05T19:50:40.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x7f0590045040 2023-10-05T19:50:40.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x7f0590045040 2023-10-05T19:50:40.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c6e70 2023-10-05T19:50:40.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588006070 con 0x55fca44c6e70 2023-10-05T19:50:40.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x7f0590045040 2023-10-05T19:50:40.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x7f0590045040 2023-10-05T19:50:40.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c2130 2023-10-05T19:50:40.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.540+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c2130 2023-10-05T19:50:40.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c6e70 2023-10-05T19:50:40.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588006070 con 0x55fca44c6e70 2023-10-05T19:50:40.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c2130 2023-10-05T19:50:40.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9890 con 0x55fca44c2130 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f05a02b8e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f05a02b8e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f05a02b8e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f05a02b8e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c5c20 con 0x55fca448f470 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.544+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c6570 con 0x55fca44c2130 2023-10-05T19:50:40.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c9d00 con 0x55fca44c2130 2023-10-05T19:50:40.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca0b0 con 0x55fca44c6e70 2023-10-05T19:50:40.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f0588006070 con 0x55fca44c6e70 2023-10-05T19:50:40.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca448f470 2023-10-05T19:50:40.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44c6140 con 0x55fca44c2130 2023-10-05T19:50:40.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.548+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cbd90 con 0x55fca44c6e70 2023-10-05T19:50:40.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cbd90 con 0x55fca44c2130 2023-10-05T19:50:40.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cbd90 con 0x7f0590045040 2023-10-05T19:50:40.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x7f0590045040 2023-10-05T19:50:40.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca448f470 2023-10-05T19:50:40.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca448f470 2023-10-05T19:50:40.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca44c6e70 2023-10-05T19:50:40.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.552+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca448f470 2023-10-05T19:50:40.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca44c2130 2023-10-05T19:50:40.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca44c2130 2023-10-05T19:50:40.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca448f470 2023-10-05T19:50:40.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x7f0590045040 2023-10-05T19:50:40.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x7f0590045040 2023-10-05T19:50:40.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca448f470 2023-10-05T19:50:40.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.556+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x7f0590045040 2023-10-05T19:50:40.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x7f0590045040 2023-10-05T19:50:40.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca44c2130 2023-10-05T19:50:40.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ca460 con 0x55fca44c6e70 2023-10-05T19:50:40.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca448f470 2023-10-05T19:50:40.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca44c2130 2023-10-05T19:50:40.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca44c6e70 2023-10-05T19:50:40.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.560+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca448f470 2023-10-05T19:50:40.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598014040 con 0x55fca448f470 2023-10-05T19:50:40.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca448f470 2023-10-05T19:50:40.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca448f470 2023-10-05T19:50:40.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca44c6e70 2023-10-05T19:50:40.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x7f0590045040 2023-10-05T19:50:40.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca448f470 2023-10-05T19:50:40.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.564+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x7f0590045040 2023-10-05T19:50:40.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca44c6e70 2023-10-05T19:50:40.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x7f0590045040 2023-10-05T19:50:40.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca44c2130 2023-10-05T19:50:40.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca44c2130 2023-10-05T19:50:40.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca44c6e70 2023-10-05T19:50:40.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.568+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca44c2130 2023-10-05T19:50:40.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0588028040 con 0x55fca44c2130 2023-10-05T19:50:40.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cad80 con 0x55fca44c2130 2023-10-05T19:50:40.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cad80 con 0x55fca448f470 2023-10-05T19:50:40.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:40.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.572+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cb620 con 0x55fca44c2130 2023-10-05T19:50:40.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cb620 con 0x55fca44c2130 2023-10-05T19:50:40.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cb620 con 0x7f0590045040 2023-10-05T19:50:40.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 zone default found 2023-10-05T19:50:40.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 4 Realm: () 2023-10-05T19:50:40.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:40.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:40.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:40.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 zonegroup default 2023-10-05T19:50:40.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cb620 con 0x7f0590045040 2023-10-05T19:50:40.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ccfa0 con 0x55fca44c6e70 2023-10-05T19:50:40.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.576+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cd350 con 0x55fca44c6e70 2023-10-05T19:50:40.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.580+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.580+0000 7f05a02b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.580+0000 7f05a02b8e40 20 started sync module instance, tier type = 2023-10-05T19:50:40.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.580+0000 7f05a02b8e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:40.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.580+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cc6b0 con 0x55fca44c2130 2023-10-05T19:50:40.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.580+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.580+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94543576613312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ccbd0 con 0x55fca44c2130 2023-10-05T19:50:40.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.580+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ce0e0 con 0x55fca448f470 2023-10-05T19:50:40.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.584+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.584+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94543576620016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ccbd0 con 0x55fca448f470 2023-10-05T19:50:40.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.584+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cec20 con 0x55fca44c2130 2023-10-05T19:50:40.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.584+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94543576613312] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.584+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94543576620016] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.584+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.584+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94543576618752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ce730 con 0x55fca44c2130 2023-10-05T19:50:40.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.584+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cefd0 con 0x7f0590045040 2023-10-05T19:50:40.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.588+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.588+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94543576623184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cf190 con 0x7f0590045040 2023-10-05T19:50:40.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.588+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cfd50 con 0x55fca44c2130 2023-10-05T19:50:40.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.588+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94543576618752] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.588+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94543576623184] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.592+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.592+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94543576624288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cf820 con 0x55fca44c2130 2023-10-05T19:50:40.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.592+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44d00c0 con 0x55fca44c6e70 2023-10-05T19:50:40.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.592+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94543576624288] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.592+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.592+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94543576627232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44cfc70 con 0x55fca44c6e70 2023-10-05T19:50:40.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.592+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44d0e50 con 0x55fca44c6e70 2023-10-05T19:50:40.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.592+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94543576627232] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94543576630944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44d16f0 con 0x55fca44c6e70 2023-10-05T19:50:40.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44d1f90 con 0x7f0590045040 2023-10-05T19:50:40.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94543576630944] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0588024040 con 0x55fca44c6e70 2023-10-05T19:50:40.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94543576634416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44d1d70 con 0x7f0590045040 2023-10-05T19:50:40.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 20 add_watcher() i=0 2023-10-05T19:50:40.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 20 add_watcher() i=1 2023-10-05T19:50:40.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 20 add_watcher() i=2 2023-10-05T19:50:40.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 20 add_watcher() i=3 2023-10-05T19:50:40.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 20 add_watcher() i=4 2023-10-05T19:50:40.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 20 add_watcher() i=5 2023-10-05T19:50:40.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 20 add_watcher() i=6 2023-10-05T19:50:40.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94543576634416] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 20 add_watcher() i=7 2023-10-05T19:50:40.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:40.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44d53c0 con 0x55fca448f470 2023-10-05T19:50:40.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.596+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94543576635984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44d27b0 con 0x55fca448f470 2023-10-05T19:50:40.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94543576635984] v30'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f056efe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f05a02b8e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:40.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f05a02b8e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:40.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f05a02b8e40 1 Processor -- start 2023-10-05T19:50:40.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f05a02b8e40 1 -- start start 2023-10-05T19:50:40.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f05a02b8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44dfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f05a02b8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca44e03f0 con 0x55fca44dfae0 2023-10-05T19:50:40.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f059d5ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44dfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f059d5ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44dfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45906/0 (socket says 172.21.15.167:45906) 2023-10-05T19:50:40.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f059d5ec700 1 -- 172.21.15.167:0/275434322 learned_addr learned my addr 172.21.15.167:0/275434322 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.600+0000 7f059d5ec700 1 -- 172.21.15.167:0/275434322 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fca44e0530 con 0x55fca44dfae0 2023-10-05T19:50:40.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f059d5ec700 1 --2- 172.21.15.167:0/275434322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44dfeb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55fca44c5b70 tx=0x7f0588010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0940e4aae1ef2f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f056e7e4700 1 -- 172.21.15.167:0/275434322 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f058803b070 con 0x55fca44dfae0 2023-10-05T19:50:40.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f056e7e4700 1 -- 172.21.15.167:0/275434322 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588022040 con 0x55fca44dfae0 2023-10-05T19:50:40.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f056e7e4700 1 -- 172.21.15.167:0/275434322 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0588021040 con 0x55fca44dfae0 2023-10-05T19:50:40.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 -- 172.21.15.167:0/275434322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 msgr2=0x55fca44dfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/275434322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44dfeb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55fca44c5b70 tx=0x7f0588010000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 -- 172.21.15.167:0/275434322 shutdown_connections 2023-10-05T19:50:40.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/275434322 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44dfeb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 -- 172.21.15.167:0/275434322 >> 172.21.15.167:0/275434322 conn(0x55fca44daea0 msgr2=0x55fca44d8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 -- 172.21.15.167:0/275434322 shutdown_connections 2023-10-05T19:50:40.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 -- 172.21.15.167:0/275434322 wait complete. 2023-10-05T19:50:40.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 Processor -- start 2023-10-05T19:50:40.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 -- start start 2023-10-05T19:50:40.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44e55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f05a02b8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fca44e65b0 con 0x55fca44dfae0 2023-10-05T19:50:40.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f059d5ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44e55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f059d5ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44e55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45916/0 (socket says 172.21.15.167:45916) 2023-10-05T19:50:40.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f059d5ec700 1 -- 172.21.15.167:0/1708347605 learned_addr learned my addr 172.21.15.167:0/1708347605 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.604+0000 7f059d5ec700 1 -- 172.21.15.167:0/1708347605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c001e10 con 0x55fca44dfae0 2023-10-05T19:50:40.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f059d5ec700 1 --2- 172.21.15.167:0/1708347605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44e55b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55fca44d9b60 tx=0x7f0588036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f056cfe1700 1 -- 172.21.15.167:0/1708347605 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0588021050 con 0x55fca44dfae0 2023-10-05T19:50:40.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f056cfe1700 1 -- 172.21.15.167:0/1708347605 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588034650 con 0x55fca44dfae0 2023-10-05T19:50:40.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1708347605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fca44e5bb0 con 0x55fca44dfae0 2023-10-05T19:50:40.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f056cfe1700 1 -- 172.21.15.167:0/1708347605 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0588045070 con 0x55fca44dfae0 2023-10-05T19:50:40.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1708347605 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fca44e6050 con 0x55fca44dfae0 2023-10-05T19:50:40.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f056cfe1700 1 -- 172.21.15.167:0/1708347605 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f058803e070 con 0x55fca44dfae0 2023-10-05T19:50:40.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f056cfe1700 1 --2- 172.21.15.167:0/1708347605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04e4030ca0 0x7f04e4033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f056cfe1700 1 -- 172.21.15.167:0/1708347605 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f058802e040 con 0x55fca44dfae0 2023-10-05T19:50:40.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f059e5ee700 1 --2- 172.21.15.167:0/1708347605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04e4030ca0 0x7f04e4033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f05a02b8e40 5 note: GC not initialized 2023-10-05T19:50:40.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.608+0000 7f059e5ee700 1 --2- 172.21.15.167:0/1708347605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04e4030ca0 0x7f04e4033150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55fca44d1fa0 tx=0x7f059800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f04ddffb700 20 reqs_thread_entry: start 2023-10-05T19:50:40.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:40.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:40.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f04cdffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:10 2023 2023-10-05T19:50:40.620 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:40.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f04cd7fa700 20 reqs_thread_entry: start 2023-10-05T19:50:40.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f04cf7fe700 20 reqs_thread_entry: start 2023-10-05T19:50:40.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 20 get_system_obj_state: rctx=0x7ffd1be53e58 obj=default.rgw.meta:users.uid:foo state=0x55fca43660b0 s->prefetch_data=0 2023-10-05T19:50:40.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:40.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca454de60 con 0x55fca448f470 2023-10-05T19:50:40.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca45508f0 con 0x55fca448f470 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:40.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 20 get_system_obj_state: rctx=0x7ffd1be53200 obj=default.rgw.meta:root:testx/myfoo state=0x55fca43660b0 s->prefetch_data=0 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.612+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca4550100 con 0x55fca448f470 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 testx/myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+139 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x16 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache get: name=default.rgw.meta+root+testx/myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:50:40.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca45522f0 con 0x55fca448f470 2023-10-05T19:50:40.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(105 testx/myfoo [call,call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+241 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=193 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 moving default.rgw.meta+root+testx/myfoo to cache LRU end 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 get_system_obj_state: rctx=0x7ffd1be53200 obj=default.rgw.meta:root:.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x55fca433c2b0 s->prefetch_data=0 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : miss 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 8.8 8:15d87132:root::.bucket.meta.testx%3amyfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca45516d0 con 0x55fca448f470 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(106 .bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=298b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 296+0+362 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x16 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T19:50:40.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.8 8:15d87132:root::.bucket.meta.testx%3amyfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca4554150 con 0x55fca448f470 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(107 .bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv3 ondisk = 0) v8 ==== 338+0+717 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 rados_obj.operate() r=0 bl.length=371 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x13 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 moving default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:40.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 get_system_obj_state: rctx=0x7ffd1be53198 obj=default.rgw.meta:users.uid:foo state=0x55fca433c2b0 s->prefetch_data=0 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x16, cached=0x13) 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca4554880 con 0x55fca448f470 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(108 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x17) 2023-10-05T19:50:40.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.616+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca45568a0 con 0x55fca448f470 2023-10-05T19:50:40.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(109 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca455a030 con 0x55fca448f470 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(110 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [create,call,writefull 0~352,setxattr (123)] v30'6 uv6 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f05a02b8e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x7 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f05a02b8e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f05a02b8e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f05a02b8e40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1, ofs0, ns] 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [notify cookie 94543577194464 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca4558db0 con 0x7f0590045040 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== watch-notify(notify (1) cookie 94543576634416 notify 128849018893 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x7f059803cb20 con 0x7f0590045040 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f0596ffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94543576634416 notifier 4511 bl.length()=701 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f0596ffd700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x7 2023-10-05T19:50:40.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f0596ffd700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:40.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f0596ffd700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:40.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f0596ffd700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f057c003d90 con 0x7f0590045040 2023-10-05T19:50:40.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.620+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.7 [notify cookie 94543577194464 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.624+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(112 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.624+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== watch-notify(notify_complete (2) cookie 94543577194464 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f059803cd50 con 0x7f0590045040 2023-10-05T19:50:40.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.624+0000 7f05a02b8e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_sources= new_sources= 2023-10-05T19:50:40.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.624+0000 7f05a02b8e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential sources added=[] removed=[] 2023-10-05T19:50:40.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.624+0000 7f05a02b8e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_dests= new_dests= 2023-10-05T19:50:40.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.624+0000 7f05a02b8e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential dests added=[] removed=[] 2023-10-05T19:50:40.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.624+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca45578b0 con 0x7f0590045040 2023-10-05T19:50:40.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.624+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(113 foo.buckets [call] v30'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.624+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca45588c0 con 0x7f0590045040 2023-10-05T19:50:40.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(114 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05a02b8e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T19:50:40.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05a02b8e40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:40.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05a02b8e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T19:50:40.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94543577190480 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca45594a0 con 0x55fca44c6e70 2023-10-05T19:50:40.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== watch-notify(notify (1) cookie 94543576630944 notify 128849018890 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x55fca44e6050 con 0x55fca44c6e70 2023-10-05T19:50:40.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05977fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94543576630944 notifier 4511 bl.length()=314 2023-10-05T19:50:40.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05977fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-10-05T19:50:40.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05977fe700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:40.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05977fe700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f04ec003410 con 0x55fca44c6e70 2023-10-05T19:50:40.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(115 notify.6 [notify cookie 94543577190480 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f058803d030 con 0x55fca44c6e70 2023-10-05T19:50:40.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(116 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f058803d030 con 0x55fca44c6e70 2023-10-05T19:50:40.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== watch-notify(notify_complete (2) cookie 94543577190480 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fca44e5bb0 con 0x55fca44c6e70 2023-10-05T19:50:40.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05a02b8e40 10 removing default.rgw.meta+root+testx/myfoo from cache 2023-10-05T19:50:40.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05a02b8e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2023-10-05T19:50:40.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:117 7.d 7:b4812045:::notify.4:head [notify cookie 94543577190480 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca45568a0 con 0x55fca44c2130 2023-10-05T19:50:40.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94543576624288 notify 128849018910 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x55fca44b50c0 con 0x55fca44c2130 2023-10-05T19:50:40.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f0596ffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018910 cookie 94543576624288 notifier 4511 bl.length()=155 2023-10-05T19:50:40.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f0596ffd700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f057c003d90 con 0x55fca44c2130 2023-10-05T19:50:40.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.628+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(117 notify.4 [notify cookie 94543577190480 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(118 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94543577190480 notify 128849018910 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fca44b4c20 con 0x55fca44c2130 2023-10-05T19:50:40.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:119 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca4559540 con 0x55fca448f470 2023-10-05T19:50:40.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(119 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f05a02b8e40 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 from cache 2023-10-05T19:50:40.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f05a02b8e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1, ofs0, ns] 2023-10-05T19:50:40.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94543577160480 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca4559540 con 0x55fca44c6e70 2023-10-05T19:50:40.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== watch-notify(notify (1) cookie 94543576630944 notify 128849018891 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x55fca44e5bb0 con 0x55fca44c6e70 2023-10-05T19:50:40.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f05977fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94543576630944 notifier 4511 bl.length()=212 2023-10-05T19:50:40.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(120 notify.6 [notify cookie 94543577160480 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f058803d030 con 0x55fca44c6e70 2023-10-05T19:50:40.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.632+0000 7f05977fe700 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:121 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f04ec003460 con 0x55fca44c6e70 2023-10-05T19:50:40.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.636+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(121 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f058803d030 con 0x55fca44c6e70 2023-10-05T19:50:40.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.636+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== watch-notify(notify_complete (2) cookie 94543577160480 notify 128849018891 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f058c001e10 con 0x55fca44c6e70 2023-10-05T19:50:40.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.636+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 8.8 8:15d87132:root::.bucket.meta.testx%3amyfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca4559540 con 0x55fca448f470 2023-10-05T19:50:40.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.636+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(122 .bucket.meta.testx:myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,delete] v30'4 uv4 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.636+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94543576613312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44a42c0 con 0x55fca44c2130 2023-10-05T19:50:40.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.640+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(123 notify.0 [watch unwatch cookie 94543576613312] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.640+0000 7f05a02b8e40 20 remove_watcher() i=0 2023-10-05T19:50:40.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.640+0000 7f05a02b8e40 2 removed watcher, disabling cache 2023-10-05T19:50:40.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.640+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:124 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94543576620016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44a42c0 con 0x55fca448f470 2023-10-05T19:50:40.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.640+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 43 ==== osd_op_reply(124 notify.1 [watch unwatch cookie 94543576620016] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.640+0000 7f05a02b8e40 20 remove_watcher() i=1 2023-10-05T19:50:40.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.640+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:125 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94543576618752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44a42c0 con 0x55fca44c2130 2023-10-05T19:50:40.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.644+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(125 notify.2 [watch unwatch cookie 94543576618752] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.644+0000 7f05a02b8e40 20 remove_watcher() i=2 2023-10-05T19:50:40.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.644+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:126 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94543576623184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44a42c0 con 0x7f0590045040 2023-10-05T19:50:40.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.644+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(126 notify.3 [watch unwatch cookie 94543576623184] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.644+0000 7f05a02b8e40 20 remove_watcher() i=3 2023-10-05T19:50:40.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.644+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:127 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94543576624288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44a42c0 con 0x55fca44c2130 2023-10-05T19:50:40.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.648+0000 7f059dded700 1 -- 172.21.15.167:0/1394273043 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(127 notify.4 [watch unwatch cookie 94543576624288] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f05900387a0 con 0x55fca44c2130 2023-10-05T19:50:40.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.648+0000 7f05a02b8e40 20 remove_watcher() i=4 2023-10-05T19:50:40.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.648+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:128 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94543576627232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44ced40 con 0x55fca44c6e70 2023-10-05T19:50:40.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.648+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(128 notify.5 [watch unwatch cookie 94543576627232] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f058803d030 con 0x55fca44c6e70 2023-10-05T19:50:40.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.648+0000 7f05a02b8e40 20 remove_watcher() i=5 2023-10-05T19:50:40.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.648+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:129 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94543576630944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44a42c0 con 0x55fca44c6e70 2023-10-05T19:50:40.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.652+0000 7f059d5ec700 1 -- 172.21.15.167:0/1394273043 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(129 notify.6 [watch unwatch cookie 94543576630944] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f058803d030 con 0x55fca44c6e70 2023-10-05T19:50:40.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.652+0000 7f05a02b8e40 20 remove_watcher() i=6 2023-10-05T19:50:40.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.652+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:130 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94543576634416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44a42c0 con 0x7f0590045040 2023-10-05T19:50:40.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.652+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(130 notify.7 [watch unwatch cookie 94543576634416] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0598033040 con 0x7f0590045040 2023-10-05T19:50:40.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.652+0000 7f05a02b8e40 20 remove_watcher() i=7 2023-10-05T19:50:40.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.656+0000 7f056efe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.656+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:131 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94543576635984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fca44a42c0 con 0x55fca448f470 2023-10-05T19:50:40.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.656+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 <== osd.1 v2:172.21.15.167:6808/26775 44 ==== osd_op_reply(131 data_loggenerations_metadata [watch unwatch cookie 94543576635984] v30'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0598033040 con 0x55fca448f470 2023-10-05T19:50:40.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.656+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55fca44c2130 msgr2=0x55fca44c4510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.656+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55fca44c2130 0x55fca44c4510 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.656+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55fca448f470 msgr2=0x55fca44c01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.656+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55fca448f470 0x55fca44c01b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.656+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0590045040 msgr2=0x7f05900106d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.656+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f0590045040 0x7f05900106d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55fca44c6e70 msgr2=0x55fca44c9280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55fca44c6e70 0x55fca44c9280 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0580030ca0 msgr2=0x7f0580033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0580030ca0 0x7f0580033150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0588004170 tx=0x7f0588001400 comp rx=0 tx=0).stop 2023-10-05T19:50:40.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 msgr2=0x55fca44b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44b46e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0590005d80 tx=0x7f059001d000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f059e5ee700 1 -- 172.21.15.167:0/1394273043 reap_dead start 2023-10-05T19:50:40.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 shutdown_connections 2023-10-05T19:50:40.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1394273043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca448eb60 0x55fca44b46e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 >> 172.21.15.167:0/1394273043 conn(0x55fca44025d0 msgr2=0x55fca44a8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 shutdown_connections 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1394273043 wait complete. 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1708347605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04e4030ca0 msgr2=0x7f04e4033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1708347605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04e4030ca0 0x7f04e4033150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55fca44d1fa0 tx=0x7f059800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1708347605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 msgr2=0x55fca44e55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1708347605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44e55b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55fca44d9b60 tx=0x7f0588036000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1708347605 shutdown_connections 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1708347605 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f04e4030ca0 0x7f04e4033150 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 --2- 172.21.15.167:0/1708347605 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55fca44dfae0 0x55fca44e55b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1708347605 >> 172.21.15.167:0/1708347605 conn(0x55fca44daea0 msgr2=0x55fca44d8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1708347605 shutdown_connections 2023-10-05T19:50:40.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.660+0000 7f05a02b8e40 1 -- 172.21.15.167:0/1708347605 wait complete. 2023-10-05T19:50:40.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-10-05T19:50:40.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-10-05T19:50:40.674 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2023-10-05T19:50:40.716 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:40.716 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:40.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.708+0000 7f13b64e5e40 1 Processor -- start 2023-10-05T19:50:40.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.708+0000 7f13b64e5e40 1 -- start start 2023-10-05T19:50:40.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.708+0000 7f13b64e5e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56371152c120 0x56371152e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.708+0000 7f13b64e5e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563711472bd0 con 0x563711527ba0 2023-10-05T19:50:40.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.708+0000 7f13b64e5e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x56371142fee0 con 0x56371152c120 2023-10-05T19:50:40.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.708+0000 7f13ab819700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56371152c120 0x56371152e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.708+0000 7f13b401a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x563711527ba0 0x563711527f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51778/0 (socket says 172.21.15.167:51778) 2023-10-05T19:50:40.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.708+0000 7f13b401a700 1 -- 172.21.15.167:0/3248371175 learned_addr learned my addr 172.21.15.167:0/3248371175 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:40.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b3819700 1 -- 172.21.15.167:0/3248371175 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820383123 0 0) 0x563711472bd0 con 0x563711527ba0 2023-10-05T19:50:40.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b3819700 1 -- 172.21.15.167:0/3248371175 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a0001e10 con 0x563711527ba0 2023-10-05T19:50:40.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13ab819700 1 -- 172.21.15.167:0/3248371175 >> v1:172.21.15.118:6789/0 conn(0x563711527ba0 legacy=0x563711527f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13ab819700 1 -- 172.21.15.167:0/3248371175 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637115287b0 con 0x56371152c120 2023-10-05T19:50:40.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13ab819700 1 --2- 172.21.15.167:0/3248371175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 0x56371152e500 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f139c00a5d0 tx=0x7f139c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f7b67525fcadee server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b3819700 1 -- 172.21.15.167:0/3248371175 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f139c007610 con 0x56371152c120 2023-10-05T19:50:40.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b3819700 1 -- 172.21.15.167:0/3248371175 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c007770 con 0x56371152c120 2023-10-05T19:50:40.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b3819700 1 -- 172.21.15.167:0/3248371175 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f139c007a40 con 0x56371152c120 2023-10-05T19:50:40.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3248371175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 msgr2=0x56371152e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3248371175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 0x56371152e500 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f139c00a5d0 tx=0x7f139c005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:40.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3248371175 shutdown_connections 2023-10-05T19:50:40.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3248371175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 0x56371152e500 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3248371175 >> 172.21.15.167:0/3248371175 conn(0x56371149b550 msgr2=0x563711525e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3248371175 shutdown_connections 2023-10-05T19:50:40.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3248371175 wait complete. 2023-10-05T19:50:40.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 Processor -- start 2023-10-05T19:50:40.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 -- start start 2023-10-05T19:50:40.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711527ba0 0x563711546a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b64e5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637113f3e30 con 0x563711527ba0 2023-10-05T19:50:40.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.712+0000 7f13b401a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711527ba0 0x563711546a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b401a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711527ba0 0x563711546a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45934/0 (socket says 172.21.15.167:45934) 2023-10-05T19:50:40.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b401a700 1 -- 172.21.15.167:0/3686067968 learned_addr learned my addr 172.21.15.167:0/3686067968 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b401a700 1 -- 172.21.15.167:0/3686067968 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c005cf0 con 0x563711527ba0 2023-10-05T19:50:40.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b401a700 1 --2- 172.21.15.167:0/3686067968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711527ba0 0x563711546a60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f13a4001c70 tx=0x7f13a4001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a651baaae627ec93 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b2817700 1 -- 172.21.15.167:0/3686067968 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a400bbf0 con 0x563711527ba0 2023-10-05T19:50:40.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b2817700 1 -- 172.21.15.167:0/3686067968 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a400bd70 con 0x563711527ba0 2023-10-05T19:50:40.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b2817700 1 -- 172.21.15.167:0/3686067968 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a400e5f0 con 0x563711527ba0 2023-10-05T19:50:40.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3686067968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711527ba0 msgr2=0x563711546a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3686067968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711527ba0 0x563711546a60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f13a4001c70 tx=0x7f13a4001820 comp rx=0 tx=0).stop 2023-10-05T19:50:40.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3686067968 shutdown_connections 2023-10-05T19:50:40.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3686067968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711527ba0 0x563711546a60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3686067968 >> 172.21.15.167:0/3686067968 conn(0x56371149b550 msgr2=0x563711542620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3686067968 shutdown_connections 2023-10-05T19:50:40.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3686067968 wait complete. 2023-10-05T19:50:40.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 Processor -- start 2023-10-05T19:50:40.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 -- start start 2023-10-05T19:50:40.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 0x56371154d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637113c6ed0 con 0x56371152c120 2023-10-05T19:50:40.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b401a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 0x56371154d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b401a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 0x56371154d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45938/0 (socket says 172.21.15.167:45938) 2023-10-05T19:50:40.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 learned_addr learned my addr 172.21.15.167:0/2800735660 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a0001e10 con 0x56371152c120 2023-10-05T19:50:40.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b401a700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 0x56371154d9c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f13a4010000 tx=0x7f13a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b1014700 1 -- 172.21.15.167:0/2800735660 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a401f070 con 0x56371152c120 2023-10-05T19:50:40.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b1014700 1 -- 172.21.15.167:0/2800735660 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a4018640 con 0x56371152c120 2023-10-05T19:50:40.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56371154df00 con 0x56371152c120 2023-10-05T19:50:40.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.716+0000 7f13b1014700 1 -- 172.21.15.167:0/2800735660 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13a4018930 con 0x56371152c120 2023-10-05T19:50:40.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56371154e340 con 0x56371152c120 2023-10-05T19:50:40.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b1014700 1 -- 172.21.15.167:0/2800735660 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f13a4018a90 con 0x56371152c120 2023-10-05T19:50:40.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b1014700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1394030c00 0x7f13940330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b1014700 1 -- 172.21.15.167:0/2800735660 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f13a4044f80 con 0x56371152c120 2023-10-05T19:50:40.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13ab819700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1394030c00 0x7f13940330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13ab819700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1394030c00 0x7f13940330b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f139c00afd0 tx=0x7f139c014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711557340 0x563711559750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711559e80 con 0x563711557340 2023-10-05T19:50:40.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b481b700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711557340 0x563711559750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b481b700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711557340 0x563711559750 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.720+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 realm 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711556960 con 0x563711557340 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371155a960 con 0x563711557340 2023-10-05T19:50:40.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371155b790 0x56371155db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371155e0b0 con 0x56371155b790 2023-10-05T19:50:40.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b401a700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371155b790 0x56371155db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b401a700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371155b790 0x56371155db70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371155e950 con 0x563711557340 2023-10-05T19:50:40.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:40.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 20 searching for the correct realm 2023-10-05T19:50:40.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563711560710 0x563711562af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711560710 2023-10-05T19:50:40.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.724+0000 7f13ab819700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563711560710 0x563711562af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13ab819700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563711560710 0x563711562af0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c007da0 con 0x563711560710 2023-10-05T19:50:40.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x56371155b790 2023-10-05T19:50:40.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b401a700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563711527ba0 0x7f13a40420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711527ba0 2023-10-05T19:50:40.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b481b700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563711527ba0 0x7f13a40420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b481b700 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563711527ba0 0x7f13a40420c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.728+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711560710 2023-10-05T19:50:40.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x56371155b790 2023-10-05T19:50:40.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x56371155b790 2023-10-05T19:50:40.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711527ba0 2023-10-05T19:50:40.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.732+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711527ba0 2023-10-05T19:50:40.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x56371155b790 2023-10-05T19:50:40.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711560710 2023-10-05T19:50:40.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x56371155b790 2023-10-05T19:50:40.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.736+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711560710 2023-10-05T19:50:40.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711560710 2023-10-05T19:50:40.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711527ba0 2023-10-05T19:50:40.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711557340 2023-10-05T19:50:40.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711527ba0 2023-10-05T19:50:40.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.740+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711560710 2023-10-05T19:50:40.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711527ba0 2023-10-05T19:50:40.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x56371155b790 2023-10-05T19:50:40.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x56371155b790 2023-10-05T19:50:40.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x563711560710 2023-10-05T19:50:40.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x56371155b790 2023-10-05T19:50:40.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.744+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563030 con 0x56371155b790 2023-10-05T19:50:40.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371155f4c0 con 0x563711557340 2023-10-05T19:50:40.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371155fe10 con 0x56371155b790 2023-10-05T19:50:40.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115633e0 con 0x56371155b790 2023-10-05T19:50:40.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563790 con 0x563711560710 2023-10-05T19:50:40.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.748+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711563b40 con 0x563711557340 2023-10-05T19:50:40.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371155f980 con 0x56371155b790 2023-10-05T19:50:40.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711560710 2023-10-05T19:50:40.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x56371155b790 2023-10-05T19:50:40.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711527ba0 2023-10-05T19:50:40.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.752+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711560710 2023-10-05T19:50:40.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x56371155b790 2023-10-05T19:50:40.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x56371155b790 2023-10-05T19:50:40.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711527ba0 2023-10-05T19:50:40.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.756+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711527ba0 2023-10-05T19:50:40.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x56371155b790 2023-10-05T19:50:40.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711560710 2023-10-05T19:50:40.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x56371155b790 2023-10-05T19:50:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.760+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711560710 2023-10-05T19:50:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711560710 2023-10-05T19:50:40.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711527ba0 2023-10-05T19:50:40.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711557340 2023-10-05T19:50:40.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.764+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711527ba0 2023-10-05T19:50:40.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711560710 2023-10-05T19:50:40.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711527ba0 2023-10-05T19:50:40.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x56371155b790 2023-10-05T19:50:40.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x56371155b790 2023-10-05T19:50:40.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.768+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x563711560710 2023-10-05T19:50:40.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x56371155b790 2023-10-05T19:50:40.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115653f0 con 0x56371155b790 2023-10-05T19:50:40.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:40.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:40.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:40.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:40.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115643e0 con 0x56371155b790 2023-10-05T19:50:40.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711564790 con 0x563711557340 2023-10-05T19:50:40.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:40.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.772+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115657f0 con 0x56371155b790 2023-10-05T19:50:40.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:40.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115657f0 con 0x56371155b790 2023-10-05T19:50:40.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:40.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115657f0 con 0x563711527ba0 2023-10-05T19:50:40.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 zone default found 2023-10-05T19:50:40.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 4 Realm: () 2023-10-05T19:50:40.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 zonegroup default 2023-10-05T19:50:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115657f0 con 0x563711527ba0 2023-10-05T19:50:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711567170 con 0x563711560710 2023-10-05T19:50:40.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.776+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711567520 con 0x563711560710 2023-10-05T19:50:40.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.780+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.780+0000 7f13b64e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:40.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.780+0000 7f13b64e5e40 20 started sync module instance, tier type = 2023-10-05T19:50:40.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.780+0000 7f13b64e5e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:40.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.780+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711566650 con 0x56371155b790 2023-10-05T19:50:40.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.780+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.780+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94794514066288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711566650 con 0x56371155b790 2023-10-05T19:50:40.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.780+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711567dc0 con 0x563711557340 2023-10-05T19:50:40.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.784+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.784+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94794514066288] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.784+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94794514064000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711567dc0 con 0x563711557340 2023-10-05T19:50:40.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.784+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711568660 con 0x56371155b790 2023-10-05T19:50:40.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.784+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94794514064000] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.784+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.784+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94794514070000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711568330 con 0x56371155b790 2023-10-05T19:50:40.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.784+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711568da0 con 0x563711527ba0 2023-10-05T19:50:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.788+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94794514070000] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.788+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.788+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94794514074064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711568330 con 0x563711527ba0 2023-10-05T19:50:40.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.788+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711569690 con 0x56371155b790 2023-10-05T19:50:40.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.788+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94794514074064] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94794514076624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711568330 con 0x56371155b790 2023-10-05T19:50:40.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371156a0f0 con 0x563711560710 2023-10-05T19:50:40.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94794514078720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371156a990 con 0x563711560710 2023-10-05T19:50:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371156b3a0 con 0x563711560710 2023-10-05T19:50:40.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94794514076624] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4014070 con 0x56371155b790 2023-10-05T19:50:40.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94794514078720] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94794514071104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371156b7a0 con 0x563711560710 2023-10-05T19:50:40.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.792+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371156c040 con 0x563711527ba0 2023-10-05T19:50:40.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94794514071104] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f139c01f480 con 0x563711560710 2023-10-05T19:50:40.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94794514086736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371156c490 con 0x563711527ba0 2023-10-05T19:50:40.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 20 add_watcher() i=0 2023-10-05T19:50:40.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 20 add_watcher() i=1 2023-10-05T19:50:40.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 20 add_watcher() i=2 2023-10-05T19:50:40.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 20 add_watcher() i=3 2023-10-05T19:50:40.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 20 add_watcher() i=4 2023-10-05T19:50:40.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 20 add_watcher() i=5 2023-10-05T19:50:40.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 20 add_watcher() i=6 2023-10-05T19:50:40.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94794514086736] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711527ba0 2023-10-05T19:50:40.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 20 add_watcher() i=7 2023-10-05T19:50:40.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:40.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371156f500 con 0x563711557340 2023-10-05T19:50:40.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.796+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94794514087840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371156caf0 con 0x563711557340 2023-10-05T19:50:40.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94794514087840] v30'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f13ac00a5a0 con 0x563711557340 2023-10-05T19:50:40.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f1385fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13b64e5e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:40.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13b64e5e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:40.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13b64e5e40 1 Processor -- start 2023-10-05T19:50:40.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13b64e5e40 1 -- start start 2023-10-05T19:50:40.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13b64e5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13b64e5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56371157a600 con 0x563711579cf0 2023-10-05T19:50:40.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13ab819700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13ab819700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45948/0 (socket says 172.21.15.167:45948) 2023-10-05T19:50:40.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13ab819700 1 -- 172.21.15.167:0/3201045720 learned_addr learned my addr 172.21.15.167:0/3201045720 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13ab819700 1 -- 172.21.15.167:0/3201045720 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56371157a740 con 0x563711579cf0 2023-10-05T19:50:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13ab819700 1 --2- 172.21.15.167:0/3201045720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157a0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x563711528bc0 tx=0x7f139c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fe905217715a77 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.800+0000 7f13857e2700 1 -- 172.21.15.167:0/3201045720 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f139c025040 con 0x563711579cf0 2023-10-05T19:50:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13857e2700 1 -- 172.21.15.167:0/3201045720 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c031040 con 0x563711579cf0 2023-10-05T19:50:40.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13857e2700 1 -- 172.21.15.167:0/3201045720 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f139c02b8a0 con 0x563711579cf0 2023-10-05T19:50:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3201045720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 msgr2=0x56371157a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3201045720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157a0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x563711528bc0 tx=0x7f139c011000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3201045720 shutdown_connections 2023-10-05T19:50:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3201045720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157a0c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3201045720 >> 172.21.15.167:0/3201045720 conn(0x5637115750b0 msgr2=0x563711573200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3201045720 shutdown_connections 2023-10-05T19:50:40.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3201045720 wait complete. 2023-10-05T19:50:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 Processor -- start 2023-10-05T19:50:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 -- start start 2023-10-05T19:50:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13b64e5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563711580710 con 0x563711579cf0 2023-10-05T19:50:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13ab819700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13ab819700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45964/0 (socket says 172.21.15.167:45964) 2023-10-05T19:50:40.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13ab819700 1 -- 172.21.15.167:0/3386129762 learned_addr learned my addr 172.21.15.167:0/3386129762 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13ab819700 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637115287b0 con 0x563711579cf0 2023-10-05T19:50:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f13ab819700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157f710 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x563711573d70 tx=0x7f139c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.804+0000 7f12ff7fe700 1 -- 172.21.15.167:0/3386129762 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f139c025040 con 0x563711579cf0 2023-10-05T19:50:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f12ff7fe700 1 -- 172.21.15.167:0/3386129762 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c043070 con 0x563711579cf0 2023-10-05T19:50:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56371157fd10 con 0x563711579cf0 2023-10-05T19:50:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f12ff7fe700 1 -- 172.21.15.167:0/3386129762 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f139c037c20 con 0x563711579cf0 2023-10-05T19:50:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563711580150 con 0x563711579cf0 2023-10-05T19:50:40.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f12ff7fe700 1 -- 172.21.15.167:0/3386129762 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f139c028040 con 0x563711579cf0 2023-10-05T19:50:40.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f12ff7fe700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f12f4030c50 0x7f12f4033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f12ff7fe700 1 -- 172.21.15.167:0/3386129762 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f139c045070 con 0x563711579cf0 2023-10-05T19:50:40.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f13b481b700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f12f4030c50 0x7f12f4033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371158a3c0 0x56371158c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371158ce20 con 0x56371158a3c0 2023-10-05T19:50:40.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f13b401a700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371158a3c0 0x56371158c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f13b481b700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f12f4030c50 0x7f12f4033100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x56371156ca50 tx=0x7f13ac00d630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.808+0000 7f13b401a700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371158a3c0 0x56371158c7d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.812+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f13a4014070 con 0x56371158a3c0 2023-10-05T19:50:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.812+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56371158daf0 0x56371158fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.812+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711590600 con 0x56371158daf0 2023-10-05T19:50:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.812+0000 7f13ab819700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56371158daf0 0x56371158fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.812+0000 7f13ab819700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56371158daf0 0x56371158fed0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.812+0000 7f13ab819700 1 -- 172.21.15.167:0/3386129762 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f139c03d020 con 0x56371158daf0 2023-10-05T19:50:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.812+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5637115912d0 0x5637115936e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.812+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711593e10 con 0x5637115912d0 2023-10-05T19:50:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.816+0000 7f13b481b700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5637115912d0 0x5637115936e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.816+0000 7f13b481b700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5637115912d0 0x5637115936e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.816+0000 7f13b481b700 1 -- 172.21.15.167:0/3386129762 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x5637115912d0 2023-10-05T19:50:40.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.816+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711594b20 0x563711596f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:40.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.816+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711597630 con 0x563711594b20 2023-10-05T19:50:40.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.816+0000 7f13b401a700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711594b20 0x563711596f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:40.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.816+0000 7f13b401a700 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711594b20 0x563711596f00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:40.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.820+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'135 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x563711594b20 2023-10-05T19:50:40.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.820+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711597c80 con 0x56371158a3c0 2023-10-05T19:50:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.820+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'40 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.820+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115982a0 con 0x5637115912d0 2023-10-05T19:50:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.824+0000 7f13b481b700 1 -- 172.21.15.167:0/3386129762 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x5637115912d0 2023-10-05T19:50:40.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.824+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115988c0 con 0x56371158a3c0 2023-10-05T19:50:40.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.824+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.828+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115988c0 con 0x563711594b20 2023-10-05T19:50:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.828+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x563711594b20 2023-10-05T19:50:40.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.828+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115988c0 con 0x56371158a3c0 2023-10-05T19:50:40.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.832+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.832+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115988c0 con 0x56371158a3c0 2023-10-05T19:50:40.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.832+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.832+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115988c0 con 0x56371158a3c0 2023-10-05T19:50:40.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.836+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'41 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.836+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115988c0 con 0x5637115912d0 2023-10-05T19:50:40.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.836+0000 7f13b481b700 1 -- 172.21.15.167:0/3386129762 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x5637115912d0 2023-10-05T19:50:40.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.836+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711598b40 con 0x56371158a3c0 2023-10-05T19:50:40.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.840+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.840+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711598b10 con 0x563711594b20 2023-10-05T19:50:40.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.840+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'34 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x563711594b20 2023-10-05T19:50:40.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.840+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711598b10 con 0x563711594b20 2023-10-05T19:50:40.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.844+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'136 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x563711594b20 2023-10-05T19:50:40.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.844+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711598b10 con 0x56371158a3c0 2023-10-05T19:50:40.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.844+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.848+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711598b10 con 0x56371158a3c0 2023-10-05T19:50:40.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.848+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'42 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.848+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711598b10 con 0x5637115912d0 2023-10-05T19:50:40.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.852+0000 7f13b481b700 1 -- 172.21.15.167:0/3386129762 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x5637115912d0 2023-10-05T19:50:40.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.852+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711598ba0 con 0x56371158a3c0 2023-10-05T19:50:40.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.852+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.852+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x563711594b20 2023-10-05T19:50:40.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.856+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'137 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x563711594b20 2023-10-05T19:50:40.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.856+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x56371158a3c0 2023-10-05T19:50:40.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.856+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.856+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x56371158a3c0 2023-10-05T19:50:40.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.860+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.860+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x5637115912d0 2023-10-05T19:50:40.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.864+0000 7f13b481b700 1 -- 172.21.15.167:0/3386129762 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x5637115912d0 2023-10-05T19:50:40.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.864+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x56371158a3c0 2023-10-05T19:50:40.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.864+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.864+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x5637115912d0 2023-10-05T19:50:40.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.868+0000 7f13b481b700 1 -- 172.21.15.167:0/3386129762 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x5637115912d0 2023-10-05T19:50:40.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.868+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x5637115912d0 2023-10-05T19:50:40.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.868+0000 7f13b481b700 1 -- 172.21.15.167:0/3386129762 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'29 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x5637115912d0 2023-10-05T19:50:40.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.868+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x5637115912d0 2023-10-05T19:50:40.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.872+0000 7f13b481b700 1 -- 172.21.15.167:0/3386129762 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x5637115912d0 2023-10-05T19:50:40.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.872+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x56371158a3c0 2023-10-05T19:50:40.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.876+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.876+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711599090 con 0x563711594b20 2023-10-05T19:50:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.876+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'27 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x563711594b20 2023-10-05T19:50:40.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.876+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711598cf0 con 0x56371158a3c0 2023-10-05T19:50:40.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.880+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371158a3c0 2023-10-05T19:50:40.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.880+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711588d90 con 0x563711594b20 2023-10-05T19:50:40.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.880+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'35 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x563711594b20 2023-10-05T19:50:40.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.880+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711588d90 con 0x56371158daf0 2023-10-05T19:50:40.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.884+0000 7f13ab819700 1 -- 172.21.15.167:0/3386129762 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f139c03d020 con 0x56371158daf0 2023-10-05T19:50:40.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f12fcff9700 20 reqs_thread_entry: start 2023-10-05T19:50:40.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f12f27fc700 20 reqs_thread_entry: start 2023-10-05T19:50:40.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:40.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:40.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f12f0ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:11 2023 2023-10-05T19:50:40.896 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:40.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 20 get_system_obj_state: rctx=0x7fff2e6c7dc8 obj=default.rgw.meta:users.uid:testx$tenanteduser state=0x5637113ff0b0 s->prefetch_data=0 2023-10-05T19:50:40.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2023-10-05T19:50:40.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115f7cc0 con 0x563711560710 2023-10-05T19:50:40.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f12d7fff700 20 reqs_thread_entry: start 2023-10-05T19:50:40.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(102 testx$tenanteduser [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+139 (crc 0 0 0) 0x7f139c03d020 con 0x563711560710 2023-10-05T19:50:40.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x16 2023-10-05T19:50:40.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T19:50:40.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:40.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:40.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:40.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:40.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:103 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115fa750 con 0x563711560710 2023-10-05T19:50:40.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(103 testx$tenanteduser [call,call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 288+0+508 (crc 0 0 0) 0x7f139c03d020 con 0x563711560710 2023-10-05T19:50:40.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T19:50:40.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2023-10-05T19:50:40.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-10-05T19:50:40.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.888+0000 7f13b64e5e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:40.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115fa750 con 0x563711557340 2023-10-05T19:50:40.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7f13ac03d050 con 0x563711557340 2023-10-05T19:50:40.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b64e5e40 10 removing key index: p5YnriCv1nAtykxBrupQ 2023-10-05T19:50:40.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b64e5e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T19:50:40.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [notify cookie 94794514666064 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115fa6b0 con 0x56371155b790 2023-10-05T19:50:40.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94794514070000 notify 128849018911 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f13a403dcc0 con 0x56371155b790 2023-10-05T19:50:40.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b2016700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018911 cookie 94794514070000 notifier 4517 bl.length()=170 2023-10-05T19:50:40.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.2 [notify cookie 94794514666064 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f13a4068040 con 0x56371155b790 2023-10-05T19:50:40.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b2016700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1398003c50 con 0x56371155b790 2023-10-05T19:50:40.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371155b790 2023-10-05T19:50:40.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94794514666064 notify 128849018911 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f13a403fe70 con 0x56371155b790 2023-10-05T19:50:40.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.892+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115f8730 con 0x563711560710 2023-10-05T19:50:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f139c03d020 con 0x563711560710 2023-10-05T19:50:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b64e5e40 10 removing email index: 2023-10-05T19:50:40.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b64e5e40 10 removing user buckets index 2023-10-05T19:50:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b64e5e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2023-10-05T19:50:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [notify cookie 94794514666064 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115fa6b0 con 0x56371155b790 2023-10-05T19:50:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== watch-notify(notify (1) cookie 94794514076624 notify 128849018912 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x7f13a403fe70 con 0x56371155b790 2023-10-05T19:50:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b2016700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018912 cookie 94794514076624 notifier 4517 bl.length()=175 2023-10-05T19:50:40.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b2016700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1398003c50 con 0x56371155b790 2023-10-05T19:50:40.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(108 notify.4 [notify cookie 94794514666064 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f13a4068040 con 0x56371155b790 2023-10-05T19:50:40.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== watch-notify(notify_complete (2) cookie 94794514666064 notify 128849018912 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56371154e340 con 0x56371155b790 2023-10-05T19:50:40.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(109 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371155b790 2023-10-05T19:50:40.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.896+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115f8730 con 0x563711557340 2023-10-05T19:50:40.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x563711557340 2023-10-05T19:50:40.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b64e5e40 10 removing user index: testx$tenanteduser 2023-10-05T19:50:40.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b64e5e40 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2023-10-05T19:50:40.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b64e5e40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2023-10-05T19:50:40.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.e 7:7759931f:::notify.3:head [notify cookie 94794514661952 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115f9b90 con 0x563711527ba0 2023-10-05T19:50:40.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== watch-notify(notify (1) cookie 94794514074064 notify 128849018894 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x7f13ac00dcf0 con 0x563711527ba0 2023-10-05T19:50:40.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(111 notify.3 [notify cookie 94794514661952 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f13ac03d050 con 0x563711527ba0 2023-10-05T19:50:40.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b2817700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94794514074064 notifier 4517 bl.length()=167 2023-10-05T19:50:40.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b2817700 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1304003270 con 0x563711527ba0 2023-10-05T19:50:40.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== watch-notify(notify_complete (2) cookie 94794514661952 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f13ac00de80 con 0x563711527ba0 2023-10-05T19:50:40.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(112 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x563711527ba0 2023-10-05T19:50:40.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.900+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5637115fa4b0 con 0x563711560710 2023-10-05T19:50:40.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.904+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(113 testx$tenanteduser [call,delete] v30'8 uv8 ondisk = 0) v8 ==== 204+0+0 (crc 0 0 0) 0x7f139c03d020 con 0x563711560710 2023-10-05T19:50:40.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.904+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94794514066288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371153d340 con 0x56371155b790 2023-10-05T19:50:40.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.904+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(114 notify.0 [watch unwatch cookie 94794514066288] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371155b790 2023-10-05T19:50:40.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.904+0000 7f13b64e5e40 20 remove_watcher() i=0 2023-10-05T19:50:40.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.908+0000 7f13b64e5e40 2 removed watcher, disabling cache 2023-10-05T19:50:40.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.908+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94794514064000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371153d340 con 0x563711557340 2023-10-05T19:50:40.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.908+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(115 notify.1 [watch unwatch cookie 94794514064000] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x563711557340 2023-10-05T19:50:40.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.908+0000 7f13b64e5e40 20 remove_watcher() i=1 2023-10-05T19:50:40.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.908+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94794514070000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371153d340 con 0x56371155b790 2023-10-05T19:50:40.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.912+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(116 notify.2 [watch unwatch cookie 94794514070000] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371155b790 2023-10-05T19:50:40.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.912+0000 7f13b64e5e40 20 remove_watcher() i=2 2023-10-05T19:50:40.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.912+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94794514074064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371153d340 con 0x563711527ba0 2023-10-05T19:50:40.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.912+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(117 notify.3 [watch unwatch cookie 94794514074064] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x563711527ba0 2023-10-05T19:50:40.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.912+0000 7f13b64e5e40 20 remove_watcher() i=3 2023-10-05T19:50:40.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.912+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:118 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94794514076624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371153d340 con 0x56371155b790 2023-10-05T19:50:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.916+0000 7f13b401a700 1 -- 172.21.15.167:0/2800735660 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(118 notify.4 [watch unwatch cookie 94794514076624] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13a4068040 con 0x56371155b790 2023-10-05T19:50:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.916+0000 7f13b64e5e40 20 remove_watcher() i=4 2023-10-05T19:50:40.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.916+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:119 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94794514078720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371153d340 con 0x563711560710 2023-10-05T19:50:40.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.916+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(119 notify.5 [watch unwatch cookie 94794514078720] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f139c03d020 con 0x563711560710 2023-10-05T19:50:40.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.916+0000 7f13b64e5e40 20 remove_watcher() i=5 2023-10-05T19:50:40.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.916+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94794514071104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371153d340 con 0x563711560710 2023-10-05T19:50:40.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.920+0000 7f13ab819700 1 -- 172.21.15.167:0/2800735660 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(120 notify.6 [watch unwatch cookie 94794514071104] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f139c03d020 con 0x563711560710 2023-10-05T19:50:40.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.920+0000 7f13b64e5e40 20 remove_watcher() i=6 2023-10-05T19:50:40.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.920+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:121 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94794514086736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563711567ee0 con 0x563711527ba0 2023-10-05T19:50:40.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.920+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(121 notify.7 [watch unwatch cookie 94794514086736] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x563711527ba0 2023-10-05T19:50:40.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.920+0000 7f13b64e5e40 20 remove_watcher() i=7 2023-10-05T19:50:40.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f1385fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:40.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94794514087840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56371153d340 con 0x563711557340 2023-10-05T19:50:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(122 data_loggenerations_metadata [watch unwatch cookie 94794514087840] v30'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f13ac03d050 con 0x563711557340 2023-10-05T19:50:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371155b790 msgr2=0x56371155db70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371155b790 0x56371155db70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711557340 msgr2=0x563711559750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711557340 0x563711559750 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563711527ba0 msgr2=0x7f13a40420c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563711527ba0 0x7f13a40420c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563711560710 msgr2=0x563711562af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563711560710 0x563711562af0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1394030c00 msgr2=0x7f13940330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1394030c00 0x7f13940330b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f139c00afd0 tx=0x7f139c014000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 msgr2=0x56371154d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b481b700 1 -- 172.21.15.167:0/2800735660 reap_dead start 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 0x56371154d9c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f13a4010000 tx=0x7f13a4016000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 shutdown_connections 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/2800735660 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56371152c120 0x56371154d9c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 >> 172.21.15.167:0/2800735660 conn(0x56371149b550 msgr2=0x5637115410a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 shutdown_connections 2023-10-05T19:50:40.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.924+0000 7f13b64e5e40 1 -- 172.21.15.167:0/2800735660 wait complete. 2023-10-05T19:50:40.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371158a3c0 msgr2=0x56371158c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56371158a3c0 0x56371158c7d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711594b20 msgr2=0x563711596f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563711594b20 0x563711596f00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56371158daf0 msgr2=0x56371158fed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56371158daf0 0x56371158fed0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5637115912d0 msgr2=0x5637115936e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5637115912d0 0x5637115936e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f12f4030c50 msgr2=0x7f12f4033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f12f4030c50 0x7f12f4033100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x56371156ca50 tx=0x7f13ac00d630 comp rx=0 tx=0).stop 2023-10-05T19:50:40.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 msgr2=0x56371157f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:40.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 --2- 172.21.15.167:0/3386129762 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563711579cf0 0x56371157f710 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x563711573d70 tx=0x7f139c036000 comp rx=0 tx=0).stop 2023-10-05T19:50:40.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b401a700 1 -- 172.21.15.167:0/3386129762 reap_dead start 2023-10-05T19:50:40.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 shutdown_connections 2023-10-05T19:50:40.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 >> 172.21.15.167:0/3386129762 conn(0x5637115750b0 msgr2=0x563711573150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:40.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 shutdown_connections 2023-10-05T19:50:40.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:40.928+0000 7f13b64e5e40 1 -- 172.21.15.167:0/3386129762 wait complete. 2023-10-05T19:50:40.950 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2023-10-05T19:50:40.955 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2023-10-05T19:50:41.003 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:41.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2023-10-05T19:50:41.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2023-10-05T19:50:41.003 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2023-10-05T19:50:41.047 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:41.047 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:41.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203f7ace40 1 Processor -- start 2023-10-05T19:50:41.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203f7ace40 1 -- start start 2023-10-05T19:50:41.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203f7ace40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56221d707830 0x56221d707c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203f7ace40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56221d655bd0 con 0x56221d708140 2023-10-05T19:50:41.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203f7ace40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x56221d612ee0 con 0x56221d707830 2023-10-05T19:50:41.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203d2e1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56221d707830 0x56221d707c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203cae0700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x56221d708140 0x56221d708be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51780/0 (socket says 172.21.15.167:51780) 2023-10-05T19:50:41.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203d2e1700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56221d707830 0x56221d707c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45976/0 (socket says 172.21.15.167:45976) 2023-10-05T19:50:41.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203cae0700 1 -- 172.21.15.167:0/4199233435 learned_addr learned my addr 172.21.15.167:0/4199233435 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:41.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203d2e1700 1 -- 172.21.15.167:0/4199233435 >> v1:172.21.15.118:6789/0 conn(0x56221d708140 legacy=0x56221d708be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.040+0000 7f203d2e1700 1 -- 172.21.15.167:0/4199233435 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56221d7092f0 con 0x56221d707830 2023-10-05T19:50:41.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203d2e1700 1 --2- 172.21.15.167:0/4199233435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 0x56221d707c00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f203800a520 tx=0x7f2038005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f28d87f88e221 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f2037fff700 1 -- 172.21.15.167:0/4199233435 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203800f590 con 0x56221d707830 2023-10-05T19:50:41.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f2037fff700 1 -- 172.21.15.167:0/4199233435 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203800f6f0 con 0x56221d707830 2023-10-05T19:50:41.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f2037fff700 1 -- 172.21.15.167:0/4199233435 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203800f880 con 0x56221d707830 2023-10-05T19:50:41.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 -- 172.21.15.167:0/4199233435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 msgr2=0x56221d707c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 --2- 172.21.15.167:0/4199233435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 0x56221d707c00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f203800a520 tx=0x7f2038005d40 comp rx=0 tx=0).stop 2023-10-05T19:50:41.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 -- 172.21.15.167:0/4199233435 shutdown_connections 2023-10-05T19:50:41.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 --2- 172.21.15.167:0/4199233435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 0x56221d707c00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 -- 172.21.15.167:0/4199233435 >> 172.21.15.167:0/4199233435 conn(0x56221d703250 msgr2=0x56221d705660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 -- 172.21.15.167:0/4199233435 shutdown_connections 2023-10-05T19:50:41.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 -- 172.21.15.167:0/4199233435 wait complete. 2023-10-05T19:50:41.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 Processor -- start 2023-10-05T19:50:41.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 -- start start 2023-10-05T19:50:41.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 0x56221d727990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203f7ace40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221d5d6e30 con 0x56221d707830 2023-10-05T19:50:41.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203d2e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 0x56221d727990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203d2e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 0x56221d727990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45980/0 (socket says 172.21.15.167:45980) 2023-10-05T19:50:41.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203d2e1700 1 -- 172.21.15.167:0/3297774601 learned_addr learned my addr 172.21.15.167:0/3297774601 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203d2e1700 1 -- 172.21.15.167:0/3297774601 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203800a0e0 con 0x56221d707830 2023-10-05T19:50:41.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.044+0000 7f203d2e1700 1 --2- 172.21.15.167:0/3297774601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 0x56221d727990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f203800a470 tx=0x7f2038014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408174a8641ef953 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f2036ffd700 1 -- 172.21.15.167:0/3297774601 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203800f860 con 0x56221d707830 2023-10-05T19:50:41.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f2036ffd700 1 -- 172.21.15.167:0/3297774601 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203800f9e0 con 0x56221d707830 2023-10-05T19:50:41.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f2036ffd700 1 -- 172.21.15.167:0/3297774601 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203800fb90 con 0x56221d707830 2023-10-05T19:50:41.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 -- 172.21.15.167:0/3297774601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 msgr2=0x56221d727990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 --2- 172.21.15.167:0/3297774601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 0x56221d727990 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f203800a470 tx=0x7f2038014000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 -- 172.21.15.167:0/3297774601 shutdown_connections 2023-10-05T19:50:41.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 --2- 172.21.15.167:0/3297774601 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d707830 0x56221d727990 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 -- 172.21.15.167:0/3297774601 >> 172.21.15.167:0/3297774601 conn(0x56221d703250 msgr2=0x56221d723550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 -- 172.21.15.167:0/3297774601 shutdown_connections 2023-10-05T19:50:41.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 -- 172.21.15.167:0/3297774601 wait complete. 2023-10-05T19:50:41.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 Processor -- start 2023-10-05T19:50:41.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 -- start start 2023-10-05T19:50:41.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d708140 0x56221d7308f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221d5a9ed0 con 0x56221d708140 2023-10-05T19:50:41.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203d2e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d708140 0x56221d7308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203d2e1700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d708140 0x56221d7308f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45988/0 (socket says 172.21.15.167:45988) 2023-10-05T19:50:41.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 learned_addr learned my addr 172.21.15.167:0/1344249370 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56221d7092f0 con 0x56221d708140 2023-10-05T19:50:41.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203d2e1700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d708140 0x56221d7308f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2038005d80 tx=0x7f203801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f20357fa700 1 -- 172.21.15.167:0/1344249370 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203802f420 con 0x56221d708140 2023-10-05T19:50:41.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f20357fa700 1 -- 172.21.15.167:0/1344249370 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203802f580 con 0x56221d708140 2023-10-05T19:50:41.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56221d730e30 con 0x56221d708140 2023-10-05T19:50:41.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f20357fa700 1 -- 172.21.15.167:0/1344249370 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f203802f6f0 con 0x56221d708140 2023-10-05T19:50:41.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.048+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56221d7312d0 con 0x56221d708140 2023-10-05T19:50:41.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f20357fa700 1 -- 172.21.15.167:0/1344249370 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2038038440 con 0x56221d708140 2023-10-05T19:50:41.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f20357fa700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2020030c00 0x7f20200330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f20357fa700 1 -- 172.21.15.167:0/1344249370 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f203802b070 con 0x56221d708140 2023-10-05T19:50:41.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203cae0700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2020030c00 0x7f20200330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d73a360 0x56221d73c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d73ce40 con 0x56221d73a360 2023-10-05T19:50:41.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203dae2700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d73a360 0x56221d73c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203cae0700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2020030c00 0x7f20200330b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2028001e90 tx=0x7f20280013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203dae2700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d73a360 0x56221d73c740 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f203000a500 con 0x56221d73a360 2023-10-05T19:50:41.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203f7ace40 20 realm 2023-10-05T19:50:41.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.052+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7399d0 con 0x56221d73a360 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f203000a500 con 0x56221d73a360 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d73d970 con 0x56221d73a360 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f203000a500 con 0x56221d73a360 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d73e7a0 0x56221d740b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7410c0 con 0x56221d73e7a0 2023-10-05T19:50:41.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203d2e1700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d73e7a0 0x56221d740b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203d2e1700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d73e7a0 0x56221d740b80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d741960 con 0x56221d73a360 2023-10-05T19:50:41.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f203000a500 con 0x56221d73a360 2023-10-05T19:50:41.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.056+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203f7ace40 20 searching for the correct realm 2023-10-05T19:50:41.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d743720 0x56221d745b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d743720 2023-10-05T19:50:41.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203cae0700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d743720 0x56221d745b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203cae0700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d743720 0x56221d745b00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028006070 con 0x56221d743720 2023-10-05T19:50:41.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73e7a0 2023-10-05T19:50:41.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203d2e1700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2038038070 0x7f20380463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x7f2038038070 2023-10-05T19:50:41.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203dae2700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2038038070 0x7f20380463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203dae2700 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2038038070 0x7f20380463c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x7f2038038070 2023-10-05T19:50:41.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.060+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d743720 2023-10-05T19:50:41.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028006070 con 0x56221d743720 2023-10-05T19:50:41.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73e7a0 2023-10-05T19:50:41.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73e7a0 2023-10-05T19:50:41.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.064+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x7f2038038070 2023-10-05T19:50:41.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x7f2038038070 2023-10-05T19:50:41.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x7f2038038070 2023-10-05T19:50:41.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x7f2038038070 2023-10-05T19:50:41.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73e7a0 2023-10-05T19:50:41.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d743720 2023-10-05T19:50:41.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028006070 con 0x56221d743720 2023-10-05T19:50:41.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.068+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73e7a0 2023-10-05T19:50:41.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d743720 2023-10-05T19:50:41.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028006070 con 0x56221d743720 2023-10-05T19:50:41.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d743720 2023-10-05T19:50:41.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028006070 con 0x56221d743720 2023-10-05T19:50:41.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x7f2038038070 2023-10-05T19:50:41.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x7f2038038070 2023-10-05T19:50:41.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73a360 2023-10-05T19:50:41.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x7f2038038070 2023-10-05T19:50:41.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x7f2038038070 2023-10-05T19:50:41.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.072+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d743720 2023-10-05T19:50:41.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028006070 con 0x56221d743720 2023-10-05T19:50:41.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x7f2038038070 2023-10-05T19:50:41.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x7f2038038070 2023-10-05T19:50:41.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73e7a0 2023-10-05T19:50:41.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73e7a0 2023-10-05T19:50:41.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d743720 2023-10-05T19:50:41.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028006070 con 0x56221d743720 2023-10-05T19:50:41.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.076+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73e7a0 2023-10-05T19:50:41.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746040 con 0x56221d73e7a0 2023-10-05T19:50:41.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7424d0 con 0x56221d73a360 2023-10-05T19:50:41.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d742e20 con 0x56221d73e7a0 2023-10-05T19:50:41.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7463f0 con 0x56221d73e7a0 2023-10-05T19:50:41.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7467a0 con 0x56221d743720 2023-10-05T19:50:41.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2028006070 con 0x56221d743720 2023-10-05T19:50:41.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.080+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d73a360 2023-10-05T19:50:41.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7429c0 con 0x56221d73e7a0 2023-10-05T19:50:41.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d748450 con 0x56221d743720 2023-10-05T19:50:41.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d748450 con 0x56221d73e7a0 2023-10-05T19:50:41.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7429c0 con 0x7f2038038070 2023-10-05T19:50:41.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x7f2038038070 2023-10-05T19:50:41.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d73a360 2023-10-05T19:50:41.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d73a360 2023-10-05T19:50:41.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.084+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d743720 2023-10-05T19:50:41.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d73a360 2023-10-05T19:50:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d73e7a0 2023-10-05T19:50:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d73e7a0 2023-10-05T19:50:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d73a360 2023-10-05T19:50:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x7f2038038070 2023-10-05T19:50:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x7f2038038070 2023-10-05T19:50:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.088+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d73a360 2023-10-05T19:50:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x7f2038038070 2023-10-05T19:50:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x7f2038038070 2023-10-05T19:50:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d73e7a0 2023-10-05T19:50:41.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d746b50 con 0x56221d743720 2023-10-05T19:50:41.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73a360 2023-10-05T19:50:41.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73e7a0 2023-10-05T19:50:41.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.092+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d743720 2023-10-05T19:50:41.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73a360 2023-10-05T19:50:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030014040 con 0x56221d73a360 2023-10-05T19:50:41.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73a360 2023-10-05T19:50:41.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73a360 2023-10-05T19:50:41.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d743720 2023-10-05T19:50:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x7f2038038070 2023-10-05T19:50:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73a360 2023-10-05T19:50:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.096+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x7f2038038070 2023-10-05T19:50:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d743720 2023-10-05T19:50:41.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x7f2038038070 2023-10-05T19:50:41.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73e7a0 2023-10-05T19:50:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73e7a0 2023-10-05T19:50:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d743720 2023-10-05T19:50:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.100+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73e7a0 2023-10-05T19:50:41.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2028028040 con 0x56221d73e7a0 2023-10-05T19:50:41.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d742990 con 0x56221d73e7a0 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d742990 con 0x56221d73a360 2023-10-05T19:50:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d747930 con 0x56221d73e7a0 2023-10-05T19:50:41.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.104+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d747930 con 0x56221d73e7a0 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d747a30 con 0x7f2038038070 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 zone default found 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 4 Realm: () 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:41.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:41.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:41.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 zonegroup default 2023-10-05T19:50:41.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d747a30 con 0x7f2038038070 2023-10-05T19:50:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7493b0 con 0x56221d743720 2023-10-05T19:50:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d749760 con 0x56221d743720 2023-10-05T19:50:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 started sync module instance, tier type = 2023-10-05T19:50:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.108+0000 7f203f7ace40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:41.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.112+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d748a70 con 0x56221d73e7a0 2023-10-05T19:50:41.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.112+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.112+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94704523052704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d748fe0 con 0x56221d73e7a0 2023-10-05T19:50:41.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.112+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74a110 con 0x56221d73a360 2023-10-05T19:50:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.116+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.116+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94704523058208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74a070 con 0x56221d73a360 2023-10-05T19:50:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.116+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74b060 con 0x56221d73e7a0 2023-10-05T19:50:41.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.116+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94704523052704] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.116+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.116+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94704523053808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74b060 con 0x56221d73e7a0 2023-10-05T19:50:41.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.116+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74b900 con 0x7f2038038070 2023-10-05T19:50:41.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.116+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94704523058208] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.120+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.120+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94704523053808] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.120+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94704523062128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74a5e0 con 0x7f2038038070 2023-10-05T19:50:41.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.120+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74bb10 con 0x56221d73e7a0 2023-10-05T19:50:41.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.120+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94704523062128] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.120+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.120+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94704523063232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74bb10 con 0x56221d73e7a0 2023-10-05T19:50:41.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.124+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74c520 con 0x56221d743720 2023-10-05T19:50:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.124+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.124+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94704523067440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74ce10 con 0x56221d743720 2023-10-05T19:50:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.124+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74d860 con 0x56221d743720 2023-10-05T19:50:41.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.124+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94704523063232] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.124+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94704523067440] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.124+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.124+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94704523064864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74dc60 con 0x56221d743720 2023-10-05T19:50:41.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.124+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74e500 con 0x7f2038038070 2023-10-05T19:50:41.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94704523075216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74e810 con 0x7f2038038070 2023-10-05T19:50:41.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 20 add_watcher() i=0 2023-10-05T19:50:41.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 20 add_watcher() i=1 2023-10-05T19:50:41.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 20 add_watcher() i=2 2023-10-05T19:50:41.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 20 add_watcher() i=3 2023-10-05T19:50:41.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 20 add_watcher() i=4 2023-10-05T19:50:41.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 20 add_watcher() i=5 2023-10-05T19:50:41.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94704523064864] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 20 add_watcher() i=6 2023-10-05T19:50:41.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94704523075216] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 20 add_watcher() i=7 2023-10-05T19:50:41.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:41.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74d330 con 0x56221d73a360 2023-10-05T19:50:41.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.128+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94704523076320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d74eca0 con 0x56221d73a360 2023-10-05T19:50:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94704523076320] v30'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f200e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203f7ace40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:41.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203f7ace40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203f7ace40 1 Processor -- start 2023-10-05T19:50:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203f7ace40 1 -- start start 2023-10-05T19:50:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203f7ace40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d75c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203f7ace40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221d75c760 con 0x56221d75be50 2023-10-05T19:50:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203cae0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d75c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203cae0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d75c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45998/0 (socket says 172.21.15.167:45998) 2023-10-05T19:50:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203cae0700 1 -- 172.21.15.167:0/3856211696 learned_addr learned my addr 172.21.15.167:0/3856211696 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203cae0700 1 -- 172.21.15.167:0/3856211696 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56221d75c8a0 con 0x56221d75be50 2023-10-05T19:50:41.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f203cae0700 1 --2- 172.21.15.167:0/3856211696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d75c220 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x56221d741fe0 tx=0x7f2028010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460ce688d9b3cb68 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f200dfe3700 1 -- 172.21.15.167:0/3856211696 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f202803b070 con 0x56221d75be50 2023-10-05T19:50:41.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f200dfe3700 1 -- 172.21.15.167:0/3856211696 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2028022040 con 0x56221d75be50 2023-10-05T19:50:41.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.132+0000 7f200dfe3700 1 -- 172.21.15.167:0/3856211696 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2028021040 con 0x56221d75be50 2023-10-05T19:50:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 -- 172.21.15.167:0/3856211696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 msgr2=0x56221d75c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 --2- 172.21.15.167:0/3856211696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d75c220 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x56221d741fe0 tx=0x7f2028010000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 -- 172.21.15.167:0/3856211696 shutdown_connections 2023-10-05T19:50:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 --2- 172.21.15.167:0/3856211696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d75c220 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 -- 172.21.15.167:0/3856211696 >> 172.21.15.167:0/3856211696 conn(0x56221d757210 msgr2=0x56221d755360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 -- 172.21.15.167:0/3856211696 shutdown_connections 2023-10-05T19:50:41.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 -- 172.21.15.167:0/3856211696 wait complete. 2023-10-05T19:50:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 Processor -- start 2023-10-05T19:50:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 -- start start 2023-10-05T19:50:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d761980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56221d762980 con 0x56221d75be50 2023-10-05T19:50:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203cae0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d761980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203cae0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d761980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46012/0 (socket says 172.21.15.167:46012) 2023-10-05T19:50:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203cae0700 1 -- 172.21.15.167:0/2069085361 learned_addr learned my addr 172.21.15.167:0/2069085361 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203cae0700 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56221d655bd0 con 0x56221d75be50 2023-10-05T19:50:41.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203cae0700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d761980 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f203802e790 tx=0x7f2028037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f1f7ffff700 1 -- 172.21.15.167:0/2069085361 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2028021070 con 0x56221d75be50 2023-10-05T19:50:41.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f1f7ffff700 1 -- 172.21.15.167:0/2069085361 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2028041630 con 0x56221d75be50 2023-10-05T19:50:41.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56221d761f80 con 0x56221d75be50 2023-10-05T19:50:41.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f1f7ffff700 1 -- 172.21.15.167:0/2069085361 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2028046070 con 0x56221d75be50 2023-10-05T19:50:41.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.136+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56221d762420 con 0x56221d75be50 2023-10-05T19:50:41.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.140+0000 7f1f7ffff700 1 -- 172.21.15.167:0/2069085361 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f202803e020 con 0x56221d75be50 2023-10-05T19:50:41.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.140+0000 7f1f7ffff700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1f84030ca0 0x7f1f84033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.140+0000 7f1f7ffff700 1 -- 172.21.15.167:0/2069085361 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f202802e040 con 0x56221d75be50 2023-10-05T19:50:41.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.140+0000 7f203dae2700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1f84030ca0 0x7f1f84033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.140+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d76c5d0 0x56221d76e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.140+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d76f080 con 0x56221d76c5d0 2023-10-05T19:50:41.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.140+0000 7f203d2e1700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d76c5d0 0x56221d76e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.140+0000 7f203dae2700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1f84030ca0 0x7f1f84033150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x56221d74c4f0 tx=0x7f203000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.140+0000 7f203d2e1700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d76c5d0 0x56221d76e9e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56221d76fd50 0x56221d772130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d772860 con 0x56221d76fd50 2023-10-05T19:50:41.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203cae0700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56221d76fd50 0x56221d772130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203cae0700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56221d76fd50 0x56221d772130 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203cae0700 1 -- 172.21.15.167:0/2069085361 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d76fd50 2023-10-05T19:50:41.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d773530 0x56221d775940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d776070 con 0x56221d773530 2023-10-05T19:50:41.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203dae2700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d773530 0x56221d775940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.144+0000 7f203dae2700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d773530 0x56221d775940 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.148+0000 7f203dae2700 1 -- 172.21.15.167:0/2069085361 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d773530 2023-10-05T19:50:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.148+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d776d40 0x56221d779150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.148+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d779880 con 0x56221d776d40 2023-10-05T19:50:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.148+0000 7f203d2e1700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d776d40 0x56221d779150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.148+0000 7f203d2e1700 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d776d40 0x56221d779150 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.152+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'140 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d776d40 2023-10-05T19:50:41.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.152+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d779ed0 con 0x56221d76c5d0 2023-10-05T19:50:41.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.152+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'43 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.152+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77a4f0 con 0x56221d773530 2023-10-05T19:50:41.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.156+0000 7f203dae2700 1 -- 172.21.15.167:0/2069085361 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d773530 2023-10-05T19:50:41.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.156+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77ab10 con 0x56221d76c5d0 2023-10-05T19:50:41.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.156+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.156+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77b000 con 0x56221d776d40 2023-10-05T19:50:41.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.160+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d776d40 2023-10-05T19:50:41.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.160+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77b000 con 0x56221d76c5d0 2023-10-05T19:50:41.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.160+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.160+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77b090 con 0x56221d76c5d0 2023-10-05T19:50:41.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.164+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.164+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77b090 con 0x56221d76c5d0 2023-10-05T19:50:41.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.164+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'44 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.168+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77b580 con 0x56221d773530 2023-10-05T19:50:41.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.168+0000 7f203dae2700 1 -- 172.21.15.167:0/2069085361 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d773530 2023-10-05T19:50:41.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.168+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77b610 con 0x56221d76c5d0 2023-10-05T19:50:41.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.172+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.172+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bb00 con 0x56221d776d40 2023-10-05T19:50:41.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.172+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'36 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d776d40 2023-10-05T19:50:41.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.172+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bb00 con 0x56221d776d40 2023-10-05T19:50:41.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.176+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'141 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d776d40 2023-10-05T19:50:41.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.176+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77b880 con 0x56221d76c5d0 2023-10-05T19:50:41.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.176+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.176+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77b880 con 0x56221d76c5d0 2023-10-05T19:50:41.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.180+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'45 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.180+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77b880 con 0x56221d773530 2023-10-05T19:50:41.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.184+0000 7f203dae2700 1 -- 172.21.15.167:0/2069085361 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d773530 2023-10-05T19:50:41.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.184+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bd70 con 0x56221d76c5d0 2023-10-05T19:50:41.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.184+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(19 gc.18 [create,call,call,call] v30'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.184+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bce0 con 0x56221d776d40 2023-10-05T19:50:41.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.188+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(20 gc.19 [create,call,call,call] v30'142 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d776d40 2023-10-05T19:50:41.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.188+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bce0 con 0x56221d76c5d0 2023-10-05T19:50:41.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.188+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(21 gc.20 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.188+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bce0 con 0x56221d76c5d0 2023-10-05T19:50:41.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.192+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(22 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.192+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bce0 con 0x56221d773530 2023-10-05T19:50:41.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.196+0000 7f203dae2700 1 -- 172.21.15.167:0/2069085361 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d773530 2023-10-05T19:50:41.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.196+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bce0 con 0x56221d76c5d0 2023-10-05T19:50:41.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.196+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(24 gc.23 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.196+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bce0 con 0x56221d773530 2023-10-05T19:50:41.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.200+0000 7f203dae2700 1 -- 172.21.15.167:0/2069085361 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d773530 2023-10-05T19:50:41.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.200+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bce0 con 0x56221d773530 2023-10-05T19:50:41.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.204+0000 7f203dae2700 1 -- 172.21.15.167:0/2069085361 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v30'31 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d773530 2023-10-05T19:50:41.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.204+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bdd0 con 0x56221d773530 2023-10-05T19:50:41.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.204+0000 7f203dae2700 1 -- 172.21.15.167:0/2069085361 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d773530 2023-10-05T19:50:41.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.204+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bdd0 con 0x56221d76c5d0 2023-10-05T19:50:41.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.208+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(28 gc.27 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.208+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bd70 con 0x56221d776d40 2023-10-05T19:50:41.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.212+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(29 gc.28 [create,call,call,call] v30'29 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d776d40 2023-10-05T19:50:41.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.212+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bd70 con 0x56221d76c5d0 2023-10-05T19:50:41.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.212+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(30 gc.29 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d76c5d0 2023-10-05T19:50:41.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.212+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bd70 con 0x56221d776d40 2023-10-05T19:50:41.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.216+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(31 gc.30 [create,call,call,call] v30'37 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d776d40 2023-10-05T19:50:41.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.216+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d77bd70 con 0x56221d76fd50 2023-10-05T19:50:41.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.216+0000 7f203cae0700 1 -- 172.21.15.167:0/2069085361 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d76fd50 2023-10-05T19:50:41.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.220+0000 7f1f7d7fa700 20 reqs_thread_entry: start 2023-10-05T19:50:41.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.220+0000 7f1f76ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:41.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.220+0000 7f203f7ace40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:41.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.220+0000 7f203f7ace40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:41.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.220+0000 7f1f757fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:11 2023 2023-10-05T19:50:41.229 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:41.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.220+0000 7f1f74ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.220+0000 7f203f7ace40 20 get_system_obj_state: rctx=0x7ffd4cc17060 obj=default.rgw.meta:root:myfoo state=0x56221d5e20b0 s->prefetch_data=0 2023-10-05T19:50:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.220+0000 7f203f7ace40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:50:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.220+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7db2a0 con 0x7f2038038070 2023-10-05T19:50:41.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:50:41.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:41.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:41.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:41.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:50:41.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7db1b0 con 0x7f2038038070 2023-10-05T19:50:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T19:50:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 get_system_obj_state: rctx=0x7ffd4cc17060 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x56221d5b82b0 s->prefetch_data=0 2023-10-05T19:50:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : miss 2023-10-05T19:50:41.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7dc880 con 0x56221d73a360 2023-10-05T19:50:41.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x16 2023-10-05T19:50:41.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:41.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:41.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:41.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:41.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:41.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:41.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:41.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7df3a0 con 0x56221d73a360 2023-10-05T19:50:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(105 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x13 2023-10-05T19:50:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:41.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 20 get_obj_state: rctx=0x7ffd4cc17320 obj=myfoo:four state=0x56221d7dd5a8 s->prefetch_data=0 2023-10-05T19:50:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.224+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 3.3cs0 3:3d892892:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7de4c0 con 0x7f2038038070 2023-10-05T19:50:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.228+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(106 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+865 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.228+0000 7f203f7ace40 10 manifest: total_size = 4 2023-10-05T19:50:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.228+0000 7f203f7ace40 20 get_obj_state: setting s->obj_tag to e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.2749712936985884970 2023-10-05T19:50:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.228+0000 7f203f7ace40 20 get_obj_state: rctx=0x7ffd4cc17320 obj=myfoo:four state=0x56221d7dd5a8 s->prefetch_data=0 2023-10-05T19:50:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.228+0000 7f203f7ace40 20 prepare_atomic_modification: state is not atomic. state=0x56221d7dd5a8 2023-10-05T19:50:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.228+0000 7f203f7ace40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6 2023-10-05T19:50:41.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.228+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 4.2c 4:36ed1c45:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7dedd0 con 0x56221d73a360 2023-10-05T19:50:41.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.228+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(107 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6 [stat,call,call] v30'11 uv11 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.228+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 3.3cs0 3:3d892892:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7dedd0 con 0x7f2038038070 2023-10-05T19:50:41.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.232+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(108 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1_four [call] v30'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.232+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 4.2c 4:36ed1c45:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7ded50 con 0x56221d73a360 2023-10-05T19:50:41.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.232+0000 7f203f7ace40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : miss 2023-10-05T19:50:41.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.232+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.232+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 6.18 6:1df25bda:::bucket.sync-source-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7e61a0 con 0x7f2038038070 2023-10-05T19:50:41.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(110 bucket.sync-source-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo info.flags=0x0 2023-10-05T19:50:41.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 10 adding default.rgw.log++bucket.sync-source-hints.myfoo to cache LRU end 2023-10-05T19:50:41.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : miss 2023-10-05T19:50:41.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 6.4 6:26e4c4bc:::bucket.sync-target-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d7ded50 con 0x56221d73a360 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(111 bucket.sync-target-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo info.flags=0x0 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 10 adding default.rgw.log++bucket.sync-target-hints.myfoo to cache LRU end 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 10 chain_cache_entry: cache_locator= 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(109 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6 [stat,call,call] v30'12 uv12 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f20367fc700 20 handle_completion(): completion ok for obj=four 2023-10-05T19:50:41.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94704523052704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d71e230 con 0x56221d73e7a0 2023-10-05T19:50:41.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(112 notify.0 [watch unwatch cookie 94704523052704] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 20 remove_watcher() i=0 2023-10-05T19:50:41.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 2 removed watcher, disabling cache 2023-10-05T19:50:41.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.236+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94704523058208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d71e230 con 0x56221d73a360 2023-10-05T19:50:41.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.240+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(113 notify.1 [watch unwatch cookie 94704523058208] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.240+0000 7f203f7ace40 20 remove_watcher() i=1 2023-10-05T19:50:41.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.240+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94704523053808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d71e230 con 0x56221d73e7a0 2023-10-05T19:50:41.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.240+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(114 notify.2 [watch unwatch cookie 94704523053808] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.240+0000 7f203f7ace40 20 remove_watcher() i=2 2023-10-05T19:50:41.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.240+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:115 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94704523062128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d71e230 con 0x7f2038038070 2023-10-05T19:50:41.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.244+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(115 notify.3 [watch unwatch cookie 94704523062128] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.244+0000 7f203f7ace40 20 remove_watcher() i=3 2023-10-05T19:50:41.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.244+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94704523063232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d71e230 con 0x56221d73e7a0 2023-10-05T19:50:41.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.244+0000 7f203d2e1700 1 -- 172.21.15.167:0/1344249370 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(116 notify.4 [watch unwatch cookie 94704523063232] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f203802e7e0 con 0x56221d73e7a0 2023-10-05T19:50:41.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.244+0000 7f203f7ace40 20 remove_watcher() i=4 2023-10-05T19:50:41.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.244+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94704523067440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d71e230 con 0x56221d743720 2023-10-05T19:50:41.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.248+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(117 notify.5 [watch unwatch cookie 94704523067440] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.248+0000 7f203f7ace40 20 remove_watcher() i=5 2023-10-05T19:50:41.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.248+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:118 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94704523064864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d71e230 con 0x56221d743720 2023-10-05T19:50:41.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.248+0000 7f203cae0700 1 -- 172.21.15.167:0/1344249370 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(118 notify.6 [watch unwatch cookie 94704523064864] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2028024040 con 0x56221d743720 2023-10-05T19:50:41.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.248+0000 7f203f7ace40 20 remove_watcher() i=6 2023-10-05T19:50:41.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.248+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:119 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94704523075216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d71e230 con 0x7f2038038070 2023-10-05T19:50:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.248+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(119 notify.7 [watch unwatch cookie 94704523075216] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2030033040 con 0x7f2038038070 2023-10-05T19:50:41.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.248+0000 7f203f7ace40 20 remove_watcher() i=7 2023-10-05T19:50:41.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f200e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:120 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94704523076320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56221d71e230 con 0x56221d73a360 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(120 data_loggenerations_metadata [watch unwatch cookie 94704523076320] v30'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2030033040 con 0x56221d73a360 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d73e7a0 msgr2=0x56221d740b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d73e7a0 0x56221d740b80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d73a360 msgr2=0x56221d73c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d73a360 0x56221d73c740 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2038038070 msgr2=0x7f20380463c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2038038070 0x7f20380463c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d743720 msgr2=0x56221d745b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d743720 0x56221d745b00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2020030c00 msgr2=0x7f20200330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2020030c00 0x7f20200330b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2028001e90 tx=0x7f20280013b0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203dae2700 1 -- 172.21.15.167:0/1344249370 reap_dead start 2023-10-05T19:50:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d708140 msgr2=0x56221d7308f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d708140 0x56221d7308f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2038005d80 tx=0x7f203801d000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 shutdown_connections 2023-10-05T19:50:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 --2- 172.21.15.167:0/1344249370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d708140 0x56221d7308f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 >> 172.21.15.167:0/1344249370 conn(0x56221d703250 msgr2=0x56221d721fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 shutdown_connections 2023-10-05T19:50:41.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.252+0000 7f203f7ace40 1 -- 172.21.15.167:0/1344249370 wait complete. 2023-10-05T19:50:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d76c5d0 msgr2=0x56221d76e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56221d76c5d0 0x56221d76e9e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d776d40 msgr2=0x56221d779150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56221d776d40 0x56221d779150 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56221d76fd50 msgr2=0x56221d772130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56221d76fd50 0x56221d772130 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d773530 msgr2=0x56221d775940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56221d773530 0x56221d775940 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1f84030ca0 msgr2=0x7f1f84033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1f84030ca0 0x7f1f84033150 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x56221d74c4f0 tx=0x7f203000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 msgr2=0x56221d761980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 --2- 172.21.15.167:0/2069085361 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56221d75be50 0x56221d761980 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f203802e790 tx=0x7f2028037000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203d2e1700 1 -- 172.21.15.167:0/2069085361 reap_dead start 2023-10-05T19:50:41.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 shutdown_connections 2023-10-05T19:50:41.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 >> 172.21.15.167:0/2069085361 conn(0x56221d757210 msgr2=0x56221d7552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 shutdown_connections 2023-10-05T19:50:41.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.256+0000 7f203f7ace40 1 -- 172.21.15.167:0/2069085361 wait complete. 2023-10-05T19:50:41.269 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T19:50:41.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2023-10-05T19:50:41.269 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2023-10-05T19:50:41.307 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:41.307 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:41.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2ed41ae40 1 Processor -- start 2023-10-05T19:50:41.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2ed41ae40 1 -- start start 2023-10-05T19:50:41.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2ed41ae40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560fb5efeb50 0x560fb5efef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2ed41ae40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560fb5e49bd0 con 0x560fb5eff460 2023-10-05T19:50:41.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2ed41ae40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x560fb5e06ee0 con 0x560fb5efeb50 2023-10-05T19:50:41.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2eaf4f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560fb5efeb50 0x560fb5efef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2ea74e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x560fb5eff460 0x560fb5efff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51788/0 (socket says 172.21.15.167:51788) 2023-10-05T19:50:41.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2eaf4f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x560fb5efeb50 0x560fb5efef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46028/0 (socket says 172.21.15.167:46028) 2023-10-05T19:50:41.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3260201780 learned_addr learned my addr 172.21.15.167:0/3260201780 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:41.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3260201780 >> v1:172.21.15.118:6789/0 conn(0x560fb5eff460 legacy=0x560fb5efff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3260201780 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fb5f00610 con 0x560fb5efeb50 2023-10-05T19:50:41.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2eaf4f700 1 --2- 172.21.15.167:0/3260201780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5efef20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400a520 tx=0x7fd2e4005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fd01067ea95801 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2e9f4d700 1 -- 172.21.15.167:0/3260201780 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e400f590 con 0x560fb5efeb50 2023-10-05T19:50:41.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2e9f4d700 1 -- 172.21.15.167:0/3260201780 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e400f6f0 con 0x560fb5efeb50 2023-10-05T19:50:41.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.300+0000 7fd2e9f4d700 1 -- 172.21.15.167:0/3260201780 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e400f880 con 0x560fb5efeb50 2023-10-05T19:50:41.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3260201780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 msgr2=0x560fb5efef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3260201780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5efef20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400a520 tx=0x7fd2e4005d40 comp rx=0 tx=0).stop 2023-10-05T19:50:41.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3260201780 shutdown_connections 2023-10-05T19:50:41.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3260201780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5efef20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3260201780 >> 172.21.15.167:0/3260201780 conn(0x560fb5e724b0 msgr2=0x560fb5e728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3260201780 shutdown_connections 2023-10-05T19:50:41.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3260201780 wait complete. 2023-10-05T19:50:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 Processor -- start 2023-10-05T19:50:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 -- start start 2023-10-05T19:50:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f1db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2ed41ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb5dcae30 con 0x560fb5efeb50 2023-10-05T19:50:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2eaf4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f1db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2eaf4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f1db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46042/0 (socket says 172.21.15.167:46042) 2023-10-05T19:50:41.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/2380450373 learned_addr learned my addr 172.21.15.167:0/2380450373 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/2380450373 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e400a0e0 con 0x560fb5efeb50 2023-10-05T19:50:41.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2eaf4f700 1 --2- 172.21.15.167:0/2380450373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f1db80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400a470 tx=0x7fd2e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741851ca80e4035d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2e8f4b700 1 -- 172.21.15.167:0/2380450373 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e400f860 con 0x560fb5efeb50 2023-10-05T19:50:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2e8f4b700 1 -- 172.21.15.167:0/2380450373 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e400f9e0 con 0x560fb5efeb50 2023-10-05T19:50:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.304+0000 7fd2e8f4b700 1 -- 172.21.15.167:0/2380450373 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e400fb90 con 0x560fb5efeb50 2023-10-05T19:50:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2380450373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 msgr2=0x560fb5f1db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/2380450373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f1db80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400a470 tx=0x7fd2e4014000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2380450373 shutdown_connections 2023-10-05T19:50:41.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/2380450373 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f1db80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2380450373 >> 172.21.15.167:0/2380450373 conn(0x560fb5e724b0 msgr2=0x560fb5f19740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2380450373 shutdown_connections 2023-10-05T19:50:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2380450373 wait complete. 2023-10-05T19:50:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 Processor -- start 2023-10-05T19:50:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 -- start start 2023-10-05T19:50:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f24880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb5d9ded0 con 0x560fb5efeb50 2023-10-05T19:50:41.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2eaf4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f24880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2eaf4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f24880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46052/0 (socket says 172.21.15.167:46052) 2023-10-05T19:50:41.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 learned_addr learned my addr 172.21.15.167:0/3352729753 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fb5f00610 con 0x560fb5efeb50 2023-10-05T19:50:41.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2eaf4f700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f24880 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400a470 tx=0x7fd2e401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2daffd700 1 -- 172.21.15.167:0/3352729753 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e402f420 con 0x560fb5efeb50 2023-10-05T19:50:41.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2daffd700 1 -- 172.21.15.167:0/3352729753 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e402f580 con 0x560fb5efeb50 2023-10-05T19:50:41.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fb5f24dc0 con 0x560fb5efeb50 2023-10-05T19:50:41.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2daffd700 1 -- 172.21.15.167:0/3352729753 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e402f730 con 0x560fb5efeb50 2023-10-05T19:50:41.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.308+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fb5f25260 con 0x560fb5efeb50 2023-10-05T19:50:41.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2daffd700 1 -- 172.21.15.167:0/3352729753 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fd2e4010420 con 0x560fb5efeb50 2023-10-05T19:50:41.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2daffd700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd2d0030c50 0x7fd2d0033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2daffd700 1 -- 172.21.15.167:0/3352729753 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fd2e402b070 con 0x560fb5efeb50 2023-10-05T19:50:41.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2ea74e700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd2d0030c50 0x7fd2d0033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fb5eff460 0x560fb5f302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f30960 con 0x560fb5eff460 2023-10-05T19:50:41.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2eb750700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fb5eff460 0x560fb5f302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2ea74e700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd2d0030c50 0x7fd2d0033100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0004170 tx=0x7fd2e0001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2eb750700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fb5eff460 0x560fb5f302f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2dc00a500 con 0x560fb5eff460 2023-10-05T19:50:41.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2ed41ae40 20 realm 2023-10-05T19:50:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.312+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f2d950 con 0x560fb5eff460 2023-10-05T19:50:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2dc00a500 con 0x560fb5eff460 2023-10-05T19:50:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f31440 con 0x560fb5eff460 2023-10-05T19:50:41.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2dc00a500 con 0x560fb5eff460 2023-10-05T19:50:41.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fb5f31070 0x560fb5f342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f349e0 con 0x560fb5f31070 2023-10-05T19:50:41.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2eaf4f700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fb5f31070 0x560fb5f342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2eaf4f700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fb5f31070 0x560fb5f342b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f352b0 con 0x560fb5eff460 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd2dc00a500 con 0x560fb5eff460 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 20 searching for the correct realm 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fb5f34e20 0x560fb5f39080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f34e20 2023-10-05T19:50:41.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.316+0000 7fd2ea74e700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fb5f34e20 0x560fb5f39080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2ea74e700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fb5f34e20 0x560fb5f39080 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0006070 con 0x560fb5f34e20 2023-10-05T19:50:41.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f31070 2023-10-05T19:50:41.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eaf4f700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fd2e4043040 0x7fd2e40377a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x7fd2e4043040 2023-10-05T19:50:41.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eb750700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fd2e4043040 0x7fd2e40377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eb750700 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fd2e4043040 0x7fd2e40377a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x7fd2e4043040 2023-10-05T19:50:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.320+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f34e20 2023-10-05T19:50:41.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0006070 con 0x560fb5f34e20 2023-10-05T19:50:41.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f31070 2023-10-05T19:50:41.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f31070 2023-10-05T19:50:41.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x7fd2e4043040 2023-10-05T19:50:41.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x7fd2e4043040 2023-10-05T19:50:41.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.324+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x7fd2e4043040 2023-10-05T19:50:41.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x7fd2e4043040 2023-10-05T19:50:41.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f31070 2023-10-05T19:50:41.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f34e20 2023-10-05T19:50:41.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0006070 con 0x560fb5f34e20 2023-10-05T19:50:41.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f31070 2023-10-05T19:50:41.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f34e20 2023-10-05T19:50:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.328+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0006070 con 0x560fb5f34e20 2023-10-05T19:50:41.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f34e20 2023-10-05T19:50:41.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0006070 con 0x560fb5f34e20 2023-10-05T19:50:41.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x7fd2e4043040 2023-10-05T19:50:41.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x7fd2e4043040 2023-10-05T19:50:41.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5eff460 2023-10-05T19:50:41.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.332+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x7fd2e4043040 2023-10-05T19:50:41.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x7fd2e4043040 2023-10-05T19:50:41.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f34e20 2023-10-05T19:50:41.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0006070 con 0x560fb5f34e20 2023-10-05T19:50:41.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x7fd2e4043040 2023-10-05T19:50:41.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x7fd2e4043040 2023-10-05T19:50:41.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f31070 2023-10-05T19:50:41.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f31070 2023-10-05T19:50:41.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f34e20 2023-10-05T19:50:41.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0006070 con 0x560fb5f34e20 2023-10-05T19:50:41.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.336+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f31070 2023-10-05T19:50:41.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f39660 con 0x560fb5f31070 2023-10-05T19:50:41.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f35e20 con 0x560fb5eff460 2023-10-05T19:50:41.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f367a0 con 0x560fb5f31070 2023-10-05T19:50:41.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.340+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f35a10 con 0x560fb5f31070 2023-10-05T19:50:41.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a010 con 0x560fb5f34e20 2023-10-05T19:50:41.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fd2e0006070 con 0x560fb5f34e20 2023-10-05T19:50:41.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5eff460 2023-10-05T19:50:41.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a770 con 0x560fb5f31070 2023-10-05T19:50:41.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3bb30 con 0x560fb5f34e20 2023-10-05T19:50:41.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.344+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3bb30 con 0x560fb5f31070 2023-10-05T19:50:41.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3bb30 con 0x7fd2e4043040 2023-10-05T19:50:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x7fd2e4043040 2023-10-05T19:50:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5eff460 2023-10-05T19:50:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5eff460 2023-10-05T19:50:41.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5f34e20 2023-10-05T19:50:41.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5eff460 2023-10-05T19:50:41.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5f31070 2023-10-05T19:50:41.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.348+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5f31070 2023-10-05T19:50:41.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5eff460 2023-10-05T19:50:41.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x7fd2e4043040 2023-10-05T19:50:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x7fd2e4043040 2023-10-05T19:50:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5eff460 2023-10-05T19:50:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x7fd2e4043040 2023-10-05T19:50:41.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x7fd2e4043040 2023-10-05T19:50:41.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5f31070 2023-10-05T19:50:41.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.352+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3a3c0 con 0x560fb5f34e20 2023-10-05T19:50:41.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5eff460 2023-10-05T19:50:41.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5f31070 2023-10-05T19:50:41.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5f34e20 2023-10-05T19:50:41.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5eff460 2023-10-05T19:50:41.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc014040 con 0x560fb5eff460 2023-10-05T19:50:41.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5eff460 2023-10-05T19:50:41.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5eff460 2023-10-05T19:50:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.356+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5f34e20 2023-10-05T19:50:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x7fd2e4043040 2023-10-05T19:50:41.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5eff460 2023-10-05T19:50:41.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x7fd2e4043040 2023-10-05T19:50:41.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5f34e20 2023-10-05T19:50:41.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x7fd2e4043040 2023-10-05T19:50:41.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.360+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5f31070 2023-10-05T19:50:41.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5f31070 2023-10-05T19:50:41.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5f34e20 2023-10-05T19:50:41.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5f31070 2023-10-05T19:50:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fd2e0028040 con 0x560fb5f31070 2023-10-05T19:50:41.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2ed41ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2ed41ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2ed41ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2ed41ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.364+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3ab20 con 0x560fb5f31070 2023-10-05T19:50:41.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3aed0 con 0x560fb5eff460 2023-10-05T19:50:41.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3b770 con 0x560fb5f31070 2023-10-05T19:50:41.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3b770 con 0x560fb5f31070 2023-10-05T19:50:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3b770 con 0x7fd2e4043040 2023-10-05T19:50:41.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.368+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 zone default found 2023-10-05T19:50:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 4 Realm: () 2023-10-05T19:50:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 zonegroup default 2023-10-05T19:50:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3b770 con 0x7fd2e4043040 2023-10-05T19:50:41.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3d0f0 con 0x560fb5f34e20 2023-10-05T19:50:41.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3d4a0 con 0x560fb5f34e20 2023-10-05T19:50:41.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 started sync module instance, tier type = 2023-10-05T19:50:41.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:41.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.372+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3c7b0 con 0x560fb5f31070 2023-10-05T19:50:41.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.376+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.376+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94625477149376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3cd00 con 0x560fb5f31070 2023-10-05T19:50:41.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.376+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3e230 con 0x560fb5eff460 2023-10-05T19:50:41.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.376+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.376+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94625477149376] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.376+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94625477156160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3cd00 con 0x560fb5eff460 2023-10-05T19:50:41.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.376+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3e7f0 con 0x560fb5f31070 2023-10-05T19:50:41.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.380+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94625477156160] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.380+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.380+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94625477154896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3e7f0 con 0x560fb5f31070 2023-10-05T19:50:41.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.380+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3f0e0 con 0x7fd2e4043040 2023-10-05T19:50:41.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.380+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.384+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94625477159920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3f040 con 0x7fd2e4043040 2023-10-05T19:50:41.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.384+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f40030 con 0x560fb5f31070 2023-10-05T19:50:41.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.384+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94625477154896] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.384+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94625477159920] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.384+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.384+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94625477162208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f3fb40 con 0x560fb5f31070 2023-10-05T19:50:41.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.384+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f403e0 con 0x560fb5f34e20 2023-10-05T19:50:41.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94625477164400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f40c80 con 0x560fb5f34e20 2023-10-05T19:50:41.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f41700 con 0x560fb5f34e20 2023-10-05T19:50:41.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94625477162208] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94625477164400] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94625477157632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f41b00 con 0x560fb5f34e20 2023-10-05T19:50:41.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f423a0 con 0x7fd2e4043040 2023-10-05T19:50:41.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94625477157632] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94625477171968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f42440 con 0x7fd2e4043040 2023-10-05T19:50:41.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 20 add_watcher() i=0 2023-10-05T19:50:41.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 20 add_watcher() i=1 2023-10-05T19:50:41.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 20 add_watcher() i=2 2023-10-05T19:50:41.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 20 add_watcher() i=3 2023-10-05T19:50:41.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 20 add_watcher() i=4 2023-10-05T19:50:41.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 20 add_watcher() i=5 2023-10-05T19:50:41.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.388+0000 7fd2ed41ae40 20 add_watcher() i=6 2023-10-05T19:50:41.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.392+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94625477171968] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.392+0000 7fd2ed41ae40 20 add_watcher() i=7 2023-10-05T19:50:41.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.392+0000 7fd2ed41ae40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:41.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.392+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f45510 con 0x560fb5eff460 2023-10-05T19:50:41.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.392+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.392+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94625477173072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f42890 con 0x560fb5eff460 2023-10-05T19:50:41.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.392+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94625477173072] v30'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.392+0000 7fd2bbfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:41.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:41.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 Processor -- start 2023-10-05T19:50:41.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 -- start start 2023-10-05T19:50:41.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f4fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb5f50340 con 0x560fb5f4fa30 2023-10-05T19:50:41.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ea74e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f4fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ea74e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f4fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46060/0 (socket says 172.21.15.167:46060) 2023-10-05T19:50:41.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ea74e700 1 -- 172.21.15.167:0/4255503438 learned_addr learned my addr 172.21.15.167:0/4255503438 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ea74e700 1 -- 172.21.15.167:0/4255503438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fb5f50480 con 0x560fb5f4fa30 2023-10-05T19:50:41.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ea74e700 1 --2- 172.21.15.167:0/4255503438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f4fe00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x560fb5f30fb0 tx=0x7fd2e0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fdb94af12ab1f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2bb7e6700 1 -- 172.21.15.167:0/4255503438 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e003b070 con 0x560fb5f4fa30 2023-10-05T19:50:41.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2bb7e6700 1 -- 172.21.15.167:0/4255503438 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0022040 con 0x560fb5f4fa30 2023-10-05T19:50:41.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2bb7e6700 1 -- 172.21.15.167:0/4255503438 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e0021040 con 0x560fb5f4fa30 2023-10-05T19:50:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/4255503438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 msgr2=0x560fb5f4fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/4255503438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f4fe00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x560fb5f30fb0 tx=0x7fd2e0010000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/4255503438 shutdown_connections 2023-10-05T19:50:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/4255503438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f4fe00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/4255503438 >> 172.21.15.167:0/4255503438 conn(0x560fb5f4adf0 msgr2=0x560fb5f48fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/4255503438 shutdown_connections 2023-10-05T19:50:41.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.396+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/4255503438 wait complete. 2023-10-05T19:50:41.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ed41ae40 1 Processor -- start 2023-10-05T19:50:41.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ed41ae40 1 -- start start 2023-10-05T19:50:41.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ed41ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f55540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ed41ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fb5f56540 con 0x560fb5f4fa30 2023-10-05T19:50:41.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ea74e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f55540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ea74e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f55540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46062/0 (socket says 172.21.15.167:46062) 2023-10-05T19:50:41.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ea74e700 1 -- 172.21.15.167:0/2229048892 learned_addr learned my addr 172.21.15.167:0/2229048892 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ea74e700 1 -- 172.21.15.167:0/2229048892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fb5e49bd0 con 0x560fb5f4fa30 2023-10-05T19:50:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ea74e700 1 --2- 172.21.15.167:0/2229048892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f55540 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x560fb5f49b10 tx=0x7fd2e0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2b9fe3700 1 -- 172.21.15.167:0/2229048892 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e0021070 con 0x560fb5f4fa30 2023-10-05T19:50:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2b9fe3700 1 -- 172.21.15.167:0/2229048892 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0041630 con 0x560fb5f4fa30 2023-10-05T19:50:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2229048892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560fb5f55b40 con 0x560fb5f4fa30 2023-10-05T19:50:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2b9fe3700 1 -- 172.21.15.167:0/2229048892 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2e0046070 con 0x560fb5f4fa30 2023-10-05T19:50:41.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2229048892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fb5f55fe0 con 0x560fb5f4fa30 2023-10-05T19:50:41.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2b9fe3700 1 -- 172.21.15.167:0/2229048892 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fd2e003e020 con 0x560fb5f4fa30 2023-10-05T19:50:41.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2b9fe3700 1 --2- 172.21.15.167:0/2229048892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd230030c50 0x7fd230033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.400+0000 7fd2b9fe3700 1 -- 172.21.15.167:0/2229048892 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fd2e002e040 con 0x560fb5f4fa30 2023-10-05T19:50:41.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2ed41ae40 5 note: GC not initialized 2023-10-05T19:50:41.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2eb750700 1 --2- 172.21.15.167:0/2229048892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd230030c50 0x7fd230033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2eb750700 1 --2- 172.21.15.167:0/2229048892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd230030c50 0x7fd230033100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x560fb5f45590 tx=0x7fd2dc00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd22affd700 20 reqs_thread_entry: start 2023-10-05T19:50:41.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd228ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:41.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2ed41ae40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:41.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2ed41ae40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:41.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd21affd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:11 2023 2023-10-05T19:50:41.413 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:41.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd21a7fc700 20 reqs_thread_entry: start 2023-10-05T19:50:41.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2ed41ae40 20 get_system_obj_state: rctx=0x7ffd1e459870 obj=default.rgw.meta:root:myfoo state=0x560fb5dd60b0 s->prefetch_data=0 2023-10-05T19:50:41.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fbe510 con 0x7fd2e4043040 2023-10-05T19:50:41.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2ed41ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:41.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.404+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fc0ab0 con 0x7fd2e4043040 2023-10-05T19:50:41.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:41.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 get_system_obj_state: rctx=0x7ffd1e459870 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x560fb5dac2b0 s->prefetch_data=0 2023-10-05T19:50:41.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fbef80 con 0x560fb5eff460 2023-10-05T19:50:41.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fc0fa0 con 0x560fb5eff460 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(105 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 get_system_obj_state: rctx=0x7ffd1e4597d0 obj=default.rgw.meta:root:myfoo state=0x560fb5dac2b0 s->prefetch_data=0 2023-10-05T19:50:41.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fc02c0 con 0x7fd2e4043040 2023-10-05T19:50:41.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(106 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:41.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fbd6a0 con 0x7fd2e4043040 2023-10-05T19:50:41.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(107 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 get_system_obj_state: rctx=0x7ffd1e4597d0 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x560fb5dd60b0 s->prefetch_data=0 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fbd6a0 con 0x560fb5eff460 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(108 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.408+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fc0870 con 0x560fb5eff460 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(109 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:41.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 4.21 4:85bb0c4e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fc0400 con 0x560fb5f34e20 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 4.3c 4:3c5ab7e8:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fc5270 con 0x560fb5eff460 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 4.b 4:d3872b52:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fc7fe0 con 0x7fd2e4043040 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 4.38 4:1c83dc09:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fc5270 con 0x560fb5f31070 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 4.32 4:4f10a7ef:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fccfe0 con 0x560fb5f31070 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 4.10 4:0b50a70f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fcfd10 con 0x560fb5f34e20 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:116 4.2c 4:36ed1c45:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fd2ae0 con 0x560fb5eff460 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 4.3b 4:dff81414:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fccfe0 con 0x560fb5f34e20 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 4.2c 4:35e9aa0f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fd7db0 con 0x560fb5eff460 2023-10-05T19:50:41.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 4.31 4:8ed18207:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fdacd0 con 0x560fb5f31070 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 4.2e 4:74947a99:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fdd7e0 con 0x560fb5f34e20 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(112 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(111 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(115 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(117 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2e0024040 con 0x560fb5f34e20 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(120 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd2e0059060 con 0x560fb5f34e20 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(119 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(113 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(116 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.6 [call out=124b] v0'0 uv12 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(114 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(118 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1.8 [call out=124b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.412+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94625477149376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5fdd7e0 con 0x560fb5f31070 2023-10-05T19:50:41.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.416+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(121 notify.0 [watch unwatch cookie 94625477149376] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.416+0000 7fd2ed41ae40 20 remove_watcher() i=0 2023-10-05T19:50:41.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.416+0000 7fd2ed41ae40 2 removed watcher, disabling cache 2023-10-05T19:50:41.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.416+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94625477156160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f14460 con 0x560fb5eff460 2023-10-05T19:50:41.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.416+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(122 notify.1 [watch unwatch cookie 94625477156160] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.416+0000 7fd2ed41ae40 20 remove_watcher() i=1 2023-10-05T19:50:41.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.416+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94625477154896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f14460 con 0x560fb5f31070 2023-10-05T19:50:41.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.420+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(123 notify.2 [watch unwatch cookie 94625477154896] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.420+0000 7fd2ed41ae40 20 remove_watcher() i=2 2023-10-05T19:50:41.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.420+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:124 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94625477159920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f14460 con 0x7fd2e4043040 2023-10-05T19:50:41.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.420+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(124 notify.3 [watch unwatch cookie 94625477159920] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.420+0000 7fd2ed41ae40 20 remove_watcher() i=3 2023-10-05T19:50:41.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.424+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:125 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94625477162208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f14460 con 0x560fb5f31070 2023-10-05T19:50:41.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.424+0000 7fd2eaf4f700 1 -- 172.21.15.167:0/3352729753 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(125 notify.4 [watch unwatch cookie 94625477162208] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e402e7e0 con 0x560fb5f31070 2023-10-05T19:50:41.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.424+0000 7fd2ed41ae40 20 remove_watcher() i=4 2023-10-05T19:50:41.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.424+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:126 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94625477164400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f14460 con 0x560fb5f34e20 2023-10-05T19:50:41.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.428+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(126 notify.5 [watch unwatch cookie 94625477164400] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e0059060 con 0x560fb5f34e20 2023-10-05T19:50:41.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.428+0000 7fd2ed41ae40 20 remove_watcher() i=5 2023-10-05T19:50:41.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.428+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:127 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94625477157632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f14460 con 0x560fb5f34e20 2023-10-05T19:50:41.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.428+0000 7fd2ea74e700 1 -- 172.21.15.167:0/3352729753 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(127 notify.6 [watch unwatch cookie 94625477157632] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2e0059060 con 0x560fb5f34e20 2023-10-05T19:50:41.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.428+0000 7fd2ed41ae40 20 remove_watcher() i=6 2023-10-05T19:50:41.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.428+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:128 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94625477171968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f14460 con 0x7fd2e4043040 2023-10-05T19:50:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.428+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(128 notify.7 [watch unwatch cookie 94625477171968] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x7fd2e4043040 2023-10-05T19:50:41.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.428+0000 7fd2ed41ae40 20 remove_watcher() i=7 2023-10-05T19:50:41.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2bbfe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:129 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94625477173072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x560fb5f7d1d0 con 0x560fb5eff460 2023-10-05T19:50:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(129 data_loggenerations_metadata [watch unwatch cookie 94625477173072] v30'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd2dc033040 con 0x560fb5eff460 2023-10-05T19:50:41.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fb5f31070 msgr2=0x560fb5f342b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x560fb5f31070 0x560fb5f342b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fb5eff460 msgr2=0x560fb5f302f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x560fb5eff460 0x560fb5f302f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fd2e4043040 msgr2=0x7fd2e40377a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fd2e4043040 0x7fd2e40377a0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fb5f34e20 msgr2=0x560fb5f39080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x560fb5f34e20 0x560fb5f39080 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd2d0030c50 msgr2=0x7fd2d0033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd2d0030c50 0x7fd2d0033100 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0004170 tx=0x7fd2e0001380 comp rx=0 tx=0).stop 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.432+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 msgr2=0x560fb5f24880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f24880 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400a470 tx=0x7fd2e401d000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2eb750700 1 -- 172.21.15.167:0/3352729753 reap_dead start 2023-10-05T19:50:41.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 shutdown_connections 2023-10-05T19:50:41.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/3352729753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5efeb50 0x560fb5f24880 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 >> 172.21.15.167:0/3352729753 conn(0x560fb5e724b0 msgr2=0x560fb5f181c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 shutdown_connections 2023-10-05T19:50:41.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/3352729753 wait complete. 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2229048892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd230030c50 msgr2=0x7fd230033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/2229048892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd230030c50 0x7fd230033100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x560fb5f45590 tx=0x7fd2dc00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2229048892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 msgr2=0x560fb5f55540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/2229048892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f55540 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x560fb5f49b10 tx=0x7fd2e0037000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2229048892 shutdown_connections 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/2229048892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fd230030c50 0x7fd230033100 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 --2- 172.21.15.167:0/2229048892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560fb5f4fa30 0x560fb5f55540 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2229048892 >> 172.21.15.167:0/2229048892 conn(0x560fb5f4adf0 msgr2=0x560fb5f48ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2229048892 shutdown_connections 2023-10-05T19:50:41.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.436+0000 7fd2ed41ae40 1 -- 172.21.15.167:0/2229048892 wait complete. 2023-10-05T19:50:41.446 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "num_shards": 11, 2023-10-05T19:50:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "tenant": "", 2023-10-05T19:50:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "zonegroup": "62f730cc-f2d2-47e0-99d9-6d51a9a03581", 2023-10-05T19:50:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_rule": "default-placement", 2023-10-05T19:50:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "explicit_placement": { 2023-10-05T19:50:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "", 2023-10-05T19:50:41.446 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "" 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "marker": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": "Normal", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "ver": "0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "mtime": "2023-10-05T19:50:40.624490Z", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "creation_time": "2023-10-05T19:50:36.660701Z", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "max_marker": "0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#", 2023-10-05T19:50:41.447 INFO:teuthology.orchestra.run.smithi167.stdout: "usage": { 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "rgw.main": { 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "size": 0, 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "size_actual": 0, 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "size_utilized": 0, 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "size_kb": 0, 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "size_kb_actual": 0, 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "size_kb_utilized": 0, 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "num_objects": 0 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:41.448 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:41.449 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:41.449 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:41.450 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '62f730cc-f2d2-47e0-99d9-6d51a9a03581', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T19:50:40.624490Z', 'creation_time': '2023-10-05T19:50:36.660701Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T19:50:41.450 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2023-10-05T19:50:41.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2023-10-05T19:50:41.450 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2023-10-05T19:50:41.486 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:41.486 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:41.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 Processor -- start 2023-10-05T19:50:41.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 -- start start 2023-10-05T19:50:41.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557c9ffaf0e0 0x557c9ffb14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557c9fef5c00 con 0x557c9ffaab60 2023-10-05T19:50:41.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x557c9feb2ee0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867635e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557c9ffaf0e0 0x557c9ffb14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867635e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557c9ffaf0e0 0x557c9ffb14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46068/0 (socket says 172.21.15.167:46068) 2023-10-05T19:50:41.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867635e700 1 -- 172.21.15.167:0/530588246 learned_addr learned my addr 172.21.15.167:0/530588246 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867635e700 1 -- 172.21.15.167:0/530588246 >> v1:172.21.15.118:6789/0 conn(0x557c9ffaab60 legacy=0x557c9ffaaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867635e700 1 -- 172.21.15.167:0/530588246 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c9ffab770 con 0x557c9ffaf0e0 2023-10-05T19:50:41.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f8675b5d700 1 -- 172.21.15.167:0/530588246 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242293257 0 0) 0x557c9fef5c00 con 0x557c9ffaab60 2023-10-05T19:50:41.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867635e700 1 --2- 172.21.15.167:0/530588246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaf0e0 0x557c9ffb14c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f866000a5c0 tx=0x7f8660005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af580f5cbf538749 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f8675b5d700 1 -- 172.21.15.167:0/530588246 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f866000e510 con 0x557c9ffaf0e0 2023-10-05T19:50:41.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f8675b5d700 1 -- 172.21.15.167:0/530588246 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866000e670 con 0x557c9ffaf0e0 2023-10-05T19:50:41.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f8675b5d700 1 -- 172.21.15.167:0/530588246 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f866000e920 con 0x557c9ffaf0e0 2023-10-05T19:50:41.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 -- 172.21.15.167:0/530588246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaf0e0 msgr2=0x557c9ffb14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 --2- 172.21.15.167:0/530588246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaf0e0 0x557c9ffb14c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f866000a5c0 tx=0x7f8660005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:41.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 -- 172.21.15.167:0/530588246 shutdown_connections 2023-10-05T19:50:41.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 --2- 172.21.15.167:0/530588246 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaf0e0 0x557c9ffb14c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 -- 172.21.15.167:0/530588246 >> 172.21.15.167:0/530588246 conn(0x557c9ff1e510 msgr2=0x557c9ffa8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 -- 172.21.15.167:0/530588246 shutdown_connections 2023-10-05T19:50:41.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.480+0000 7f867902ae40 1 -- 172.21.15.167:0/530588246 wait complete. 2023-10-05T19:50:41.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 Processor -- start 2023-10-05T19:50:41.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 -- start start 2023-10-05T19:50:41.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffc9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c9fe76e30 con 0x557c9ffaab60 2023-10-05T19:50:41.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f8676b5f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffc9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f8676b5f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffc9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46078/0 (socket says 172.21.15.167:46078) 2023-10-05T19:50:41.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f8676b5f700 1 -- 172.21.15.167:0/2229293371 learned_addr learned my addr 172.21.15.167:0/2229293371 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f8676b5f700 1 -- 172.21.15.167:0/2229293371 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866000a180 con 0x557c9ffaab60 2023-10-05T19:50:41.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f8676b5f700 1 --2- 172.21.15.167:0/2229293371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffc9a50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8668001d20 tx=0x7f86680018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a0d8456d2d8349 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f8674b5b700 1 -- 172.21.15.167:0/2229293371 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8668014070 con 0x557c9ffaab60 2023-10-05T19:50:41.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f8674b5b700 1 -- 172.21.15.167:0/2229293371 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8668008070 con 0x557c9ffaab60 2023-10-05T19:50:41.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f8674b5b700 1 -- 172.21.15.167:0/2229293371 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f866800bd30 con 0x557c9ffaab60 2023-10-05T19:50:41.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 -- 172.21.15.167:0/2229293371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 msgr2=0x557c9ffc9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 --2- 172.21.15.167:0/2229293371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffc9a50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8668001d20 tx=0x7f86680018b0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 -- 172.21.15.167:0/2229293371 shutdown_connections 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 --2- 172.21.15.167:0/2229293371 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffc9a50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 -- 172.21.15.167:0/2229293371 >> 172.21.15.167:0/2229293371 conn(0x557c9ff1e510 msgr2=0x557c9ffc5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 -- 172.21.15.167:0/2229293371 shutdown_connections 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 -- 172.21.15.167:0/2229293371 wait complete. 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 Processor -- start 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.484+0000 7f867902ae40 1 -- start start 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f867902ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffd07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f867902ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c9fe49ed0 con 0x557c9ffaab60 2023-10-05T19:50:41.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f8676b5f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffd07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f8676b5f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffd07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46094/0 (socket says 172.21.15.167:46094) 2023-10-05T19:50:41.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 learned_addr learned my addr 172.21.15.167:0/656385948 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866800a040 con 0x557c9ffaab60 2023-10-05T19:50:41.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f8676b5f700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffd07e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x557c9ffc6130 tx=0x7f8668016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f866effd700 1 -- 172.21.15.167:0/656385948 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f866800bdc0 con 0x557c9ffaab60 2023-10-05T19:50:41.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f866effd700 1 -- 172.21.15.167:0/656385948 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8668021070 con 0x557c9ffaab60 2023-10-05T19:50:41.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c9ffd0d20 con 0x557c9ffaab60 2023-10-05T19:50:41.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f866effd700 1 -- 172.21.15.167:0/656385948 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f866801a5e0 con 0x557c9ffaab60 2023-10-05T19:50:41.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c9ffd11c0 con 0x557c9ffaab60 2023-10-05T19:50:41.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.488+0000 7f866effd700 1 -- 172.21.15.167:0/656385948 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f866801a7d0 con 0x557c9ffaab60 2023-10-05T19:50:41.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f866effd700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f865c030c40 0x7f865c0330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f866effd700 1 -- 172.21.15.167:0/656385948 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f8668044c80 con 0x557c9ffaab60 2023-10-05T19:50:41.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867635e700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f865c030c40 0x7f865c0330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557c9ffaf0e0 0x557c9ffdc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffdc980 con 0x557c9ffaf0e0 2023-10-05T19:50:41.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f8677360700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557c9ffaf0e0 0x557c9ffdc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867635e700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f865c030c40 0x7f865c0330f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8660000f80 tx=0x7f8660013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f8677360700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557c9ffaf0e0 0x557c9ffdc3a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f867000a500 con 0x557c9ffaf0e0 2023-10-05T19:50:41.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 20 realm 2023-10-05T19:50:41.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffd9a00 con 0x557c9ffaf0e0 2023-10-05T19:50:41.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f867000a500 con 0x557c9ffaf0e0 2023-10-05T19:50:41.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:41.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffdd460 con 0x557c9ffaf0e0 2023-10-05T19:50:41.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f867000a500 con 0x557c9ffaf0e0 2023-10-05T19:50:41.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557c9ffdd090 0x557c9ffe02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.492+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe0a00 con 0x557c9ffdd090 2023-10-05T19:50:41.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f8676b5f700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557c9ffdd090 0x557c9ffe02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f8676b5f700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557c9ffdd090 0x557c9ffe02d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867902ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe12d0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f867000a500 con 0x557c9ffaf0e0 2023-10-05T19:50:41.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867902ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867902ae40 20 searching for the correct realm 2023-10-05T19:50:41.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557c9ffe0e40 0x557c9ffe50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffe0e40 2023-10-05T19:50:41.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867635e700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557c9ffe0e40 0x557c9ffe50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867635e700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557c9ffe0e40 0x557c9ffe50a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.496+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffdd090 2023-10-05T19:50:41.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8676b5f700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8668042130 0x7f866803d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x7f8668042130 2023-10-05T19:50:41.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8677360700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8668042130 0x7f866803d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8677360700 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8668042130 0x7f866803d3d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x7f8668042130 2023-10-05T19:50:41.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffe0e40 2023-10-05T19:50:41.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.500+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffdd090 2023-10-05T19:50:41.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffdd090 2023-10-05T19:50:41.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x7f8668042130 2023-10-05T19:50:41.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x7f8668042130 2023-10-05T19:50:41.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x7f8668042130 2023-10-05T19:50:41.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x7f8668042130 2023-10-05T19:50:41.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.504+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffdd090 2023-10-05T19:50:41.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffe0e40 2023-10-05T19:50:41.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffdd090 2023-10-05T19:50:41.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffe0e40 2023-10-05T19:50:41.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.508+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffe0e40 2023-10-05T19:50:41.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x7f8668042130 2023-10-05T19:50:41.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x7f8668042130 2023-10-05T19:50:41.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffaf0e0 2023-10-05T19:50:41.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x7f8668042130 2023-10-05T19:50:41.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x7f8668042130 2023-10-05T19:50:41.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.512+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffe0e40 2023-10-05T19:50:41.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x7f8668042130 2023-10-05T19:50:41.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x7f8668042130 2023-10-05T19:50:41.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffdd090 2023-10-05T19:50:41.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffdd090 2023-10-05T19:50:41.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffe0e40 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffdd090 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.516+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5680 con 0x557c9ffdd090 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe1e40 con 0x557c9ffaf0e0 2023-10-05T19:50:41.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe2790 con 0x557c9ffdd090 2023-10-05T19:50:41.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8668016070 con 0x557c9ffdd090 2023-10-05T19:50:41.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe19d0 con 0x557c9ffdd090 2023-10-05T19:50:41.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6030 con 0x557c9ffe0e40 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.520+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6790 con 0x557c9ffdd090 2023-10-05T19:50:41.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f867902ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe7b50 con 0x557c9ffe0e40 2023-10-05T19:50:41.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe7b50 con 0x557c9ffdd090 2023-10-05T19:50:41.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe7b50 con 0x7f8668042130 2023-10-05T19:50:41.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x7f8668042130 2023-10-05T19:50:41.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.524+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffe0e40 2023-10-05T19:50:41.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffdd090 2023-10-05T19:50:41.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffdd090 2023-10-05T19:50:41.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x7f8668042130 2023-10-05T19:50:41.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x7f8668042130 2023-10-05T19:50:41.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.528+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x7f8668042130 2023-10-05T19:50:41.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x7f8668042130 2023-10-05T19:50:41.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffdd090 2023-10-05T19:50:41.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffe0e40 2023-10-05T19:50:41.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffdd090 2023-10-05T19:50:41.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.532+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffe0e40 2023-10-05T19:50:41.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670014040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffe0e40 2023-10-05T19:50:41.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x7f8668042130 2023-10-05T19:50:41.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.536+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffaf0e0 2023-10-05T19:50:41.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x7f8668042130 2023-10-05T19:50:41.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffe0e40 2023-10-05T19:50:41.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x7f8668042130 2023-10-05T19:50:41.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffdd090 2023-10-05T19:50:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffdd090 2023-10-05T19:50:41.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.540+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffe0e40 2023-10-05T19:50:41.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffdd090 2023-10-05T19:50:41.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557c9ffdd090 2023-10-05T19:50:41.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x557c9ffdd090 2023-10-05T19:50:41.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x557c9ffaf0e0 2023-10-05T19:50:41.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.544+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5bd0 con 0x557c9ffdd090 2023-10-05T19:50:41.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f866804a040 con 0x557c9ffdd090 2023-10-05T19:50:41.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe5be0 con 0x557c9ffdd090 2023-10-05T19:50:41.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe7470 con 0x7f8668042130 2023-10-05T19:50:41.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 zone default found 2023-10-05T19:50:41.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 4 Realm: () 2023-10-05T19:50:41.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:41.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:41.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:41.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 zonegroup default 2023-10-05T19:50:41.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe7470 con 0x7f8668042130 2023-10-05T19:50:41.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe8df0 con 0x557c9ffe0e40 2023-10-05T19:50:41.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.548+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867902ae40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe91a0 con 0x557c9ffe0e40 2023-10-05T19:50:41.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867902ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867902ae40 20 started sync module instance, tier type = 2023-10-05T19:50:41.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867902ae40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:41.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe84b0 con 0x557c9ffdd090 2023-10-05T19:50:41.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93993748557552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe84b0 con 0x557c9ffdd090 2023-10-05T19:50:41.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.552+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe9b40 con 0x557c9ffaf0e0 2023-10-05T19:50:41.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.556+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.556+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93993748567568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe9a60 con 0x557c9ffaf0e0 2023-10-05T19:50:41.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.556+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffea960 con 0x557c9ffdd090 2023-10-05T19:50:41.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.556+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93993748557552] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.556+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93993748567568] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.556+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.556+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93993748564064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffea430 con 0x557c9ffdd090 2023-10-05T19:50:41.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.556+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffeb250 con 0x7f8668042130 2023-10-05T19:50:41.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.560+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.560+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93993748573536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffea430 con 0x7f8668042130 2023-10-05T19:50:41.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.560+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffebb90 con 0x557c9ffdd090 2023-10-05T19:50:41.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.560+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93993748564064] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.560+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93993748573536] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93993748570448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffeb6a0 con 0x557c9ffdd090 2023-10-05T19:50:41.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffebf40 con 0x557c9ffe0e40 2023-10-05T19:50:41.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93993748576464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffec7e0 con 0x557c9ffe0e40 2023-10-05T19:50:41.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffed230 con 0x557c9ffe0e40 2023-10-05T19:50:41.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93993748570448] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 93993748576464] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93993748574640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffedb20 con 0x557c9ffe0e40 2023-10-05T19:50:41.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.564+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffeded0 con 0x7f8668042130 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93993748574640] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8660017050 con 0x557c9ffe0e40 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93993748583984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffee3c0 con 0x7f8668042130 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 20 add_watcher() i=0 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 20 add_watcher() i=1 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 20 add_watcher() i=2 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 20 add_watcher() i=3 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 20 add_watcher() i=4 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 20 add_watcher() i=5 2023-10-05T19:50:41.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 20 add_watcher() i=6 2023-10-05T19:50:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93993748583984] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 20 add_watcher() i=7 2023-10-05T19:50:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:41.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9fff1420 con 0x557c9ffaf0e0 2023-10-05T19:50:41.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.568+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93993748586192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffee810 con 0x557c9ffaf0e0 2023-10-05T19:50:41.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93993748586192] v30'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f86477ee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867902ae40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:41.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867902ae40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:41.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867902ae40 1 Processor -- start 2023-10-05T19:50:41.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867902ae40 1 -- start start 2023-10-05T19:50:41.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867902ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557c9fffbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867902ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c9fffc2a0 con 0x557c9fffb990 2023-10-05T19:50:41.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867635e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557c9fffbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867635e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557c9fffbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46108/0 (socket says 172.21.15.167:46108) 2023-10-05T19:50:41.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867635e700 1 -- 172.21.15.167:0/882988986 learned_addr learned my addr 172.21.15.167:0/882988986 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867635e700 1 -- 172.21.15.167:0/882988986 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c9fffc3e0 con 0x557c9fffb990 2023-10-05T19:50:41.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.572+0000 7f867635e700 1 --2- 172.21.15.167:0/882988986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557c9fffbd60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8660003000 tx=0x7f8660010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54511cabe14cccf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f8646fed700 1 -- 172.21.15.167:0/882988986 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f866002d040 con 0x557c9fffb990 2023-10-05T19:50:41.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f8646fed700 1 -- 172.21.15.167:0/882988986 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8660010b50 con 0x557c9fffb990 2023-10-05T19:50:41.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f8646fed700 1 -- 172.21.15.167:0/882988986 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8660010d00 con 0x557c9fffb990 2023-10-05T19:50:41.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 -- 172.21.15.167:0/882988986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 msgr2=0x557c9fffbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 --2- 172.21.15.167:0/882988986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557c9fffbd60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8660003000 tx=0x7f8660010000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 -- 172.21.15.167:0/882988986 shutdown_connections 2023-10-05T19:50:41.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 --2- 172.21.15.167:0/882988986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557c9fffbd60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 -- 172.21.15.167:0/882988986 >> 172.21.15.167:0/882988986 conn(0x557c9fff6d50 msgr2=0x557c9fff4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 -- 172.21.15.167:0/882988986 shutdown_connections 2023-10-05T19:50:41.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 -- 172.21.15.167:0/882988986 wait complete. 2023-10-05T19:50:41.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 Processor -- start 2023-10-05T19:50:41.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 -- start start 2023-10-05T19:50:41.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557ca0001380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867902ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ca0002380 con 0x557c9fffb990 2023-10-05T19:50:41.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867635e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557ca0001380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867635e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557ca0001380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46114/0 (socket says 172.21.15.167:46114) 2023-10-05T19:50:41.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 learned_addr learned my addr 172.21.15.167:0/2744164650 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c9ffab770 con 0x557c9fffb990 2023-10-05T19:50:41.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.576+0000 7f867635e700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557ca0001380 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8660010b20 tx=0x7f866002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f86457ea700 1 -- 172.21.15.167:0/2744164650 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8660033430 con 0x557c9fffb990 2023-10-05T19:50:41.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f86457ea700 1 -- 172.21.15.167:0/2744164650 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8660033590 con 0x557c9fffb990 2023-10-05T19:50:41.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557ca0001980 con 0x557c9fffb990 2023-10-05T19:50:41.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f86457ea700 1 -- 172.21.15.167:0/2744164650 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8660033760 con 0x557c9fffb990 2023-10-05T19:50:41.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ca0001dc0 con 0x557c9fffb990 2023-10-05T19:50:41.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f86457ea700 1 -- 172.21.15.167:0/2744164650 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f86600338c0 con 0x557c9fffb990 2023-10-05T19:50:41.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f86457ea700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f85bc030ca0 0x7f85bc033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f86457ea700 1 -- 172.21.15.167:0/2744164650 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f8660046c20 con 0x557c9fffb990 2023-10-05T19:50:41.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f8677360700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f85bc030ca0 0x7f85bc033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f867902ae40 5 note: GC not initialized 2023-10-05T19:50:41.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.580+0000 7f8677360700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f85bc030ca0 0x7f85bc033150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x557c9fff14f0 tx=0x7f867000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f85affff700 20 reqs_thread_entry: start 2023-10-05T19:50:41.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f867902ae40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:41.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f85b67fc700 20 reqs_thread_entry: start 2023-10-05T19:50:41.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f867902ae40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:41.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f85ae7fc700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:11 2023 2023-10-05T19:50:41.592 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:41.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f85adffb700 20 reqs_thread_entry: start 2023-10-05T19:50:41.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f867902ae40 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557ca0069920 0x557ca006bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557ca006c240 con 0x557ca0069920 2023-10-05T19:50:41.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f8676b5f700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557ca0069920 0x557ca006bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f8676b5f700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557ca0069920 0x557ca006bd00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 [pgnls start_epoch 30 out=254b] v30'37 uv29 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8668053040 con 0x557ca0069920 2023-10-05T19:50:41.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x557ca0069920 2023-10-05T19:50:41.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 [pgnls start_epoch 30 out=131b] v30'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f8668053040 con 0x557ca0069920 2023-10-05T19:50:41.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f8676b5f700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f8668017b80 0x7f866801d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.584+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:3 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe63e0 con 0x7f8668017b80 2023-10-05T19:50:41.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.588+0000 7f867635e700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f8668017b80 0x7f866801d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.588+0000 7f867635e700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f8668017b80 0x7f866801d7c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.588+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(3 [pgnls start_epoch 30 out=322b] v30'25 uv21 ondisk = 1) v8 ==== 144+0+322 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.588+0000 7f867635e700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8660010070 0x7f866001b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.588+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:4 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffedb20 con 0x7f8660010070 2023-10-05T19:50:41.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.588+0000 7f8677360700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8660010070 0x7f866001b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.588+0000 7f8677360700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8660010070 0x7f866001b390 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.588+0000 7f8677360700 1 -- 172.21.15.167:0/2744164650 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(4 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8670033040 con 0x7f8660010070 2023-10-05T19:50:41.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.588+0000 7f8677360700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x557ca0069920 2023-10-05T19:50:41.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.592+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(5 [pgnls start_epoch 30 out=335b] v30'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7f8668053040 con 0x557ca0069920 2023-10-05T19:50:41.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.592+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:6 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8660010070 2023-10-05T19:50:41.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.592+0000 7f8677360700 1 -- 172.21.15.167:0/2744164650 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(6 [pgnls start_epoch 30 out=213b] v30'13 uv13 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8670033040 con 0x7f8660010070 2023-10-05T19:50:41.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.592+0000 7f8677360700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f8670046040 0x7f867001b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.592+0000 7f8677360700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:7 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.592+0000 7f8676b5f700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f8670046040 0x7f867001b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.592+0000 7f8676b5f700 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f8670046040 0x7f867001b420 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.592+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.592+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:8 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.596+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(8 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.596+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:9 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.596+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(9 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.596+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.596+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(10 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.596+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.596+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(11 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.596+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:12 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(12 [pgnls start_epoch 30 out=206b] v30'25 uv24 ondisk = 1) v8 ==== 144+0+206 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:13 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:14 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=90b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:15 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(15 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:16 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(16 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x557ca0069920 2023-10-05T19:50:41.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(17 [pgnls start_epoch 30 out=254b] v30'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8668053040 con 0x557ca0069920 2023-10-05T19:50:41.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.600+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(18 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:19 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(19 [pgnls start_epoch 30 out=172b] v30'31 uv23 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:20 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(20 [pgnls start_epoch 30 out=295b] v30'24 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(21 [pgnls start_epoch 30 out=276b] v30'13 uv13 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(22 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.604+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:23 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(23 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x557ca0069920 2023-10-05T19:50:41.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(24 [pgnls start_epoch 30 out=172b] v30'29 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8668053040 con 0x557ca0069920 2023-10-05T19:50:41.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:25 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=289b] v30'45 uv33 ondisk = 1) v8 ==== 144+0+289 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(26 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(27 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:28 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(28 [pgnls start_epoch 30 out=166b] v30'15 uv11 ondisk = 1) v8 ==== 144+0+166 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.608+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:29 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8668017b80 2023-10-05T19:50:41.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.612+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=90b] v30'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f8660042070 con 0x7f8668017b80 2023-10-05T19:50:41.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.612+0000 7f867635e700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:30 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x557ca0069920 2023-10-05T19:50:41.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.612+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(30 [pgnls start_epoch 30 out=131b] v30'7 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f8668053040 con 0x557ca0069920 2023-10-05T19:50:41.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.612+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:31 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8660010070 2023-10-05T19:50:41.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.612+0000 7f8677360700 1 -- 172.21.15.167:0/2744164650 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(31 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8670033040 con 0x7f8660010070 2023-10-05T19:50:41.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.612+0000 7f8677360700 1 -- 172.21.15.167:0/2744164650 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:32 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe6b40 con 0x7f8670046040 2023-10-05T19:50:41.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.612+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(32 [pgnls start_epoch 30 out=289b] v30'21 uv17 ondisk = 1) v8 ==== 144+0+289 (crc 0 0 0) 0x7f8668053040 con 0x7f8670046040 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout:[ 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000078", 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000070", 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000104", 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000026", 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000028", 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000040", 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000015", 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000069", 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000095", 2023-10-05T19:50:41.623 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000003", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000047", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000035", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000037", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "2023-10-05-19--", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000024", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000000", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000031", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "data_loggenerations_metadata", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000076", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000113", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000005", 2023-10-05T19:50:41.624 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000011", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000058", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000052", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000088", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000080", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000090", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000110", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000096", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000087", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000008", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000006", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000029", 2023-10-05T19:50:41.625 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000089", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000022", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000016", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000041", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000018", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000092", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000014", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000112", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000007", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000021", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000064", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000071", 2023-10-05T19:50:41.626 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000074", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000081", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000009", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000121", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000125", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000082", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000105", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000059", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000077", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000032", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000053", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000091", 2023-10-05T19:50:41.627 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000065", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000083", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000010", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000045", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000002", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000116", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000034", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000101", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000079", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000049", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000117", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000044", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000066", 2023-10-05T19:50:41.628 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000068", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000085", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000073", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000038", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000118", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000036", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000103", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000119", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000098", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000027", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000019", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000039", 2023-10-05T19:50:41.629 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000100", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000093", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000004", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000063", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000122", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000057", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000054", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000114", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "data_log.0", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000012", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000084", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000043", 2023-10-05T19:50:41.630 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000111", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000048", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000020", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000099", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000056", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000072", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000062", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000115", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000033", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000025", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000123", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000108", 2023-10-05T19:50:41.631 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000094", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000060", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000109", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000013", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000051", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000106", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000017", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000023", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000107", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000046", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000067", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2", 2023-10-05T19:50:41.632 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000086", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000050", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000102", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000124", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000001", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000126", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000055", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000061", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000097", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000042", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000075", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000120", 2023-10-05T19:50:41.633 INFO:teuthology.orchestra.run.smithi167.stdout: "obj_delete_at_hint.0000000030" 2023-10-05T19:50:41.634 INFO:teuthology.orchestra.run.smithi167.stdout:] 2023-10-05T19:50:41.634 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.616+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93993748557552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffedb20 con 0x557c9ffdd090 2023-10-05T19:50:41.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.616+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 93993748557552] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.616+0000 7f867902ae40 20 remove_watcher() i=0 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.616+0000 7f867902ae40 2 removed watcher, disabling cache 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.616+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93993748567568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffedb20 con 0x557c9ffaf0e0 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.620+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 93993748567568] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.620+0000 7f867902ae40 20 remove_watcher() i=1 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.620+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93993748564064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffc0330 con 0x557c9ffdd090 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.624+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 93993748564064] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.624+0000 7f867902ae40 20 remove_watcher() i=2 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.624+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93993748573536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffc0330 con 0x7f8668042130 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.624+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 93993748573536] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.624+0000 7f867902ae40 20 remove_watcher() i=3 2023-10-05T19:50:41.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.624+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93993748570448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffc0330 con 0x557c9ffdd090 2023-10-05T19:50:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.628+0000 7f8676b5f700 1 -- 172.21.15.167:0/656385948 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 93993748570448] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8668053040 con 0x557c9ffdd090 2023-10-05T19:50:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.628+0000 7f867902ae40 20 remove_watcher() i=4 2023-10-05T19:50:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.628+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93993748576464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffc0330 con 0x557c9ffe0e40 2023-10-05T19:50:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.628+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 93993748576464] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8660042070 con 0x557c9ffe0e40 2023-10-05T19:50:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.628+0000 7f867902ae40 20 remove_watcher() i=5 2023-10-05T19:50:41.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.628+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93993748574640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe9610 con 0x557c9ffe0e40 2023-10-05T19:50:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.632+0000 7f867635e700 1 -- 172.21.15.167:0/656385948 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 93993748574640] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8660042070 con 0x557c9ffe0e40 2023-10-05T19:50:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.632+0000 7f867902ae40 20 remove_watcher() i=6 2023-10-05T19:50:41.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.632+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93993748583984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffea150 con 0x7f8668042130 2023-10-05T19:50:41.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.632+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 93993748583984] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8670033040 con 0x7f8668042130 2023-10-05T19:50:41.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.632+0000 7f867902ae40 20 remove_watcher() i=7 2023-10-05T19:50:41.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f86477ee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93993748586192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557c9ffe9610 con 0x557c9ffaf0e0 2023-10-05T19:50:41.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 93993748586192] v30'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8670033040 con 0x557c9ffaf0e0 2023-10-05T19:50:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557c9ffdd090 msgr2=0x557c9ffe02d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557c9ffdd090 0x557c9ffe02d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557c9ffaf0e0 msgr2=0x557c9ffdc3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557c9ffaf0e0 0x557c9ffdc3a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8668042130 msgr2=0x7f866803d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8668042130 0x7f866803d3d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557c9ffe0e40 msgr2=0x557c9ffe50a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557c9ffe0e40 0x557c9ffe50a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f865c030c40 msgr2=0x7f865c0330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f865c030c40 0x7f865c0330f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8660000f80 tx=0x7f8660013000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f8677360700 1 -- 172.21.15.167:0/656385948 reap_dead start 2023-10-05T19:50:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 msgr2=0x557c9ffd07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffd07e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x557c9ffc6130 tx=0x7f8668016000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 shutdown_connections 2023-10-05T19:50:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/656385948 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9ffaab60 0x557c9ffd07e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 >> 172.21.15.167:0/656385948 conn(0x557c9ff1e510 msgr2=0x557c9ffc4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 shutdown_connections 2023-10-05T19:50:41.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/656385948 wait complete. 2023-10-05T19:50:41.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f8668017b80 msgr2=0x7f866801d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x7f8668017b80 0x7f866801d7c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557ca0069920 msgr2=0x557ca006bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557ca0069920 0x557ca006bd00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8660010070 msgr2=0x7f866001b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8660010070 0x7f866001b390 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f8670046040 msgr2=0x7f867001b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.636+0000 7f867902ae40 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x7f8670046040 0x7f867001b420 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f85bc030ca0 msgr2=0x7f85bc033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f867902ae40 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f85bc030ca0 0x7f85bc033150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x557c9fff14f0 tx=0x7f867000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 msgr2=0x557ca0001380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f867902ae40 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557ca0001380 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8660010b20 tx=0x7f866002c000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f8676b5f700 1 -- 172.21.15.167:0/2744164650 reap_dead start 2023-10-05T19:50:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 shutdown_connections 2023-10-05T19:50:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f867902ae40 1 --2- 172.21.15.167:0/2744164650 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557c9fffb990 0x557ca0001380 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 >> 172.21.15.167:0/2744164650 conn(0x557c9fff6d50 msgr2=0x557c9fff4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 shutdown_connections 2023-10-05T19:50:41.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.640+0000 7f867902ae40 1 -- 172.21.15.167:0/2744164650 wait complete. 2023-10-05T19:50:41.652 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', '2023-10-05-19--', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2023-10-05T19:50:41.652 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-19--'] 2023-10-05T19:50:41.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-19--'] 2023-10-05T19:50:41.652 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-19-- 2023-10-05T19:50:41.688 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:41.689 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:41.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.680+0000 7f78db5b8e40 1 Processor -- start 2023-10-05T19:50:41.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.680+0000 7f78db5b8e40 1 -- start start 2023-10-05T19:50:41.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.680+0000 7f78db5b8e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5613e4d78920 0x5613e4d78cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.680+0000 7f78db5b8e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5613e4cc5bd0 con 0x5613e4d79230 2023-10-05T19:50:41.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.680+0000 7f78db5b8e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5613e4c82ee0 con 0x5613e4d78920 2023-10-05T19:50:41.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.680+0000 7f78d90ed700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5613e4d78920 0x5613e4d78cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.680+0000 7f78d88ec700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x5613e4d79230 0x5613e4d79cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51798/0 (socket says 172.21.15.167:51798) 2023-10-05T19:50:41.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.680+0000 7f78d88ec700 1 -- 172.21.15.167:0/2789551410 learned_addr learned my addr 172.21.15.167:0/2789551410 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:41.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d90ed700 1 -- 172.21.15.167:0/2789551410 >> v1:172.21.15.118:6789/0 conn(0x5613e4d79230 legacy=0x5613e4d79cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d3fff700 1 -- 172.21.15.167:0/2789551410 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566135098 0 0) 0x5613e4cc5bd0 con 0x5613e4d79230 2023-10-05T19:50:41.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d90ed700 1 -- 172.21.15.167:0/2789551410 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613e4d7a3e0 con 0x5613e4d78920 2023-10-05T19:50:41.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d90ed700 1 --2- 172.21.15.167:0/2789551410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d78cf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00a520 tx=0x7f78cc005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc3748e532a720 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d3fff700 1 -- 172.21.15.167:0/2789551410 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78cc00f590 con 0x5613e4d78920 2023-10-05T19:50:41.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d3fff700 1 -- 172.21.15.167:0/2789551410 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc00f6f0 con 0x5613e4d78920 2023-10-05T19:50:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d3fff700 1 -- 172.21.15.167:0/2789551410 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78cc00f880 con 0x5613e4d78920 2023-10-05T19:50:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 -- 172.21.15.167:0/2789551410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 msgr2=0x5613e4d78cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/2789551410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d78cf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00a520 tx=0x7f78cc005d40 comp rx=0 tx=0).stop 2023-10-05T19:50:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 -- 172.21.15.167:0/2789551410 shutdown_connections 2023-10-05T19:50:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/2789551410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d78cf0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 -- 172.21.15.167:0/2789551410 >> 172.21.15.167:0/2789551410 conn(0x5613e4d74340 msgr2=0x5613e4d76750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 -- 172.21.15.167:0/2789551410 shutdown_connections 2023-10-05T19:50:41.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 -- 172.21.15.167:0/2789551410 wait complete. 2023-10-05T19:50:41.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 Processor -- start 2023-10-05T19:50:41.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 -- start start 2023-10-05T19:50:41.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d97750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78db5b8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613e4c46e30 con 0x5613e4d78920 2023-10-05T19:50:41.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d90ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d97750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d90ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d97750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46140/0 (socket says 172.21.15.167:46140) 2023-10-05T19:50:41.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.684+0000 7f78d90ed700 1 -- 172.21.15.167:0/1333588832 learned_addr learned my addr 172.21.15.167:0/1333588832 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78d90ed700 1 -- 172.21.15.167:0/1333588832 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc00a0e0 con 0x5613e4d78920 2023-10-05T19:50:41.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78d90ed700 1 --2- 172.21.15.167:0/1333588832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d97750 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f78cc005b20 tx=0x7f78cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1520c1f2deb7c091 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78d2ffd700 1 -- 172.21.15.167:0/1333588832 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78cc00f860 con 0x5613e4d78920 2023-10-05T19:50:41.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78d2ffd700 1 -- 172.21.15.167:0/1333588832 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc00f9c0 con 0x5613e4d78920 2023-10-05T19:50:41.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78d2ffd700 1 -- 172.21.15.167:0/1333588832 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78cc00fb70 con 0x5613e4d78920 2023-10-05T19:50:41.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1333588832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 msgr2=0x5613e4d97750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1333588832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d97750 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f78cc005b20 tx=0x7f78cc014000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1333588832 shutdown_connections 2023-10-05T19:50:41.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1333588832 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d97750 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1333588832 >> 172.21.15.167:0/1333588832 conn(0x5613e4d74340 msgr2=0x5613e4d93310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1333588832 shutdown_connections 2023-10-05T19:50:41.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1333588832 wait complete. 2023-10-05T19:50:41.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 Processor -- start 2023-10-05T19:50:41.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 -- start start 2023-10-05T19:50:41.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d9e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78db5b8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613e4c19ed0 con 0x5613e4d78920 2023-10-05T19:50:41.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78d90ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d9e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78d90ed700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d9e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46150/0 (socket says 172.21.15.167:46150) 2023-10-05T19:50:41.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 learned_addr learned my addr 172.21.15.167:0/1442589396 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.688+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613e4d7a3e0 con 0x5613e4d78920 2023-10-05T19:50:41.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78d90ed700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d9e450 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5613e4d93e30 tx=0x7f78cc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78d17fa700 1 -- 172.21.15.167:0/1442589396 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78cc02f430 con 0x5613e4d78920 2023-10-05T19:50:41.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78d17fa700 1 -- 172.21.15.167:0/1442589396 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc02f5b0 con 0x5613e4d78920 2023-10-05T19:50:41.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613e4d9e990 con 0x5613e4d78920 2023-10-05T19:50:41.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78d17fa700 1 -- 172.21.15.167:0/1442589396 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78cc02f760 con 0x5613e4d78920 2023-10-05T19:50:41.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613e4d9ee30 con 0x5613e4d78920 2023-10-05T19:50:41.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78d17fa700 1 -- 172.21.15.167:0/1442589396 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f78cc010420 con 0x5613e4d78920 2023-10-05T19:50:41.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78d17fa700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f78c0030ca0 0x7f78c0033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78d17fa700 1 -- 172.21.15.167:0/1442589396 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f78cc02b070 con 0x5613e4d78920 2023-10-05T19:50:41.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78d88ec700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f78c0030ca0 0x7f78c0033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5613e4d79230 0x5613e4da9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4daa5b0 con 0x5613e4d79230 2023-10-05T19:50:41.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.692+0000 7f78d98ee700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5613e4d79230 0x5613e4da9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78d88ec700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f78c0030ca0 0x7f78c0033150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78c40011e0 tx=0x7f78c40013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78d98ee700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5613e4d79230 0x5613e4da9f00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78d400a500 con 0x5613e4d79230 2023-10-05T19:50:41.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 20 realm 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4da7560 con 0x5613e4d79230 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78d400a500 con 0x5613e4d79230 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dab090 con 0x5613e4d79230 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78d400a500 con 0x5613e4d79230 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4daacc0 0x5613e4dadf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dae630 con 0x5613e4daacc0 2023-10-05T19:50:41.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78d90ed700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4daacc0 0x5613e4dadf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.696+0000 7f78d90ed700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4daacc0 0x5613e4dadf00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f78cc0387d0 con 0x5613e4daacc0 2023-10-05T19:50:41.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78db5b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4daef00 con 0x5613e4d79230 2023-10-05T19:50:41.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f78d400a500 con 0x5613e4d79230 2023-10-05T19:50:41.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78db5b8e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78db5b8e40 20 searching for the correct realm 2023-10-05T19:50:41.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5613e4daea70 0x5613e4db2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daea70 2023-10-05T19:50:41.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d88ec700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5613e4daea70 0x5613e4db2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d88ec700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5613e4daea70 0x5613e4db2cd0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4006070 con 0x5613e4daea70 2023-10-05T19:50:41.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daacc0 2023-10-05T19:50:41.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc0387d0 con 0x5613e4daacc0 2023-10-05T19:50:41.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d90ed700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f78cc045040 0x7f78cc0289f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x7f78cc045040 2023-10-05T19:50:41.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d98ee700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f78cc045040 0x7f78cc0289f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.700+0000 7f78d98ee700 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f78cc045040 0x7f78cc0289f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x7f78cc045040 2023-10-05T19:50:41.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daea70 2023-10-05T19:50:41.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4006070 con 0x5613e4daea70 2023-10-05T19:50:41.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daacc0 2023-10-05T19:50:41.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc0387d0 con 0x5613e4daacc0 2023-10-05T19:50:41.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daacc0 2023-10-05T19:50:41.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc0387d0 con 0x5613e4daacc0 2023-10-05T19:50:41.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.704+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x7f78cc045040 2023-10-05T19:50:41.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x7f78cc045040 2023-10-05T19:50:41.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x7f78cc045040 2023-10-05T19:50:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x7f78cc045040 2023-10-05T19:50:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daacc0 2023-10-05T19:50:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc04e040 con 0x5613e4daacc0 2023-10-05T19:50:41.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daea70 2023-10-05T19:50:41.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4006070 con 0x5613e4daea70 2023-10-05T19:50:41.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.708+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daacc0 2023-10-05T19:50:41.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc04e040 con 0x5613e4daacc0 2023-10-05T19:50:41.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daea70 2023-10-05T19:50:41.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4006070 con 0x5613e4daea70 2023-10-05T19:50:41.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daea70 2023-10-05T19:50:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4006070 con 0x5613e4daea70 2023-10-05T19:50:41.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x7f78cc045040 2023-10-05T19:50:41.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x7f78cc045040 2023-10-05T19:50:41.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4d79230 2023-10-05T19:50:41.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.712+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x7f78cc045040 2023-10-05T19:50:41.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x7f78cc045040 2023-10-05T19:50:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daea70 2023-10-05T19:50:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4006070 con 0x5613e4daea70 2023-10-05T19:50:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x7f78cc045040 2023-10-05T19:50:41.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x7f78cc045040 2023-10-05T19:50:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daacc0 2023-10-05T19:50:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc04e040 con 0x5613e4daacc0 2023-10-05T19:50:41.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daacc0 2023-10-05T19:50:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc04e040 con 0x5613e4daacc0 2023-10-05T19:50:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daea70 2023-10-05T19:50:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4006070 con 0x5613e4daea70 2023-10-05T19:50:41.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.716+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daacc0 2023-10-05T19:50:41.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f78cc04e040 con 0x5613e4daacc0 2023-10-05T19:50:41.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db32b0 con 0x5613e4daacc0 2023-10-05T19:50:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc04e040 con 0x5613e4daacc0 2023-10-05T19:50:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dafa70 con 0x5613e4d79230 2023-10-05T19:50:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db03f0 con 0x5613e4daacc0 2023-10-05T19:50:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.720+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4daf660 con 0x5613e4daacc0 2023-10-05T19:50:41.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db3c60 con 0x5613e4daea70 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f78c4006070 con 0x5613e4daea70 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4d79230 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db43c0 con 0x5613e4daacc0 2023-10-05T19:50:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db5780 con 0x5613e4daea70 2023-10-05T19:50:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.724+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db5780 con 0x5613e4daacc0 2023-10-05T19:50:41.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db5780 con 0x7f78cc045040 2023-10-05T19:50:41.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x7f78cc045040 2023-10-05T19:50:41.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4d79230 2023-10-05T19:50:41.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4d79230 2023-10-05T19:50:41.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4daea70 2023-10-05T19:50:41.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4d79230 2023-10-05T19:50:41.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.728+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4daacc0 2023-10-05T19:50:41.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4daacc0 2023-10-05T19:50:41.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4d79230 2023-10-05T19:50:41.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x7f78cc045040 2023-10-05T19:50:41.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x7f78cc045040 2023-10-05T19:50:41.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4d79230 2023-10-05T19:50:41.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x7f78cc045040 2023-10-05T19:50:41.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x7f78cc045040 2023-10-05T19:50:41.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.732+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4daacc0 2023-10-05T19:50:41.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4010 con 0x5613e4daea70 2023-10-05T19:50:41.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4d79230 2023-10-05T19:50:41.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4daacc0 2023-10-05T19:50:41.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4daea70 2023-10-05T19:50:41.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.736+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4d79230 2023-10-05T19:50:41.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4014040 con 0x5613e4d79230 2023-10-05T19:50:41.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4d79230 2023-10-05T19:50:41.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4d79230 2023-10-05T19:50:41.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4daea70 2023-10-05T19:50:41.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x7f78cc045040 2023-10-05T19:50:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4d79230 2023-10-05T19:50:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x7f78cc045040 2023-10-05T19:50:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.740+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4daea70 2023-10-05T19:50:41.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x7f78cc045040 2023-10-05T19:50:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4daacc0 2023-10-05T19:50:41.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4daacc0 2023-10-05T19:50:41.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4daea70 2023-10-05T19:50:41.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.744+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4daacc0 2023-10-05T19:50:41.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f78c4028040 con 0x5613e4daacc0 2023-10-05T19:50:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f78cc058040 con 0x5613e4daacc0 2023-10-05T19:50:41.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4770 con 0x5613e4daacc0 2023-10-05T19:50:41.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db4b20 con 0x5613e4d79230 2023-10-05T19:50:41.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.748+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db53c0 con 0x5613e4daacc0 2023-10-05T19:50:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db53c0 con 0x5613e4daacc0 2023-10-05T19:50:41.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db54c0 con 0x7f78cc045040 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 zone default found 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 4 Realm: () 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 zonegroup default 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db54c0 con 0x7f78cc045040 2023-10-05T19:50:41.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db6e40 con 0x5613e4daea70 2023-10-05T19:50:41.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.752+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78db5b8e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db71f0 con 0x5613e4daea70 2023-10-05T19:50:41.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78db5b8e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78db5b8e40 20 started sync module instance, tier type = 2023-10-05T19:50:41.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78db5b8e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:41.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db6550 con 0x5613e4daacc0 2023-10-05T19:50:41.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94643443949664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db6a70 con 0x5613e4daacc0 2023-10-05T19:50:41.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.756+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db7f80 con 0x5613e4d79230 2023-10-05T19:50:41.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.760+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.760+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94643443956368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db6a70 con 0x5613e4d79230 2023-10-05T19:50:41.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.760+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db8aa0 con 0x5613e4daacc0 2023-10-05T19:50:41.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.760+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94643443949664] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.760+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94643443956368] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.760+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.760+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94643443957472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db6a70 con 0x5613e4daacc0 2023-10-05T19:50:41.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.760+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db8ea0 con 0x7f78cc045040 2023-10-05T19:50:41.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.764+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.764+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94643443957472] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.764+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94643443955104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db8ea0 con 0x7f78cc045040 2023-10-05T19:50:41.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.764+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db9740 con 0x5613e4daacc0 2023-10-05T19:50:41.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.764+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94643443955104] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.768+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.768+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94643443961424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db9790 con 0x5613e4daacc0 2023-10-05T19:50:41.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.768+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db9790 con 0x5613e4daea70 2023-10-05T19:50:41.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.768+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.768+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94643443965296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dba730 con 0x5613e4daea70 2023-10-05T19:50:41.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.768+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dbb2c0 con 0x5613e4daea70 2023-10-05T19:50:41.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.768+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94643443961424] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94643443965296] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94643443962528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dbb6c0 con 0x5613e4daea70 2023-10-05T19:50:41.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dbbf60 con 0x7f78cc045040 2023-10-05T19:50:41.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94643443962528] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94643443971776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dbc360 con 0x7f78cc045040 2023-10-05T19:50:41.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 20 add_watcher() i=0 2023-10-05T19:50:41.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 20 add_watcher() i=1 2023-10-05T19:50:41.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 20 add_watcher() i=2 2023-10-05T19:50:41.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 20 add_watcher() i=3 2023-10-05T19:50:41.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 20 add_watcher() i=4 2023-10-05T19:50:41.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 20 add_watcher() i=5 2023-10-05T19:50:41.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 20 add_watcher() i=6 2023-10-05T19:50:41.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94643443971776] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 20 add_watcher() i=7 2023-10-05T19:50:41.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:41.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dbf390 con 0x5613e4d79230 2023-10-05T19:50:41.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.772+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94643443972880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4dbc720 con 0x5613e4d79230 2023-10-05T19:50:41.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94643443972880] v30'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78a9feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78db5b8e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:41.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78db5b8e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:41.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78db5b8e40 1 Processor -- start 2023-10-05T19:50:41.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78db5b8e40 1 -- start start 2023-10-05T19:50:41.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78db5b8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dc9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78db5b8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613e4dc9f60 con 0x5613e4dc9650 2023-10-05T19:50:41.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78d88ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dc9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78d88ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dc9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46164/0 (socket says 172.21.15.167:46164) 2023-10-05T19:50:41.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78d88ec700 1 -- 172.21.15.167:0/1677708430 learned_addr learned my addr 172.21.15.167:0/1677708430 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78d88ec700 1 -- 172.21.15.167:0/1677708430 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613e4dca0a0 con 0x5613e4dc9650 2023-10-05T19:50:41.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.776+0000 7f78d88ec700 1 --2- 172.21.15.167:0/1677708430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dc9a20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x5613e4db01a0 tx=0x7f78c4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294e4a7980be614a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78a97ea700 1 -- 172.21.15.167:0/1677708430 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78c403b070 con 0x5613e4dc9650 2023-10-05T19:50:41.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78a97ea700 1 -- 172.21.15.167:0/1677708430 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4022040 con 0x5613e4dc9650 2023-10-05T19:50:41.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78a97ea700 1 -- 172.21.15.167:0/1677708430 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78c4021040 con 0x5613e4dc9650 2023-10-05T19:50:41.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1677708430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 msgr2=0x5613e4dc9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1677708430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dc9a20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x5613e4db01a0 tx=0x7f78c4010000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1677708430 shutdown_connections 2023-10-05T19:50:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1677708430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dc9a20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1677708430 >> 172.21.15.167:0/1677708430 conn(0x5613e4dc4a10 msgr2=0x5613e4dc2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1677708430 shutdown_connections 2023-10-05T19:50:41.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1677708430 wait complete. 2023-10-05T19:50:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 Processor -- start 2023-10-05T19:50:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 -- start start 2023-10-05T19:50:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dcf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613e4dd0030 con 0x5613e4dc9650 2023-10-05T19:50:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78d88ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dcf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78d88ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dcf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46170/0 (socket says 172.21.15.167:46170) 2023-10-05T19:50:41.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78d88ec700 1 -- 172.21.15.167:0/619039451 learned_addr learned my addr 172.21.15.167:0/619039451 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78d88ec700 1 -- 172.21.15.167:0/619039451 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c400eab0 con 0x5613e4dc9650 2023-10-05T19:50:41.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78d88ec700 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dcf030 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f78c400bf30 tx=0x7f78c4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78237fe700 1 -- 172.21.15.167:0/619039451 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78c4021070 con 0x5613e4dc9650 2023-10-05T19:50:41.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78237fe700 1 -- 172.21.15.167:0/619039451 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4034440 con 0x5613e4dc9650 2023-10-05T19:50:41.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613e4dcf630 con 0x5613e4dc9650 2023-10-05T19:50:41.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78237fe700 1 -- 172.21.15.167:0/619039451 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f78c4046070 con 0x5613e4dc9650 2023-10-05T19:50:41.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.780+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613e4dcfad0 con 0x5613e4dc9650 2023-10-05T19:50:41.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.784+0000 7f78237fe700 1 -- 172.21.15.167:0/619039451 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f78c403e020 con 0x5613e4dc9650 2023-10-05T19:50:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.784+0000 7f78237fe700 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7818030c50 0x7f7818033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.784+0000 7f78237fe700 1 -- 172.21.15.167:0/619039451 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f78c402e040 con 0x5613e4dc9650 2023-10-05T19:50:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.784+0000 7f78d98ee700 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7818030c50 0x7f7818033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.784+0000 7f78db5b8e40 5 note: GC not initialized 2023-10-05T19:50:41.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.784+0000 7f78d98ee700 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7818030c50 0x7f7818033100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5613e4dbc680 tx=0x7f78d400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f7820ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:41.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78167fc700 20 reqs_thread_entry: start 2023-10-05T19:50:41.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78db5b8e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:41.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78db5b8e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:41.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78db5b8e40 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T19:50:41.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f7814ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:12 2023 2023-10-05T19:50:41.796 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:41.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4e366e0 0x5613e4e38ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.8 6:163360d8:::2023-10-05-19--:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4e39000 con 0x5613e4e366e0 2023-10-05T19:50:41.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f7803fff700 20 reqs_thread_entry: start 2023-10-05T19:50:41.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78d90ed700 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4e366e0 0x5613e4e38ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78d90ed700 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4e366e0 0x5613e4e38ac0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78d90ed700 1 -- 172.21.15.167:0/619039451 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 2023-10-05-19-- [read 0~658 out=658b] v0'0 uv21 ondisk = 0) v8 ==== 159+0+658 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4e366e0 2023-10-05T19:50:41.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78db5b8e40 10 read 658 2023-10-05T19:50:41.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78db5b8e40 10 log_show_next pos 658 bl 658 off 304 eof 1 2023-10-05T19:50:41.798 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:41.798 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_id": "", 2023-10-05T19:50:41.798 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_owner": "", 2023-10-05T19:50:41.798 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:50:41.798 INFO:teuthology.orchestra.run.smithi167.stdout: "log_entries": [ 2023-10-05T19:50:41.798 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:41.798 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:30.745162Z", 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:30.745162+0000", 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.15.167", 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "anonymous", 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "list_buckets", 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "GET / HTTP/1.1", 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 231, 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:41.799 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 0, 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "curl/7.68.0", 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx00000b542d60318d82cfb-00651f1386-1085-default", 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:36.845022Z", 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:36.845022+0000", 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:41.800 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "list_buckets", 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "GET / HTTP/1.1", 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 322, 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 0, 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx000007fc76e18fcfe6989-00651f138c-1085-default", 2023-10-05T19:50:41.801 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: "log_sum": { 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 553, 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 0, 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: "total_entries": 2 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:41.802 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:41.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78db5b8e40 10 log_show_next pos 658 bl 658 off 658 eof 1 2023-10-05T19:50:41.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.788+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94643443949664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4df5d10 con 0x5613e4daacc0 2023-10-05T19:50:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.792+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94643443949664] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.792+0000 7f78db5b8e40 20 remove_watcher() i=0 2023-10-05T19:50:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.792+0000 7f78db5b8e40 2 removed watcher, disabling cache 2023-10-05T19:50:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.792+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94643443956368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db6060 con 0x5613e4d79230 2023-10-05T19:50:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.796+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94643443956368] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.796+0000 7f78db5b8e40 20 remove_watcher() i=1 2023-10-05T19:50:41.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.796+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94643443957472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db7a90 con 0x5613e4daacc0 2023-10-05T19:50:41.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.796+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94643443957472] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.796+0000 7f78db5b8e40 20 remove_watcher() i=2 2023-10-05T19:50:41.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.796+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94643443955104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db7f80 con 0x7f78cc045040 2023-10-05T19:50:41.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.800+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94643443955104] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.800+0000 7f78db5b8e40 20 remove_watcher() i=3 2023-10-05T19:50:41.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.800+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94643443961424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db7f80 con 0x5613e4daacc0 2023-10-05T19:50:41.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.800+0000 7f78d90ed700 1 -- 172.21.15.167:0/1442589396 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94643443961424] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78cc063040 con 0x5613e4daacc0 2023-10-05T19:50:41.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.800+0000 7f78db5b8e40 20 remove_watcher() i=4 2023-10-05T19:50:41.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.800+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94643443965296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db7f80 con 0x5613e4daea70 2023-10-05T19:50:41.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.804+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94643443965296] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.804+0000 7f78db5b8e40 20 remove_watcher() i=5 2023-10-05T19:50:41.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.804+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94643443962528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db7f80 con 0x5613e4daea70 2023-10-05T19:50:41.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.804+0000 7f78d88ec700 1 -- 172.21.15.167:0/1442589396 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94643443962528] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78c4024040 con 0x5613e4daea70 2023-10-05T19:50:41.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.804+0000 7f78db5b8e40 20 remove_watcher() i=6 2023-10-05T19:50:41.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.804+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94643443971776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db9340 con 0x7f78cc045040 2023-10-05T19:50:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.808+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94643443971776] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x7f78cc045040 2023-10-05T19:50:41.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.808+0000 7f78db5b8e40 20 remove_watcher() i=7 2023-10-05T19:50:41.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.808+0000 7f78a9feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.808+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94643443972880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613e4db9340 con 0x5613e4d79230 2023-10-05T19:50:41.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.808+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94643443972880] v30'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f78d4033040 con 0x5613e4d79230 2023-10-05T19:50:41.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4daacc0 msgr2=0x5613e4dadf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4daacc0 0x5613e4dadf00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5613e4d79230 msgr2=0x5613e4da9f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5613e4d79230 0x5613e4da9f00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f78cc045040 msgr2=0x7f78cc0289f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f78cc045040 0x7f78cc0289f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5613e4daea70 msgr2=0x5613e4db2cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5613e4daea70 0x5613e4db2cd0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f78c0030ca0 msgr2=0x7f78c0033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f78c0030ca0 0x7f78c0033150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78c40011e0 tx=0x7f78c40013a0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 msgr2=0x5613e4d9e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78d98ee700 1 -- 172.21.15.167:0/1442589396 reap_dead start 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d9e450 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5613e4d93e30 tx=0x7f78cc01d000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 shutdown_connections 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/1442589396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4d78920 0x5613e4d9e450 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 >> 172.21.15.167:0/1442589396 conn(0x5613e4d74340 msgr2=0x5613e4d91d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 shutdown_connections 2023-10-05T19:50:41.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/1442589396 wait complete. 2023-10-05T19:50:41.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4e366e0 msgr2=0x5613e4e38ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4e366e0 0x5613e4e38ac0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7818030c50 msgr2=0x7f7818033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7818030c50 0x7f7818033100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5613e4dbc680 tx=0x7f78d400e040 comp rx=0 tx=0).stop 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 msgr2=0x5613e4dcf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dcf030 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f78c400bf30 tx=0x7f78c4037000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 shutdown_connections 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5613e4e366e0 0x5613e4e38ac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7818030c50 0x7f7818033100 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 --2- 172.21.15.167:0/619039451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5613e4dc9650 0x5613e4dcf030 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 >> 172.21.15.167:0/619039451 conn(0x5613e4dc4a10 msgr2=0x5613e4dc2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 shutdown_connections 2023-10-05T19:50:41.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.812+0000 7f78db5b8e40 1 -- 172.21.15.167:0/619039451 wait complete. 2023-10-05T19:50:41.826 DEBUG:tasks.util.rgw: json result: {'bucket_id': '', 'bucket_owner': '', 'bucket': '', 'log_entries': [{'bucket': '', 'time': '2023-10-05T19:50:30.745162Z', 'time_local': '2023-10-05T19:50:30.745162+0000', 'remote_addr': '172.21.15.167', 'user': 'anonymous', 'operation': 'list_buckets', 'uri': 'GET / HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 231, 'bytes_received': 0, 'object_size': 0, 'total_time': 0, 'user_agent': 'curl/7.68.0', 'referrer': '', 'trans_id': 'tx00000b542d60318d82cfb-00651f1386-1085-default', 'authentication_type': 'Local', 'temp_url': False}, {'bucket': '', 'time': '2023-10-05T19:50:36.845022Z', 'time_local': '2023-10-05T19:50:36.845022+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'list_buckets', 'uri': 'GET / HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 322, 'bytes_received': 0, 'object_size': 0, 'total_time': 0, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx000007fc76e18fcfe6989-00651f138c-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 553, 'bytes_received': 0, 'total_time': 0, 'total_entries': 2}} 2023-10-05T19:50:41.826 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-19--'] 2023-10-05T19:50:41.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-19--'] 2023-10-05T19:50:41.826 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-19-- 2023-10-05T19:50:41.861 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:41.861 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:41.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 Processor -- start 2023-10-05T19:50:41.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 -- start start 2023-10-05T19:50:41.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55866cb45b90 0x55866cb45f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55866ca90bd0 con 0x55866cb464a0 2023-10-05T19:50:41.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55866ca4dee0 con 0x55866cb45b90 2023-10-05T19:50:41.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa357590700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55866cb45b90 0x55866cb45f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa357590700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55866cb45b90 0x55866cb45f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46176/0 (socket says 172.21.15.167:46176) 2023-10-05T19:50:41.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa357590700 1 -- 172.21.15.167:0/1749218086 learned_addr learned my addr 172.21.15.167:0/1749218086 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa356d8f700 1 --1- 172.21.15.167:0/1749218086 >> v1:172.21.15.118:6789/0 conn(0x55866cb464a0 0x55866cb46ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51802/0 (socket says 172.21.15.167:51802) 2023-10-05T19:50:41.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa357590700 1 -- 172.21.15.167:0/1749218086 >> v1:172.21.15.118:6789/0 conn(0x55866cb464a0 legacy=0x55866cb46ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa35658e700 1 -- 172.21.15.167:0/1749218086 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059503834 0 0) 0x55866ca90bd0 con 0x55866cb464a0 2023-10-05T19:50:41.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa357590700 1 -- 172.21.15.167:0/1749218086 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55866cb475f0 con 0x55866cb45b90 2023-10-05T19:50:41.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa357590700 1 --2- 172.21.15.167:0/1749218086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb45f60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa35000a5c0 tx=0x7fa350005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ea81a2d821f24d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa35658e700 1 -- 172.21.15.167:0/1749218086 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa35000e510 con 0x55866cb45b90 2023-10-05T19:50:41.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa35658e700 1 -- 172.21.15.167:0/1749218086 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35000e670 con 0x55866cb45b90 2023-10-05T19:50:41.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa35658e700 1 -- 172.21.15.167:0/1749218086 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa35000e920 con 0x55866cb45b90 2023-10-05T19:50:41.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 -- 172.21.15.167:0/1749218086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 msgr2=0x55866cb45f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 --2- 172.21.15.167:0/1749218086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb45f60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa35000a5c0 tx=0x7fa350005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:41.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 -- 172.21.15.167:0/1749218086 shutdown_connections 2023-10-05T19:50:41.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 --2- 172.21.15.167:0/1749218086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb45f60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 -- 172.21.15.167:0/1749218086 >> 172.21.15.167:0/1749218086 conn(0x55866cab9540 msgr2=0x55866cb43e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 -- 172.21.15.167:0/1749218086 shutdown_connections 2023-10-05T19:50:41.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.856+0000 7fa359a5be40 1 -- 172.21.15.167:0/1749218086 wait complete. 2023-10-05T19:50:41.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa359a5be40 1 Processor -- start 2023-10-05T19:50:41.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa359a5be40 1 -- start start 2023-10-05T19:50:41.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa359a5be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb64970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa359a5be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866ca11e30 con 0x55866cb45b90 2023-10-05T19:50:41.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa357590700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb64970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa357590700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb64970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46192/0 (socket says 172.21.15.167:46192) 2023-10-05T19:50:41.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa357590700 1 -- 172.21.15.167:0/4043571766 learned_addr learned my addr 172.21.15.167:0/4043571766 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa357590700 1 -- 172.21.15.167:0/4043571766 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35000a180 con 0x55866cb45b90 2023-10-05T19:50:41.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa357590700 1 --2- 172.21.15.167:0/4043571766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb64970 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa35000a510 tx=0x7fa350013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82af4ce57b07793 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa35558c700 1 -- 172.21.15.167:0/4043571766 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa35000e7e0 con 0x55866cb45b90 2023-10-05T19:50:41.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa35558c700 1 -- 172.21.15.167:0/4043571766 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35000e960 con 0x55866cb45b90 2023-10-05T19:50:41.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.860+0000 7fa35558c700 1 -- 172.21.15.167:0/4043571766 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa35000ec50 con 0x55866cb45b90 2023-10-05T19:50:41.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 -- 172.21.15.167:0/4043571766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 msgr2=0x55866cb64970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 --2- 172.21.15.167:0/4043571766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb64970 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa35000a510 tx=0x7fa350013000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 -- 172.21.15.167:0/4043571766 shutdown_connections 2023-10-05T19:50:41.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 --2- 172.21.15.167:0/4043571766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb64970 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 -- 172.21.15.167:0/4043571766 >> 172.21.15.167:0/4043571766 conn(0x55866cab9540 msgr2=0x55866cb60530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 -- 172.21.15.167:0/4043571766 shutdown_connections 2023-10-05T19:50:41.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 -- 172.21.15.167:0/4043571766 wait complete. 2023-10-05T19:50:41.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 Processor -- start 2023-10-05T19:50:41.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 -- start start 2023-10-05T19:50:41.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb6b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866c9e4ed0 con 0x55866cb45b90 2023-10-05T19:50:41.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa357590700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb6b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa357590700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb6b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46200/0 (socket says 172.21.15.167:46200) 2023-10-05T19:50:41.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 learned_addr learned my addr 172.21.15.167:0/2553845010 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55866cb475f0 con 0x55866cb45b90 2023-10-05T19:50:41.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa357590700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb6b5d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa350005b90 tx=0x7fa35001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa34f7fe700 1 -- 172.21.15.167:0/2553845010 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa35000ee00 con 0x55866cb45b90 2023-10-05T19:50:41.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55866cb6bb10 con 0x55866cb45b90 2023-10-05T19:50:41.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55866cb6bef0 con 0x55866cb45b90 2023-10-05T19:50:41.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa34f7fe700 1 -- 172.21.15.167:0/2553845010 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa350010ae0 con 0x55866cb45b90 2023-10-05T19:50:41.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.864+0000 7fa34f7fe700 1 -- 172.21.15.167:0/2553845010 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa350010d90 con 0x55866cb45b90 2023-10-05T19:50:41.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa34f7fe700 1 -- 172.21.15.167:0/2553845010 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fa350037450 con 0x55866cb45b90 2023-10-05T19:50:41.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa34f7fe700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa338030c00 0x7fa3380330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa34f7fe700 1 -- 172.21.15.167:0/2553845010 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fa350046440 con 0x55866cb45b90 2023-10-05T19:50:41.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa356d8f700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa338030c00 0x7fa3380330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55866cb464a0 0x55866cb77060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb77710 con 0x55866cb464a0 2023-10-05T19:50:41.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa357d91700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55866cb464a0 0x55866cb77060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa356d8f700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa338030c00 0x7fa3380330b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa3400011e0 tx=0x7fa340001460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa357d91700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55866cb464a0 0x55866cb77060 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa34800a500 con 0x55866cb464a0 2023-10-05T19:50:41.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa359a5be40 20 realm 2023-10-05T19:50:41.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.868+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb746c0 con 0x55866cb464a0 2023-10-05T19:50:41.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa34800a500 con 0x55866cb464a0 2023-10-05T19:50:41.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:41.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb781f0 con 0x55866cb464a0 2023-10-05T19:50:41.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa34800a500 con 0x55866cb464a0 2023-10-05T19:50:41.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cb79020 0x55866cb7b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb7b940 con 0x55866cb79020 2023-10-05T19:50:41.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa357590700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cb79020 0x55866cb7b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa357590700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cb79020 0x55866cb7b400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb7c1e0 con 0x55866cb464a0 2023-10-05T19:50:41.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa34800a500 con 0x55866cb464a0 2023-10-05T19:50:41.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 20 searching for the correct realm 2023-10-05T19:50:41.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55866cb7dfa0 0x55866cb80380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb7dfa0 2023-10-05T19:50:41.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.872+0000 7fa356d8f700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55866cb7dfa0 0x55866cb80380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa356d8f700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55866cb7dfa0 0x55866cb80380 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb79020 2023-10-05T19:50:41.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa357590700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa350010070 0x7fa350026790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x7fa350010070 2023-10-05T19:50:41.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa357d91700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa350010070 0x7fa350026790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa357d91700 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa350010070 0x7fa350026790 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x7fa350010070 2023-10-05T19:50:41.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.876+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb7dfa0 2023-10-05T19:50:41.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb79020 2023-10-05T19:50:41.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb79020 2023-10-05T19:50:41.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x7fa350010070 2023-10-05T19:50:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x7fa350010070 2023-10-05T19:50:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.880+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x7fa350010070 2023-10-05T19:50:41.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x7fa350010070 2023-10-05T19:50:41.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb79020 2023-10-05T19:50:41.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb7dfa0 2023-10-05T19:50:41.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb79020 2023-10-05T19:50:41.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.884+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb7dfa0 2023-10-05T19:50:41.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb7dfa0 2023-10-05T19:50:41.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x7fa350010070 2023-10-05T19:50:41.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x7fa350010070 2023-10-05T19:50:41.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb464a0 2023-10-05T19:50:41.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x7fa350010070 2023-10-05T19:50:41.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x7fa350010070 2023-10-05T19:50:41.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.888+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb7dfa0 2023-10-05T19:50:41.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x7fa350010070 2023-10-05T19:50:41.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x7fa350010070 2023-10-05T19:50:41.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb79020 2023-10-05T19:50:41.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb79020 2023-10-05T19:50:41.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb7dfa0 2023-10-05T19:50:41.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.892+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb79020 2023-10-05T19:50:41.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb808c0 con 0x55866cb79020 2023-10-05T19:50:41.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb7cd50 con 0x55866cb464a0 2023-10-05T19:50:41.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb7d640 con 0x55866cb79020 2023-10-05T19:50:41.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.896+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb80c70 con 0x55866cb79020 2023-10-05T19:50:41.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb81020 con 0x55866cb7dfa0 2023-10-05T19:50:41.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb7d270 con 0x55866cb79020 2023-10-05T19:50:41.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb82d50 con 0x55866cb7dfa0 2023-10-05T19:50:41.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.900+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb82d50 con 0x55866cb79020 2023-10-05T19:50:41.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb82d50 con 0x7fa350010070 2023-10-05T19:50:41.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x7fa350010070 2023-10-05T19:50:41.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb7dfa0 2023-10-05T19:50:41.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.904+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb79020 2023-10-05T19:50:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb79020 2023-10-05T19:50:41.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x7fa350010070 2023-10-05T19:50:41.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x7fa350010070 2023-10-05T19:50:41.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x7fa350010070 2023-10-05T19:50:41.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x7fa350010070 2023-10-05T19:50:41.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.908+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb79020 2023-10-05T19:50:41.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb7dfa0 2023-10-05T19:50:41.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb79020 2023-10-05T19:50:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb7dfa0 2023-10-05T19:50:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348014040 con 0x55866cb464a0 2023-10-05T19:50:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.912+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb7dfa0 2023-10-05T19:50:41.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x7fa350010070 2023-10-05T19:50:41.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb464a0 2023-10-05T19:50:41.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x7fa350010070 2023-10-05T19:50:41.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.916+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb7dfa0 2023-10-05T19:50:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x7fa350010070 2023-10-05T19:50:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb79020 2023-10-05T19:50:41.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb79020 2023-10-05T19:50:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb7dfa0 2023-10-05T19:50:41.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.920+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb79020 2023-10-05T19:50:41.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb813d0 con 0x55866cb79020 2023-10-05T19:50:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:41.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb81d40 con 0x55866cb79020 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb81d40 con 0x55866cb464a0 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.924+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb825e0 con 0x55866cb79020 2023-10-05T19:50:41.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:41.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb825e0 con 0x55866cb79020 2023-10-05T19:50:41.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:41.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb825e0 con 0x7fa350010070 2023-10-05T19:50:41.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 zone default found 2023-10-05T19:50:41.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 4 Realm: () 2023-10-05T19:50:41.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:41.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:41.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:41.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 zonegroup default 2023-10-05T19:50:41.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb825e0 con 0x7fa350010070 2023-10-05T19:50:41.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.928+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb83f60 con 0x55866cb7dfa0 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa359a5be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb84310 con 0x55866cb7dfa0 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa359a5be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa359a5be40 20 started sync module instance, tier type = 2023-10-05T19:50:41.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa359a5be40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb83620 con 0x55866cb79020 2023-10-05T19:50:41.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94035837989168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb83b40 con 0x55866cb79020 2023-10-05T19:50:41.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.932+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb83610 con 0x55866cb464a0 2023-10-05T19:50:41.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.936+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.936+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94035837995952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb854f0 con 0x55866cb464a0 2023-10-05T19:50:41.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.936+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb85f00 con 0x55866cb79020 2023-10-05T19:50:41.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.936+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94035837989168] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.936+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94035837995952] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.940+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.940+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94035837999632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb854f0 con 0x55866cb79020 2023-10-05T19:50:41.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.940+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb85e60 con 0x7fa350010070 2023-10-05T19:50:41.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.940+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94035837999632] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.940+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.940+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94035837997056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb85e60 con 0x7fa350010070 2023-10-05T19:50:41.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.940+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb86ce0 con 0x55866cb79020 2023-10-05T19:50:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.944+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94035837997056] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.944+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.944+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94035838001840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb86bf0 con 0x55866cb79020 2023-10-05T19:50:41.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.944+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb87490 con 0x55866cb7dfa0 2023-10-05T19:50:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.944+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.944+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94035838004768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb87d30 con 0x55866cb7dfa0 2023-10-05T19:50:41.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.944+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb88780 con 0x55866cb7dfa0 2023-10-05T19:50:41.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.944+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94035838001840] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.944+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94035838004768] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94035838002944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb88b80 con 0x55866cb7dfa0 2023-10-05T19:50:41.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb89420 con 0x7fa350010070 2023-10-05T19:50:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94035838002944] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94035838012288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb894c0 con 0x7fa350010070 2023-10-05T19:50:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 20 add_watcher() i=0 2023-10-05T19:50:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 20 add_watcher() i=1 2023-10-05T19:50:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 20 add_watcher() i=2 2023-10-05T19:50:41.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 20 add_watcher() i=3 2023-10-05T19:50:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 20 add_watcher() i=4 2023-10-05T19:50:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 20 add_watcher() i=5 2023-10-05T19:50:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 20 add_watcher() i=6 2023-10-05T19:50:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94035838012288] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 20 add_watcher() i=7 2023-10-05T19:50:41.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:41.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb8c5d0 con 0x55866cb464a0 2023-10-05T19:50:41.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.948+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94035838013392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb89910 con 0x55866cb464a0 2023-10-05T19:50:41.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94035838013392] v30'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa2a3fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa359a5be40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa359a5be40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:41.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa359a5be40 1 Processor -- start 2023-10-05T19:50:41.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa359a5be40 1 -- start start 2023-10-05T19:50:41.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa359a5be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb971c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa359a5be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866cb97700 con 0x55866cb96df0 2023-10-05T19:50:41.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa356d8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa356d8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46202/0 (socket says 172.21.15.167:46202) 2023-10-05T19:50:41.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa356d8f700 1 -- 172.21.15.167:0/3424821025 learned_addr learned my addr 172.21.15.167:0/3424821025 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.952+0000 7fa356d8f700 1 -- 172.21.15.167:0/3424821025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55866cb97840 con 0x55866cb96df0 2023-10-05T19:50:41.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa356d8f700 1 --2- 172.21.15.167:0/3424821025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb971c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa34000f550 tx=0x7fa340006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343d74f08c9b97e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa2a37fe700 1 -- 172.21.15.167:0/3424821025 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa34002e890 con 0x55866cb96df0 2023-10-05T19:50:41.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa2a37fe700 1 -- 172.21.15.167:0/3424821025 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa340024040 con 0x55866cb96df0 2023-10-05T19:50:41.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa2a37fe700 1 -- 172.21.15.167:0/3424821025 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa34002ea30 con 0x55866cb96df0 2023-10-05T19:50:41.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 -- 172.21.15.167:0/3424821025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 msgr2=0x55866cb971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 --2- 172.21.15.167:0/3424821025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb971c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa34000f550 tx=0x7fa340006000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 -- 172.21.15.167:0/3424821025 shutdown_connections 2023-10-05T19:50:41.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 --2- 172.21.15.167:0/3424821025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb971c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 -- 172.21.15.167:0/3424821025 >> 172.21.15.167:0/3424821025 conn(0x55866cb921b0 msgr2=0x55866cb90300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 -- 172.21.15.167:0/3424821025 shutdown_connections 2023-10-05T19:50:41.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 -- 172.21.15.167:0/3424821025 wait complete. 2023-10-05T19:50:41.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 Processor -- start 2023-10-05T19:50:41.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 -- start start 2023-10-05T19:50:41.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb9c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa359a5be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866cb9d9f0 con 0x55866cb96df0 2023-10-05T19:50:41.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa356d8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb9c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa356d8f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb9c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46204/0 (socket says 172.21.15.167:46204) 2023-10-05T19:50:41.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa356d8f700 1 -- 172.21.15.167:0/1120593509 learned_addr learned my addr 172.21.15.167:0/1120593509 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.956+0000 7fa356d8f700 1 -- 172.21.15.167:0/1120593509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa340006070 con 0x55866cb96df0 2023-10-05T19:50:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa356d8f700 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb9c9f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa34003c040 tx=0x7fa340037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa2a1ffb700 1 -- 172.21.15.167:0/1120593509 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa34003a590 con 0x55866cb96df0 2023-10-05T19:50:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa2a1ffb700 1 -- 172.21.15.167:0/1120593509 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34003a6f0 con 0x55866cb96df0 2023-10-05T19:50:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55866cb9cff0 con 0x55866cb96df0 2023-10-05T19:50:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa2a1ffb700 1 -- 172.21.15.167:0/1120593509 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa34003a8a0 con 0x55866cb96df0 2023-10-05T19:50:41.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55866cb9d490 con 0x55866cb96df0 2023-10-05T19:50:41.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa2a1ffb700 1 -- 172.21.15.167:0/1120593509 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fa340040050 con 0x55866cb96df0 2023-10-05T19:50:41.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa2a1ffb700 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa294030c50 0x7fa294033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa2a1ffb700 1 -- 172.21.15.167:0/1120593509 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fa340044c30 con 0x55866cb96df0 2023-10-05T19:50:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa359a5be40 5 note: GC not initialized 2023-10-05T19:50:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa357d91700 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa294030c50 0x7fa294033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.960+0000 7fa357d91700 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa294030c50 0x7fa294033100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55866cb8c6f0 tx=0x7fa34800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa29affd700 20 reqs_thread_entry: start 2023-10-05T19:50:41.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa298ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:41.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa359a5be40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa359a5be40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa286ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:12 2023 2023-10-05T19:50:41.972 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa2867fc700 20 reqs_thread_entry: start 2023-10-05T19:50:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa359a5be40 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cc03de0 0x55866cc061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.8 6:163360d8:::2023-10-05-19--:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cc06700 con 0x55866cc03de0 2023-10-05T19:50:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa357590700 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cc03de0 0x55866cc061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:41.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.964+0000 7fa357590700 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cc03de0 0x55866cc061c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:41.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.968+0000 7fa357590700 1 -- 172.21.15.167:0/1120593509 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 2023-10-05-19-- [delete] v30'26 uv26 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cc03de0 2023-10-05T19:50:41.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.968+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94035837989168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cbc30e0 con 0x55866cb79020 2023-10-05T19:50:41.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.968+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94035837989168] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.968+0000 7fa359a5be40 20 remove_watcher() i=0 2023-10-05T19:50:41.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.968+0000 7fa359a5be40 2 removed watcher, disabling cache 2023-10-05T19:50:41.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.968+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94035837995952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb83130 con 0x55866cb464a0 2023-10-05T19:50:41.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.972+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94035837995952] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.972+0000 7fa359a5be40 20 remove_watcher() i=1 2023-10-05T19:50:41.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.972+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94035837999632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb83130 con 0x55866cb79020 2023-10-05T19:50:41.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.972+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94035837999632] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.972+0000 7fa359a5be40 20 remove_watcher() i=2 2023-10-05T19:50:41.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.972+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94035837997056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb85a10 con 0x7fa350010070 2023-10-05T19:50:41.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.976+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94035837997056] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.976+0000 7fa359a5be40 20 remove_watcher() i=3 2023-10-05T19:50:41.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.976+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94035838001840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb85a10 con 0x55866cb79020 2023-10-05T19:50:41.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.976+0000 7fa357590700 1 -- 172.21.15.167:0/2553845010 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94035838001840] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa350034070 con 0x55866cb79020 2023-10-05T19:50:41.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.976+0000 7fa359a5be40 20 remove_watcher() i=4 2023-10-05T19:50:41.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.976+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94035838004768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb862b0 con 0x55866cb7dfa0 2023-10-05T19:50:41.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.980+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94035838004768] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.980+0000 7fa359a5be40 20 remove_watcher() i=5 2023-10-05T19:50:41.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.980+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94035838002944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb85a10 con 0x55866cb7dfa0 2023-10-05T19:50:41.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.980+0000 7fa356d8f700 1 -- 172.21.15.167:0/2553845010 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94035838002944] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa34000f600 con 0x55866cb7dfa0 2023-10-05T19:50:41.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.980+0000 7fa359a5be40 20 remove_watcher() i=6 2023-10-05T19:50:41.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.980+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94035838012288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb85a10 con 0x7fa350010070 2023-10-05T19:50:41.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.984+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94035838012288] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa348033040 con 0x7fa350010070 2023-10-05T19:50:41.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.984+0000 7fa359a5be40 20 remove_watcher() i=7 2023-10-05T19:50:41.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.984+0000 7fa2a3fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:41.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.984+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94035838013392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55866cb88b80 con 0x55866cb464a0 2023-10-05T19:50:41.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.984+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94035838013392] v30'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa348033040 con 0x55866cb464a0 2023-10-05T19:50:41.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cb79020 msgr2=0x55866cb7b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cb79020 0x55866cb7b400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55866cb464a0 msgr2=0x55866cb77060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55866cb464a0 0x55866cb77060 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa350010070 msgr2=0x7fa350026790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa350010070 0x7fa350026790 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55866cb7dfa0 msgr2=0x55866cb80380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55866cb7dfa0 0x55866cb80380 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa338030c00 msgr2=0x7fa3380330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa338030c00 0x7fa3380330b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa3400011e0 tx=0x7fa340001460 comp rx=0 tx=0).stop 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa357d91700 1 -- 172.21.15.167:0/2553845010 reap_dead start 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 msgr2=0x55866cb6b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb6b5d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa350005b90 tx=0x7fa35001c000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 shutdown_connections 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/2553845010 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb45b90 0x55866cb6b5d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 >> 172.21.15.167:0/2553845010 conn(0x55866cab9540 msgr2=0x55866cb5efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 shutdown_connections 2023-10-05T19:50:41.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/2553845010 wait complete. 2023-10-05T19:50:41.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cc03de0 msgr2=0x55866cc061c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cc03de0 0x55866cc061c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa294030c50 msgr2=0x7fa294033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa294030c50 0x7fa294033100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55866cb8c6f0 tx=0x7fa34800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 msgr2=0x55866cb9c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb9c9f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa34003c040 tx=0x7fa340037000 comp rx=0 tx=0).stop 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 shutdown_connections 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55866cc03de0 0x55866cc061c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa294030c50 0x7fa294033100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 --2- 172.21.15.167:0/1120593509 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55866cb96df0 0x55866cb9c9f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 >> 172.21.15.167:0/1120593509 conn(0x55866cb921b0 msgr2=0x55866cb90250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 shutdown_connections 2023-10-05T19:50:41.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:41.988+0000 7fa359a5be40 1 -- 172.21.15.167:0/1120593509 wait complete. 2023-10-05T19:50:42.001 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo'] 2023-10-05T19:50:42.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo'] 2023-10-05T19:50:42.001 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo 2023-10-05T19:50:42.080 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:42.081 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:42.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.072+0000 7efc37973e40 1 Processor -- start 2023-10-05T19:50:42.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.072+0000 7efc37973e40 1 -- start start 2023-10-05T19:50:42.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.072+0000 7efc37973e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56460dec4e10 0x56460dec71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.072+0000 7efc37973e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56460de0dbd0 con 0x56460de34d20 2023-10-05T19:50:42.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.072+0000 7efc37973e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x56460ddcaee0 con 0x56460dec4e10 2023-10-05T19:50:42.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc34ca7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56460dec4e10 0x56460dec71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc34ca7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56460dec4e10 0x56460dec71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46212/0 (socket says 172.21.15.167:46212) 2023-10-05T19:50:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc34ca7700 1 -- 172.21.15.167:0/798366239 learned_addr learned my addr 172.21.15.167:0/798366239 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc34ca7700 1 -- 172.21.15.167:0/798366239 >> v1:172.21.15.118:6789/0 conn(0x56460de34d20 legacy=0x56460dec36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc34ca7700 1 -- 172.21.15.167:0/798366239 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56460dec8740 con 0x56460dec4e10 2023-10-05T19:50:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc34ca7700 1 --2- 172.21.15.167:0/798366239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460dec4e10 0x56460dec71f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efc2000a5c0 tx=0x7efc20005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7585d14e72cb6cfc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc2ffff700 1 -- 172.21.15.167:0/798366239 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc2000e510 con 0x56460dec4e10 2023-10-05T19:50:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc2ffff700 1 -- 172.21.15.167:0/798366239 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2000e670 con 0x56460dec4e10 2023-10-05T19:50:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc2ffff700 1 -- 172.21.15.167:0/798366239 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc2000e920 con 0x56460dec4e10 2023-10-05T19:50:42.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 -- 172.21.15.167:0/798366239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460dec4e10 msgr2=0x56460dec71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 --2- 172.21.15.167:0/798366239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460dec4e10 0x56460dec71f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efc2000a5c0 tx=0x7efc20005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:42.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 -- 172.21.15.167:0/798366239 shutdown_connections 2023-10-05T19:50:42.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 --2- 172.21.15.167:0/798366239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460dec4e10 0x56460dec71f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 -- 172.21.15.167:0/798366239 >> 172.21.15.167:0/798366239 conn(0x56460debb240 msgr2=0x56460debd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 -- 172.21.15.167:0/798366239 shutdown_connections 2023-10-05T19:50:42.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 -- 172.21.15.167:0/798366239 wait complete. 2023-10-05T19:50:42.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 Processor -- start 2023-10-05T19:50:42.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 -- start start 2023-10-05T19:50:42.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dec0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc37973e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56460dd8ee30 con 0x56460de34d20 2023-10-05T19:50:42.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc354a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dec0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc354a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dec0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46222/0 (socket says 172.21.15.167:46222) 2023-10-05T19:50:42.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.076+0000 7efc354a8700 1 -- 172.21.15.167:0/1536739237 learned_addr learned my addr 172.21.15.167:0/1536739237 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc354a8700 1 -- 172.21.15.167:0/1536739237 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2000a180 con 0x56460de34d20 2023-10-05T19:50:42.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc354a8700 1 --2- 172.21.15.167:0/1536739237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dec0c70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efc30001d30 tx=0x7efc30001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54aa9c7bc7660d4a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc2effd700 1 -- 172.21.15.167:0/1536739237 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc30014070 con 0x56460de34d20 2023-10-05T19:50:42.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc2effd700 1 -- 172.21.15.167:0/1536739237 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc30008070 con 0x56460de34d20 2023-10-05T19:50:42.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc2effd700 1 -- 172.21.15.167:0/1536739237 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc3000bd30 con 0x56460de34d20 2023-10-05T19:50:42.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 -- 172.21.15.167:0/1536739237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 msgr2=0x56460dec0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 --2- 172.21.15.167:0/1536739237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dec0c70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efc30001d30 tx=0x7efc30001900 comp rx=0 tx=0).stop 2023-10-05T19:50:42.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 -- 172.21.15.167:0/1536739237 shutdown_connections 2023-10-05T19:50:42.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 --2- 172.21.15.167:0/1536739237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dec0c70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 -- 172.21.15.167:0/1536739237 >> 172.21.15.167:0/1536739237 conn(0x56460debb240 msgr2=0x56460dedb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 -- 172.21.15.167:0/1536739237 shutdown_connections 2023-10-05T19:50:42.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 -- 172.21.15.167:0/1536739237 wait complete. 2023-10-05T19:50:42.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 Processor -- start 2023-10-05T19:50:42.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 -- start start 2023-10-05T19:50:42.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dee8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.080+0000 7efc37973e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56460dd61ed0 con 0x56460de34d20 2023-10-05T19:50:42.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc354a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dee8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc354a8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dee8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46232/0 (socket says 172.21.15.167:46232) 2023-10-05T19:50:42.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 learned_addr learned my addr 172.21.15.167:0/3799977887 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3000a040 con 0x56460de34d20 2023-10-05T19:50:42.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc354a8700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dee8a60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efc3000b850 tx=0x7efc30016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc2d7fa700 1 -- 172.21.15.167:0/3799977887 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc3001a480 con 0x56460de34d20 2023-10-05T19:50:42.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc2d7fa700 1 -- 172.21.15.167:0/3799977887 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc30021070 con 0x56460de34d20 2023-10-05T19:50:42.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56460dee8fa0 con 0x56460de34d20 2023-10-05T19:50:42.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc2d7fa700 1 -- 172.21.15.167:0/3799977887 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc3001a720 con 0x56460de34d20 2023-10-05T19:50:42.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56460dee9440 con 0x56460de34d20 2023-10-05T19:50:42.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc2d7fa700 1 -- 172.21.15.167:0/3799977887 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7efc3001a950 con 0x56460de34d20 2023-10-05T19:50:42.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.084+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc2d7fa700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efc1c030c40 0x7efc1c0330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc2d7fa700 1 -- 172.21.15.167:0/3799977887 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7efc30044dd0 con 0x56460de34d20 2023-10-05T19:50:42.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc34ca7700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efc1c030c40 0x7efc1c0330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56460dec4e10 0x56460def4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460def4bd0 con 0x56460dec4e10 2023-10-05T19:50:42.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc35ca9700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56460dec4e10 0x56460def4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc34ca7700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efc1c030c40 0x7efc1c0330f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc20000f80 tx=0x7efc20013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc35ca9700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56460dec4e10 0x56460def4520 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efc2800a500 con 0x56460dec4e10 2023-10-05T19:50:42.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 20 realm 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460def1b80 con 0x56460dec4e10 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efc2800a500 con 0x56460dec4e10 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460def56b0 con 0x56460dec4e10 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efc2800a500 con 0x56460dec4e10 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460def52e0 0x56460def8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460def8c50 con 0x56460def52e0 2023-10-05T19:50:42.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.088+0000 7efc354a8700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460def52e0 0x56460def8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc354a8700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460def52e0 0x56460def8520 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efc30016070 con 0x56460def52e0 2023-10-05T19:50:42.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc37973e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460def9520 con 0x56460dec4e10 2023-10-05T19:50:42.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7efc2800a500 con 0x56460dec4e10 2023-10-05T19:50:42.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc37973e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc37973e40 20 searching for the correct realm 2023-10-05T19:50:42.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56460def9090 0x56460defd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def9090 2023-10-05T19:50:42.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc34ca7700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56460def9090 0x56460defd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc34ca7700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56460def9090 0x56460defd2f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.092+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def52e0 2023-10-05T19:50:42.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc30016070 con 0x56460def52e0 2023-10-05T19:50:42.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc354a8700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efc3001ac00 0x7efc3000a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x7efc3001ac00 2023-10-05T19:50:42.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc35ca9700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efc3001ac00 0x7efc3000a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc35ca9700 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efc3001ac00 0x7efc3000a940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x7efc3001ac00 2023-10-05T19:50:42.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def9090 2023-10-05T19:50:42.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.096+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def52e0 2023-10-05T19:50:42.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc30016070 con 0x56460def52e0 2023-10-05T19:50:42.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def52e0 2023-10-05T19:50:42.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc30016070 con 0x56460def52e0 2023-10-05T19:50:42.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x7efc3001ac00 2023-10-05T19:50:42.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x7efc3001ac00 2023-10-05T19:50:42.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x7efc3001ac00 2023-10-05T19:50:42.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x7efc3001ac00 2023-10-05T19:50:42.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.100+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def52e0 2023-10-05T19:50:42.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc30016070 con 0x56460def52e0 2023-10-05T19:50:42.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def9090 2023-10-05T19:50:42.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def52e0 2023-10-05T19:50:42.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc30016070 con 0x56460def52e0 2023-10-05T19:50:42.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def9090 2023-10-05T19:50:42.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.104+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def9090 2023-10-05T19:50:42.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x7efc3001ac00 2023-10-05T19:50:42.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x7efc3001ac00 2023-10-05T19:50:42.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460dec4e10 2023-10-05T19:50:42.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x7efc3001ac00 2023-10-05T19:50:42.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x7efc3001ac00 2023-10-05T19:50:42.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def9090 2023-10-05T19:50:42.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.108+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x7efc3001ac00 2023-10-05T19:50:42.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x7efc3001ac00 2023-10-05T19:50:42.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def52e0 2023-10-05T19:50:42.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc30016070 con 0x56460def52e0 2023-10-05T19:50:42.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def52e0 2023-10-05T19:50:42.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc30016070 con 0x56460def52e0 2023-10-05T19:50:42.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def9090 2023-10-05T19:50:42.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def52e0 2023-10-05T19:50:42.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7efc30016070 con 0x56460def52e0 2023-10-05T19:50:42.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.112+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defd8d0 con 0x56460def52e0 2023-10-05T19:50:42.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defa090 con 0x56460dec4e10 2023-10-05T19:50:42.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defa520 con 0x56460def52e0 2023-10-05T19:50:42.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defa950 con 0x56460def52e0 2023-10-05T19:50:42.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.116+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe230 con 0x56460def9090 2023-10-05T19:50:42.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe990 con 0x56460def52e0 2023-10-05T19:50:42.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc37973e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460deffd50 con 0x56460def9090 2023-10-05T19:50:42.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460deffd50 con 0x56460def52e0 2023-10-05T19:50:42.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.120+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460deffd50 con 0x7efc3001ac00 2023-10-05T19:50:42.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x7efc3001ac00 2023-10-05T19:50:42.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def9090 2023-10-05T19:50:42.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def52e0 2023-10-05T19:50:42.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.124+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def52e0 2023-10-05T19:50:42.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x7efc3001ac00 2023-10-05T19:50:42.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x7efc3001ac00 2023-10-05T19:50:42.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x7efc3001ac00 2023-10-05T19:50:42.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x7efc3001ac00 2023-10-05T19:50:42.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.128+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def52e0 2023-10-05T19:50:42.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def9090 2023-10-05T19:50:42.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def52e0 2023-10-05T19:50:42.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def9090 2023-10-05T19:50:42.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28014040 con 0x56460dec4e10 2023-10-05T19:50:42.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.132+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def9090 2023-10-05T19:50:42.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x7efc3001ac00 2023-10-05T19:50:42.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460dec4e10 2023-10-05T19:50:42.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x7efc3001ac00 2023-10-05T19:50:42.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.136+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def9090 2023-10-05T19:50:42.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x7efc3001ac00 2023-10-05T19:50:42.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def52e0 2023-10-05T19:50:42.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def52e0 2023-10-05T19:50:42.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def9090 2023-10-05T19:50:42.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.140+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def52e0 2023-10-05T19:50:42.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defe5e0 con 0x56460def52e0 2023-10-05T19:50:42.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defed40 con 0x56460def52e0 2023-10-05T19:50:42.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460defed40 con 0x56460dec4e10 2023-10-05T19:50:42.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.144+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460deff5e0 con 0x56460def52e0 2023-10-05T19:50:42.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460deff5e0 con 0x56460def52e0 2023-10-05T19:50:42.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460deff5e0 con 0x7efc3001ac00 2023-10-05T19:50:42.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 zone default found 2023-10-05T19:50:42.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 4 Realm: () 2023-10-05T19:50:42.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:42.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:42.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:42.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 zonegroup default 2023-10-05T19:50:42.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460deff5e0 con 0x7efc3001ac00 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df00f60 con 0x56460def9090 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.148+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df01310 con 0x56460def9090 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.152+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.152+0000 7efc37973e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.152+0000 7efc37973e40 20 started sync module instance, tier type = 2023-10-05T19:50:42.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.152+0000 7efc37973e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:42.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.152+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df00620 con 0x56460def52e0 2023-10-05T19:50:42.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.152+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.152+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94858881532208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df00b40 con 0x56460def52e0 2023-10-05T19:50:42.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.152+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df020a0 con 0x56460dec4e10 2023-10-05T19:50:42.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.156+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.156+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94858881538992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df00b40 con 0x56460dec4e10 2023-10-05T19:50:42.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.156+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df02bc0 con 0x56460def52e0 2023-10-05T19:50:42.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.156+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94858881532208] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.156+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94858881538992] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.156+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.160+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94858881540096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df02690 con 0x56460def52e0 2023-10-05T19:50:42.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.160+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df034b0 con 0x7efc3001ac00 2023-10-05T19:50:42.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.160+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.160+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94858881544128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df02690 con 0x7efc3001ac00 2023-10-05T19:50:42.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.160+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df03df0 con 0x56460def52e0 2023-10-05T19:50:42.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.160+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94858881540096] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94858881544128] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94858881537728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df03900 con 0x56460def52e0 2023-10-05T19:50:42.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df041a0 con 0x56460def9090 2023-10-05T19:50:42.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94858881546784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df04a40 con 0x56460def9090 2023-10-05T19:50:42.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df05450 con 0x56460def9090 2023-10-05T19:50:42.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94858881537728] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94858881546784] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94858881545232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df05cf0 con 0x56460def9090 2023-10-05T19:50:42.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.164+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df04550 con 0x7efc3001ac00 2023-10-05T19:50:42.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94858881545232] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc20017050 con 0x56460def9090 2023-10-05T19:50:42.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94858881549648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df06590 con 0x7efc3001ac00 2023-10-05T19:50:42.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 20 add_watcher() i=0 2023-10-05T19:50:42.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 20 add_watcher() i=1 2023-10-05T19:50:42.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 20 add_watcher() i=2 2023-10-05T19:50:42.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 20 add_watcher() i=3 2023-10-05T19:50:42.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 20 add_watcher() i=4 2023-10-05T19:50:42.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 20 add_watcher() i=5 2023-10-05T19:50:42.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 20 add_watcher() i=6 2023-10-05T19:50:42.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94858881549648] v30'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 20 add_watcher() i=7 2023-10-05T19:50:42.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:42.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df095c0 con 0x56460dec4e10 2023-10-05T19:50:42.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.168+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94858881556640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df06b50 con 0x56460dec4e10 2023-10-05T19:50:42.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94858881556640] v30'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc05feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc37973e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:42.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc37973e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:42.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc37973e40 1 Processor -- start 2023-10-05T19:50:42.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc37973e40 1 -- start start 2023-10-05T19:50:42.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc37973e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df13e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc37973e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56460df14390 con 0x56460df13a80 2023-10-05T19:50:42.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc34ca7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df13e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc34ca7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df13e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46244/0 (socket says 172.21.15.167:46244) 2023-10-05T19:50:42.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc34ca7700 1 -- 172.21.15.167:0/3475090846 learned_addr learned my addr 172.21.15.167:0/3475090846 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc34ca7700 1 -- 172.21.15.167:0/3475090846 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56460df144d0 con 0x56460df13a80 2023-10-05T19:50:42.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc34ca7700 1 --2- 172.21.15.167:0/3475090846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df13e50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efc2000a5c0 tx=0x7efc20010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26c1230408f8c43 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc057ea700 1 -- 172.21.15.167:0/3475090846 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc20037070 con 0x56460df13a80 2023-10-05T19:50:42.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc057ea700 1 -- 172.21.15.167:0/3475090846 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc20010b30 con 0x56460df13a80 2023-10-05T19:50:42.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.172+0000 7efc057ea700 1 -- 172.21.15.167:0/3475090846 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc2002d040 con 0x56460df13a80 2023-10-05T19:50:42.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 -- 172.21.15.167:0/3475090846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 msgr2=0x56460df13e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 --2- 172.21.15.167:0/3475090846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df13e50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efc2000a5c0 tx=0x7efc20010000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 -- 172.21.15.167:0/3475090846 shutdown_connections 2023-10-05T19:50:42.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 --2- 172.21.15.167:0/3475090846 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df13e50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 -- 172.21.15.167:0/3475090846 >> 172.21.15.167:0/3475090846 conn(0x56460df0ee40 msgr2=0x56460df0cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 -- 172.21.15.167:0/3475090846 shutdown_connections 2023-10-05T19:50:42.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 -- 172.21.15.167:0/3475090846 wait complete. 2023-10-05T19:50:42.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 Processor -- start 2023-10-05T19:50:42.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 -- start start 2023-10-05T19:50:42.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df19450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56460df1a450 con 0x56460df13a80 2023-10-05T19:50:42.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc34ca7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df19450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc34ca7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df19450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46256/0 (socket says 172.21.15.167:46256) 2023-10-05T19:50:42.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc34ca7700 1 -- 172.21.15.167:0/2848463779 learned_addr learned my addr 172.21.15.167:0/2848463779 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc34ca7700 1 -- 172.21.15.167:0/2848463779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56460dec8740 con 0x56460df13a80 2023-10-05T19:50:42.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc34ca7700 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df19450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efc2000a5c0 tx=0x7efc2002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efb7f7fe700 1 -- 172.21.15.167:0/2848463779 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc20037050 con 0x56460df13a80 2023-10-05T19:50:42.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efb7f7fe700 1 -- 172.21.15.167:0/2848463779 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2003c440 con 0x56460df13a80 2023-10-05T19:50:42.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efb7f7fe700 1 -- 172.21.15.167:0/2848463779 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc2003c5d0 con 0x56460df13a80 2023-10-05T19:50:42.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56460df19a50 con 0x56460df13a80 2023-10-05T19:50:42.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.176+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56460df19e90 con 0x56460df13a80 2023-10-05T19:50:42.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.180+0000 7efb7f7fe700 1 -- 172.21.15.167:0/2848463779 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7efc2003c730 con 0x56460df13a80 2023-10-05T19:50:42.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.180+0000 7efb7f7fe700 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb74030ca0 0x7efb74033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.180+0000 7efb7f7fe700 1 -- 172.21.15.167:0/2848463779 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7efc20046c20 con 0x56460df13a80 2023-10-05T19:50:42.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.180+0000 7efc35ca9700 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb74030ca0 0x7efb74033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.180+0000 7efc37973e40 5 note: GC not initialized 2023-10-05T19:50:42.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.180+0000 7efc35ca9700 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb74030ca0 0x7efb74033150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x56460df06ab0 tx=0x7efc2800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.180+0000 7efb7cff9700 20 reqs_thread_entry: start 2023-10-05T19:50:42.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efb727fc700 20 reqs_thread_entry: start 2023-10-05T19:50:42.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:42.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:42.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efb70ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:12 2023 2023-10-05T19:50:42.191 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:42.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efb5ffff700 20 reqs_thread_entry: start 2023-10-05T19:50:42.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T19:50:42.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460df80b80 0x56460df82f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.1a 6:5f9f8d27:::2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df834a0 con 0x56460df80b80 2023-10-05T19:50:42.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc354a8700 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460df80b80 0x56460df82f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc354a8700 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460df80b80 0x56460df82f60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc354a8700 1 -- 172.21.15.167:0/2848463779 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo [read 0~3730 out=3730b] v0'0 uv24 ondisk = 0) v8 ==== 207+0+3730 (crc 0 0 0) 0x7efc3004b040 con 0x56460df80b80 2023-10-05T19:50:42.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 read 3730 2023-10-05T19:50:42.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 log_show_next pos 3730 bl 3730 off 417 eof 1 2023-10-05T19:50:42.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 log_show_next pos 3730 bl 3730 off 922 eof 1 2023-10-05T19:50:42.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 log_show_next pos 3730 bl 3730 off 1442 eof 1 2023-10-05T19:50:42.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 log_show_next pos 3730 bl 3730 off 1947 eof 1 2023-10-05T19:50:42.194 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:42.194 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1", 2023-10-05T19:50:42.194 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_owner": "foo", 2023-10-05T19:50:42.194 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:42.194 INFO:teuthology.orchestra.run.smithi167.stdout: "log_entries": [ 2023-10-05T19:50:42.194 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.194 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:42.194 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:36.653026Z", 2023-10-05T19:50:42.194 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:36.653026+0000", 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "create_bucket", 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "PUT /myfoo/ HTTP/1.1", 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 15, 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.195 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx00000f76a936f8e447ca6-00651f138c-1085-default", 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:37.817000Z", 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:37.817000+0000", 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.196 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "put_obj", 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "PUT /myfoo/f97c5d29941bfb1b2fdab0874906ab82 HTTP/1.1", 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 3, 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 3, 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 7, 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx00000a7e4112a3cb82d8a-00651f138d-1085-default", 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.197 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:38.184991Z", 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:38.184991+0000", 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "delete_obj", 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "DELETE /myfoo/f97c5d29941bfb1b2fdab0874906ab82 HTTP/1.1", 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "204", 2023-10-05T19:50:42.198 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "NoContent", 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 7, 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx000003218cfb32d75596c-00651f138e-1085-default", 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:42.199 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:38.600982Z", 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:38.600982+0000", 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "put_obj", 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "PUT /myfoo/b8a9f715dbb64fd5c56e7783c6820a61 HTTP/1.1", 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 3, 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 3, 2023-10-05T19:50:42.200 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 7, 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx000005907ec974a5d4c36-00651f138e-1085-default", 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:38.608981Z", 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:38.608981+0000", 2023-10-05T19:50:42.201 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "delete_obj", 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "DELETE /myfoo/b8a9f715dbb64fd5c56e7783c6820a61 HTTP/1.1", 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "204", 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "NoContent", 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 7, 2023-10-05T19:50:42.202 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 log_show_next pos 3730 bl 3730 off 2467 eof 1 2023-10-05T19:50:42.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 log_show_next pos 3730 bl 3730 off 2888 eof 1 2023-10-05T19:50:42.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 log_show_next pos 3730 bl 3730 off 3315 eof 1 2023-10-05T19:50:42.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 10 log_show_next pos 3730 bl 3730 off 3730 eof 1 2023-10-05T19:50:42.203 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.203 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx00000ac3ebc9ee4aaa0d4-00651f138e-1085-default", 2023-10-05T19:50:42.203 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.203 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.203 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:40.936928Z", 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:40.936928+0000", 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "put_obj", 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "PUT /myfoo/four HTTP/1.1", 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:42.204 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 4, 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 4, 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 7, 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx000002628f158fb56f92a-00651f1390-1085-default", 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:42.205 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:40.944928Z", 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:40.944928+0000", 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "object_owner": "foo", 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "get_obj", 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "GET /myfoo/four HTTP/1.1", 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 4, 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 4, 2023-10-05T19:50:42.206 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 3, 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx00000845d346874c4f305-00651f1390-1085-default", 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:40.948928Z", 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:40.948928+0000", 2023-10-05T19:50:42.207 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "list_bucket", 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "GET /myfoo/ HTTP/1.1", 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 515, 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 3, 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.208 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx00000f25504ea8e1b35fd-00651f1390-1085-default", 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: "log_sum": { 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 519, 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 10, 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 56, 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: "total_entries": 8 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:42.209 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:42.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.184+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94858881532208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df401b0 con 0x56460def52e0 2023-10-05T19:50:42.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.188+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94858881532208] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.188+0000 7efc37973e40 20 remove_watcher() i=0 2023-10-05T19:50:42.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.188+0000 7efc37973e40 2 removed watcher, disabling cache 2023-10-05T19:50:42.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.188+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94858881538992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df00130 con 0x56460dec4e10 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.188+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94858881538992] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.188+0000 7efc37973e40 20 remove_watcher() i=1 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.188+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94858881540096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df00130 con 0x56460def52e0 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.192+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94858881540096] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.192+0000 7efc37973e40 20 remove_watcher() i=2 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.192+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94858881544128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df020a0 con 0x7efc3001ac00 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.192+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94858881544128] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.192+0000 7efc37973e40 20 remove_watcher() i=3 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.192+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94858881537728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df020a0 con 0x56460def52e0 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.196+0000 7efc354a8700 1 -- 172.21.15.167:0/3799977887 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94858881537728] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc3004b040 con 0x56460def52e0 2023-10-05T19:50:42.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.196+0000 7efc37973e40 20 remove_watcher() i=4 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.196+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94858881546784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df020a0 con 0x56460def9090 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.196+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94858881546784] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc20042070 con 0x56460def9090 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.196+0000 7efc37973e40 20 remove_watcher() i=5 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.196+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94858881545232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df02060 con 0x56460def9090 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.200+0000 7efc34ca7700 1 -- 172.21.15.167:0/3799977887 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94858881545232] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc20042070 con 0x56460def9090 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.200+0000 7efc37973e40 20 remove_watcher() i=6 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.200+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94858881549648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df034b0 con 0x7efc3001ac00 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.200+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94858881549648] v30'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efc28033040 con 0x7efc3001ac00 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.200+0000 7efc37973e40 20 remove_watcher() i=7 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc05feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94858881556640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56460df016c0 con 0x56460dec4e10 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94858881556640] v30'153 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efc28033040 con 0x56460dec4e10 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460def52e0 msgr2=0x56460def8520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460def52e0 0x56460def8520 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56460dec4e10 msgr2=0x56460def4520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56460dec4e10 0x56460def4520 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efc3001ac00 msgr2=0x7efc3000a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efc3001ac00 0x7efc3000a940 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56460def9090 msgr2=0x56460defd2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56460def9090 0x56460defd2f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efc1c030c40 msgr2=0x7efc1c0330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efc1c030c40 0x7efc1c0330f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc20000f80 tx=0x7efc20013000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc35ca9700 1 -- 172.21.15.167:0/3799977887 reap_dead start 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 msgr2=0x56460dee8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dee8a60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efc3000b850 tx=0x7efc30016000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 shutdown_connections 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 --2- 172.21.15.167:0/3799977887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460de34d20 0x56460dee8a60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 >> 172.21.15.167:0/3799977887 conn(0x56460debb240 msgr2=0x56460deda0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 shutdown_connections 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.204+0000 7efc37973e40 1 -- 172.21.15.167:0/3799977887 wait complete. 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460df80b80 msgr2=0x56460df82f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460df80b80 0x56460df82f60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb74030ca0 msgr2=0x7efb74033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb74030ca0 0x7efb74033150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x56460df06ab0 tx=0x7efc2800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 msgr2=0x56460df19450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df19450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efc2000a5c0 tx=0x7efc2002c000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 shutdown_connections 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56460df80b80 0x56460df82f60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb74030ca0 0x7efb74033150 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 --2- 172.21.15.167:0/2848463779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56460df13a80 0x56460df19450 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 >> 172.21.15.167:0/2848463779 conn(0x56460df0ee40 msgr2=0x56460df0cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 shutdown_connections 2023-10-05T19:50:42.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.208+0000 7efc37973e40 1 -- 172.21.15.167:0/2848463779 wait complete. 2023-10-05T19:50:42.220 DEBUG:tasks.util.rgw: json result: {'bucket_id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1', 'bucket_owner': 'foo', 'bucket': 'myfoo', 'log_entries': [{'bucket': 'myfoo', 'time': '2023-10-05T19:50:36.653026Z', 'time_local': '2023-10-05T19:50:36.653026+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'create_bucket', 'uri': 'PUT /myfoo/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 15, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000f76a936f8e447ca6-00651f138c-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T19:50:37.817000Z', 'time_local': '2023-10-05T19:50:37.817000+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'put_obj', 'uri': 'PUT /myfoo/f97c5d29941bfb1b2fdab0874906ab82 HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 3, 'object_size': 3, 'total_time': 7, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000a7e4112a3cb82d8a-00651f138d-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T19:50:38.184991Z', 'time_local': '2023-10-05T19:50:38.184991+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_obj', 'uri': 'DELETE /myfoo/f97c5d29941bfb1b2fdab0874906ab82 HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 7, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx000003218cfb32d75596c-00651f138e-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T19:50:38.600982Z', 'time_local': '2023-10-05T19:50:38.600982+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'put_obj', 'uri': 'PUT /myfoo/b8a9f715dbb64fd5c56e7783c6820a61 HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 3, 'object_size': 3, 'total_time': 7, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx000005907ec974a5d4c36-00651f138e-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T19:50:38.608981Z', 'time_local': '2023-10-05T19:50:38.608981+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_obj', 'uri': 'DELETE /myfoo/b8a9f715dbb64fd5c56e7783c6820a61 HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 7, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000ac3ebc9ee4aaa0d4-00651f138e-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T19:50:40.936928Z', 'time_local': '2023-10-05T19:50:40.936928+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'put_obj', 'uri': 'PUT /myfoo/four HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 4, 'object_size': 4, 'total_time': 7, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx000002628f158fb56f92a-00651f1390-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T19:50:40.944928Z', 'time_local': '2023-10-05T19:50:40.944928+0000', 'remote_addr': '172.21.0.51', 'object_owner': 'foo', 'user': 'foo', 'operation': 'get_obj', 'uri': 'GET /myfoo/four HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 4, 'bytes_received': 0, 'object_size': 4, 'total_time': 3, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000845d346874c4f305-00651f1390-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo', 'time': '2023-10-05T19:50:40.948928Z', 'time_local': '2023-10-05T19:50:40.948928+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'list_bucket', 'uri': 'GET /myfoo/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 515, 'bytes_received': 0, 'object_size': 0, 'total_time': 3, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000f25504ea8e1b35fd-00651f1390-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 519, 'bytes_received': 10, 'total_time': 56, 'total_entries': 8}} 2023-10-05T19:50:42.220 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.221 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.221 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.221 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.221 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.221 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.221 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.221 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.221 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo'] 2023-10-05T19:50:42.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo'] 2023-10-05T19:50:42.221 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo 2023-10-05T19:50:42.262 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:42.262 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:42.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 Processor -- start 2023-10-05T19:50:42.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 -- start start 2023-10-05T19:50:42.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55994a39bb90 0x55994a39bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55994a2e6bd0 con 0x55994a39c4a0 2023-10-05T19:50:42.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55994a2a3ee0 con 0x55994a39bb90 2023-10-05T19:50:42.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d5361700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55994a39bb90 0x55994a39bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d5361700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55994a39bb90 0x55994a39bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46264/0 (socket says 172.21.15.167:46264) 2023-10-05T19:50:42.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d5361700 1 -- 172.21.15.167:0/621240480 learned_addr learned my addr 172.21.15.167:0/621240480 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d4b60700 1 --1- 172.21.15.167:0/621240480 >> v1:172.21.15.118:6789/0 conn(0x55994a39c4a0 0x55994a39cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51828/0 (socket says 172.21.15.167:51828) 2023-10-05T19:50:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d5361700 1 -- 172.21.15.167:0/621240480 >> v1:172.21.15.118:6789/0 conn(0x55994a39c4a0 legacy=0x55994a39cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d5361700 1 -- 172.21.15.167:0/621240480 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55994a39d5f0 con 0x55994a39bb90 2023-10-05T19:50:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d5361700 1 --2- 172.21.15.167:0/621240480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 0x55994a39bf60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f42c800a5c0 tx=0x7f42c8005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56404bbbd5597e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42cffff700 1 -- 172.21.15.167:0/621240480 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c800e510 con 0x55994a39bb90 2023-10-05T19:50:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42cffff700 1 -- 172.21.15.167:0/621240480 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c800e670 con 0x55994a39bb90 2023-10-05T19:50:42.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42cffff700 1 -- 172.21.15.167:0/621240480 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c800e920 con 0x55994a39bb90 2023-10-05T19:50:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 -- 172.21.15.167:0/621240480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 msgr2=0x55994a39bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 --2- 172.21.15.167:0/621240480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 0x55994a39bf60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f42c800a5c0 tx=0x7f42c8005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:42.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 -- 172.21.15.167:0/621240480 shutdown_connections 2023-10-05T19:50:42.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 --2- 172.21.15.167:0/621240480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 0x55994a39bf60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 -- 172.21.15.167:0/621240480 >> 172.21.15.167:0/621240480 conn(0x55994a30f540 msgr2=0x55994a399e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 -- 172.21.15.167:0/621240480 shutdown_connections 2023-10-05T19:50:42.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.256+0000 7f42d782ce40 1 -- 172.21.15.167:0/621240480 wait complete. 2023-10-05T19:50:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 Processor -- start 2023-10-05T19:50:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 -- start start 2023-10-05T19:50:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 0x55994a3bac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994a267e30 con 0x55994a39bb90 2023-10-05T19:50:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d5361700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 0x55994a3bac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d5361700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 0x55994a3bac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46270/0 (socket says 172.21.15.167:46270) 2023-10-05T19:50:42.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d5361700 1 -- 172.21.15.167:0/1159182592 learned_addr learned my addr 172.21.15.167:0/1159182592 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d5361700 1 -- 172.21.15.167:0/1159182592 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c800a180 con 0x55994a39bb90 2023-10-05T19:50:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d5361700 1 --2- 172.21.15.167:0/1159182592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 0x55994a3bac80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f42c800ad10 tx=0x7f42c8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc1f5cd4eda8e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42ceffd700 1 -- 172.21.15.167:0/1159182592 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c80032f0 con 0x55994a39bb90 2023-10-05T19:50:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42ceffd700 1 -- 172.21.15.167:0/1159182592 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c800e7e0 con 0x55994a39bb90 2023-10-05T19:50:42.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42ceffd700 1 -- 172.21.15.167:0/1159182592 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c800eab0 con 0x55994a39bb90 2023-10-05T19:50:42.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 -- 172.21.15.167:0/1159182592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 msgr2=0x55994a3bac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1159182592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 0x55994a3bac80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f42c800ad10 tx=0x7f42c8013000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 -- 172.21.15.167:0/1159182592 shutdown_connections 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1159182592 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39bb90 0x55994a3bac80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 -- 172.21.15.167:0/1159182592 >> 172.21.15.167:0/1159182592 conn(0x55994a30f540 msgr2=0x55994a3b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 -- 172.21.15.167:0/1159182592 shutdown_connections 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 -- 172.21.15.167:0/1159182592 wait complete. 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 Processor -- start 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.260+0000 7f42d782ce40 1 -- start start 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d782ce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39c4a0 0x55994a3c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d782ce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994a23aed0 con 0x55994a39c4a0 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d5361700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39c4a0 0x55994a3c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d5361700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39c4a0 0x55994a3c1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46272/0 (socket says 172.21.15.167:46272) 2023-10-05T19:50:42.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 learned_addr learned my addr 172.21.15.167:0/1238999100 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55994a39d5f0 con 0x55994a39c4a0 2023-10-05T19:50:42.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d5361700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39c4a0 0x55994a3c1a50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f42c801e040 tx=0x7f42c801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42cd7fa700 1 -- 172.21.15.167:0/1238999100 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c801c9f0 con 0x55994a39c4a0 2023-10-05T19:50:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42cd7fa700 1 -- 172.21.15.167:0/1238999100 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c801cb70 con 0x55994a39c4a0 2023-10-05T19:50:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55994a3c1f90 con 0x55994a39c4a0 2023-10-05T19:50:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42cd7fa700 1 -- 172.21.15.167:0/1238999100 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c801ce60 con 0x55994a39c4a0 2023-10-05T19:50:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55994a3c23d0 con 0x55994a39c4a0 2023-10-05T19:50:42.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.264+0000 7f42cd7fa700 1 -- 172.21.15.167:0/1238999100 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f42c8010440 con 0x55994a39c4a0 2023-10-05T19:50:42.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42cd7fa700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f42bc030ca0 0x7f42bc033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42cd7fa700 1 -- 172.21.15.167:0/1238999100 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f42c80462a0 con 0x55994a39c4a0 2023-10-05T19:50:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d4b60700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f42bc030ca0 0x7f42bc033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55994a3cb480 0x55994a3cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3cdec0 con 0x55994a3cb480 2023-10-05T19:50:42.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d5b62700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55994a3cb480 0x55994a3cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d4b60700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f42bc030ca0 0x7f42bc033150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42c000b300 tx=0x7f42c0001470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d5b62700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55994a3cb480 0x55994a3cd860 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42d000a500 con 0x55994a3cb480 2023-10-05T19:50:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 20 realm 2023-10-05T19:50:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3caaf0 con 0x55994a3cb480 2023-10-05T19:50:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42d000a500 con 0x55994a3cb480 2023-10-05T19:50:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3ce9a0 con 0x55994a3cb480 2023-10-05T19:50:42.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42d000a500 con 0x55994a3cb480 2023-10-05T19:50:42.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a3cf7d0 0x55994a3d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.268+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d20f0 con 0x55994a3cf7d0 2023-10-05T19:50:42.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d5361700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a3cf7d0 0x55994a3d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d5361700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a3cf7d0 0x55994a3d1bb0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d782ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d2990 con 0x55994a3cb480 2023-10-05T19:50:42.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f42d000a500 con 0x55994a3cb480 2023-10-05T19:50:42.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d782ce40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d782ce40 20 searching for the correct realm 2023-10-05T19:50:42.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55994a3d4750 0x55994a3d6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3d4750 2023-10-05T19:50:42.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d4b60700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55994a3d4750 0x55994a3d6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d4b60700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55994a3d4750 0x55994a3d6b30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.272+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cf7d0 2023-10-05T19:50:42.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5361700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55994a39bb90 0x7f42c8025aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a39bb90 2023-10-05T19:50:42.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55994a39bb90 0x7f42c8025aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55994a39bb90 0x7f42c8025aa0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a39bb90 2023-10-05T19:50:42.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3d4750 2023-10-05T19:50:42.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.276+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cf7d0 2023-10-05T19:50:42.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cf7d0 2023-10-05T19:50:42.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a39bb90 2023-10-05T19:50:42.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a39bb90 2023-10-05T19:50:42.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a39bb90 2023-10-05T19:50:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a39bb90 2023-10-05T19:50:42.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cf7d0 2023-10-05T19:50:42.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.280+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3d4750 2023-10-05T19:50:42.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cf7d0 2023-10-05T19:50:42.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3d4750 2023-10-05T19:50:42.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.284+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3d4750 2023-10-05T19:50:42.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a39bb90 2023-10-05T19:50:42.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a39bb90 2023-10-05T19:50:42.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cb480 2023-10-05T19:50:42.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a39bb90 2023-10-05T19:50:42.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a39bb90 2023-10-05T19:50:42.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3d4750 2023-10-05T19:50:42.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a39bb90 2023-10-05T19:50:42.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a39bb90 2023-10-05T19:50:42.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.288+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cf7d0 2023-10-05T19:50:42.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cf7d0 2023-10-05T19:50:42.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3d4750 2023-10-05T19:50:42.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cf7d0 2023-10-05T19:50:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7070 con 0x55994a3cf7d0 2023-10-05T19:50:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d782ce40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d782ce40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d782ce40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d782ce40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d3500 con 0x55994a3cb480 2023-10-05T19:50:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.292+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d3df0 con 0x55994a3cf7d0 2023-10-05T19:50:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7420 con 0x55994a3cf7d0 2023-10-05T19:50:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d77d0 con 0x55994a3d4750 2023-10-05T19:50:42.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.296+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d3a20 con 0x55994a3cf7d0 2023-10-05T19:50:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d782ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d9530 con 0x55994a3d4750 2023-10-05T19:50:42.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d9530 con 0x55994a3cf7d0 2023-10-05T19:50:42.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d9530 con 0x55994a39bb90 2023-10-05T19:50:42.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a39bb90 2023-10-05T19:50:42.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.300+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3d4750 2023-10-05T19:50:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cf7d0 2023-10-05T19:50:42.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cf7d0 2023-10-05T19:50:42.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a39bb90 2023-10-05T19:50:42.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a39bb90 2023-10-05T19:50:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.304+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a39bb90 2023-10-05T19:50:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a39bb90 2023-10-05T19:50:42.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cf7d0 2023-10-05T19:50:42.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3d4750 2023-10-05T19:50:42.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cf7d0 2023-10-05T19:50:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.308+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3d4750 2023-10-05T19:50:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0014040 con 0x55994a3cb480 2023-10-05T19:50:42.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3d4750 2023-10-05T19:50:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.312+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a39bb90 2023-10-05T19:50:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cb480 2023-10-05T19:50:42.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a39bb90 2023-10-05T19:50:42.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3d4750 2023-10-05T19:50:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a39bb90 2023-10-05T19:50:42.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cf7d0 2023-10-05T19:50:42.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cf7d0 2023-10-05T19:50:42.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.316+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3d4750 2023-10-05T19:50:42.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cf7d0 2023-10-05T19:50:42.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d7b80 con 0x55994a3cf7d0 2023-10-05T19:50:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d8520 con 0x55994a3cf7d0 2023-10-05T19:50:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d8520 con 0x55994a3cb480 2023-10-05T19:50:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.320+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d80a0 con 0x55994a3cf7d0 2023-10-05T19:50:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d80f0 con 0x55994a3cf7d0 2023-10-05T19:50:42.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d8ee0 con 0x55994a39bb90 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 zone default found 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 4 Realm: () 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 zonegroup default 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d8ee0 con 0x55994a39bb90 2023-10-05T19:50:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d8ee0 con 0x55994a3d4750 2023-10-05T19:50:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.324+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d782ce40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d92e0 con 0x55994a3d4750 2023-10-05T19:50:42.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d782ce40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d782ce40 20 started sync module instance, tier type = 2023-10-05T19:50:42.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d782ce40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:42.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3da970 con 0x55994a3cf7d0 2023-10-05T19:50:42.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94116863904096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3dae60 con 0x55994a3cf7d0 2023-10-05T19:50:42.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.328+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3db700 con 0x55994a3cb480 2023-10-05T19:50:42.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.332+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.332+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94116863904096] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.332+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94116863913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3db860 con 0x55994a3cb480 2023-10-05T19:50:42.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.332+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3da970 con 0x55994a3cf7d0 2023-10-05T19:50:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.336+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94116863913568] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.336+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.336+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94116863912304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3dbe60 con 0x55994a3cf7d0 2023-10-05T19:50:42.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.336+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3dc700 con 0x55994a39bb90 2023-10-05T19:50:42.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.336+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.336+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94116863917952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3dc900 con 0x55994a39bb90 2023-10-05T19:50:42.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.336+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3dd4c0 con 0x55994a3cf7d0 2023-10-05T19:50:42.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.336+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94116863912304] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.336+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94116863917952] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94116863914736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3dcf90 con 0x55994a3cf7d0 2023-10-05T19:50:42.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3dddb0 con 0x55994a3d4750 2023-10-05T19:50:42.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94116863924416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3dcf90 con 0x55994a3d4750 2023-10-05T19:50:42.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3decb0 con 0x55994a3d4750 2023-10-05T19:50:42.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94116863914736] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94116863924416] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94116863928256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3df0b0 con 0x55994a3d4750 2023-10-05T19:50:42.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.340+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3df950 con 0x55994a39bb90 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94116863928256] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94116863930544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3df9f0 con 0x55994a39bb90 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 20 add_watcher() i=0 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 20 add_watcher() i=1 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 20 add_watcher() i=2 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 20 add_watcher() i=3 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 20 add_watcher() i=4 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 20 add_watcher() i=5 2023-10-05T19:50:42.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 20 add_watcher() i=6 2023-10-05T19:50:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94116863930544] v30'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 20 add_watcher() i=7 2023-10-05T19:50:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:42.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3e2a20 con 0x55994a3cb480 2023-10-05T19:50:42.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.344+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94116863931648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3e0020 con 0x55994a3cb480 2023-10-05T19:50:42.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94116863931648] v30'154 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42a5feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d782ce40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:42.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d782ce40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:42.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d782ce40 1 Processor -- start 2023-10-05T19:50:42.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d782ce40 1 -- start start 2023-10-05T19:50:42.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d782ce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3102d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d782ce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994a310810 con 0x55994a30ff00 2023-10-05T19:50:42.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d4b60700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d4b60700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3102d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46276/0 (socket says 172.21.15.167:46276) 2023-10-05T19:50:42.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d4b60700 1 -- 172.21.15.167:0/2005305912 learned_addr learned my addr 172.21.15.167:0/2005305912 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.348+0000 7f42d4b60700 1 -- 172.21.15.167:0/2005305912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55994a310950 con 0x55994a30ff00 2023-10-05T19:50:42.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.352+0000 7f42d4b60700 1 --2- 172.21.15.167:0/2005305912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3102d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55994a3d34d0 tx=0x7f42c0006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e453e3cc6dd4f94f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.352+0000 7f42a57ea700 1 -- 172.21.15.167:0/2005305912 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c002e740 con 0x55994a30ff00 2023-10-05T19:50:42.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.352+0000 7f42a57ea700 1 -- 172.21.15.167:0/2005305912 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c0024040 con 0x55994a30ff00 2023-10-05T19:50:42.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.352+0000 7f42a57ea700 1 -- 172.21.15.167:0/2005305912 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c002e8c0 con 0x55994a30ff00 2023-10-05T19:50:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 -- 172.21.15.167:0/2005305912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 msgr2=0x55994a3102d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 --2- 172.21.15.167:0/2005305912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3102d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55994a3d34d0 tx=0x7f42c0006000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 -- 172.21.15.167:0/2005305912 shutdown_connections 2023-10-05T19:50:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 --2- 172.21.15.167:0/2005305912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3102d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 -- 172.21.15.167:0/2005305912 >> 172.21.15.167:0/2005305912 conn(0x55994a3e85c0 msgr2=0x55994a3e6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 -- 172.21.15.167:0/2005305912 shutdown_connections 2023-10-05T19:50:42.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 -- 172.21.15.167:0/2005305912 wait complete. 2023-10-05T19:50:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 Processor -- start 2023-10-05T19:50:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 -- start start 2023-10-05T19:50:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55994a3f81a0 con 0x55994a30ff00 2023-10-05T19:50:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d4b60700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d4b60700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46278/0 (socket says 172.21.15.167:46278) 2023-10-05T19:50:42.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d4b60700 1 -- 172.21.15.167:0/3155832412 learned_addr learned my addr 172.21.15.167:0/3155832412 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d4b60700 1 -- 172.21.15.167:0/3155832412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c0006070 con 0x55994a30ff00 2023-10-05T19:50:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d4b60700 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3f71a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f42c8013040 tx=0x7f42c0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f421f7fe700 1 -- 172.21.15.167:0/3155832412 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c0039500 con 0x55994a30ff00 2023-10-05T19:50:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f421f7fe700 1 -- 172.21.15.167:0/3155832412 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c0039660 con 0x55994a30ff00 2023-10-05T19:50:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55994a3f77a0 con 0x55994a30ff00 2023-10-05T19:50:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f421f7fe700 1 -- 172.21.15.167:0/3155832412 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42c00397d0 con 0x55994a30ff00 2023-10-05T19:50:42.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.356+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55994a3f7be0 con 0x55994a30ff00 2023-10-05T19:50:42.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.360+0000 7f421f7fe700 1 -- 172.21.15.167:0/3155832412 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f42c0040040 con 0x55994a30ff00 2023-10-05T19:50:42.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.360+0000 7f421f7fe700 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4214030c50 0x7f4214033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.360+0000 7f421f7fe700 1 -- 172.21.15.167:0/3155832412 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f42c004dc60 con 0x55994a30ff00 2023-10-05T19:50:42.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.360+0000 7f42d5b62700 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4214030c50 0x7f4214033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.360+0000 7f42d782ce40 5 note: GC not initialized 2023-10-05T19:50:42.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.360+0000 7f42d5b62700 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4214030c50 0x7f4214033100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55994a3dff80 tx=0x7f42d000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.360+0000 7f421cff9700 20 reqs_thread_entry: start 2023-10-05T19:50:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.364+0000 7f42127fc700 20 reqs_thread_entry: start 2023-10-05T19:50:42.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.364+0000 7f42d782ce40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.364+0000 7f42d782ce40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.364+0000 7f4210ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:12 2023 2023-10-05T19:50:42.371 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.364+0000 7f41f7fff700 20 reqs_thread_entry: start 2023-10-05T19:50:42.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.364+0000 7f42d782ce40 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a45e610 0x55994a4609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.364+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.1a 6:5f9f8d27:::2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a460f30 con 0x55994a45e610 2023-10-05T19:50:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.364+0000 7f42d5361700 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a45e610 0x55994a4609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.364+0000 7f42d5361700 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a45e610 0x55994a4609f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.368+0000 7f42d5361700 1 -- 172.21.15.167:0/3155832412 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1-myfoo [delete] v30'26 uv26 ondisk = 0) v8 ==== 207+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a45e610 2023-10-05T19:50:42.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.368+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94116863904096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a41d910 con 0x55994a3cf7d0 2023-10-05T19:50:42.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.368+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94116863904096] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.368+0000 7f42d782ce40 20 remove_watcher() i=0 2023-10-05T19:50:42.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.368+0000 7f42d782ce40 2 removed watcher, disabling cache 2023-10-05T19:50:42.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.368+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94116863913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d8960 con 0x55994a3cb480 2023-10-05T19:50:42.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.372+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94116863913568] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.372+0000 7f42d782ce40 20 remove_watcher() i=1 2023-10-05T19:50:42.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.372+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94116863912304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3d8960 con 0x55994a3cf7d0 2023-10-05T19:50:42.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.372+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94116863912304] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.372+0000 7f42d782ce40 20 remove_watcher() i=2 2023-10-05T19:50:42.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.372+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94116863917952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3da970 con 0x55994a39bb90 2023-10-05T19:50:42.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.376+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94116863917952] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.376+0000 7f42d782ce40 20 remove_watcher() i=3 2023-10-05T19:50:42.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.376+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94116863914736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3da970 con 0x55994a3cf7d0 2023-10-05T19:50:42.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.376+0000 7f42d5361700 1 -- 172.21.15.167:0/1238999100 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94116863914736] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c802b070 con 0x55994a3cf7d0 2023-10-05T19:50:42.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.376+0000 7f42d782ce40 20 remove_watcher() i=4 2023-10-05T19:50:42.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.376+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94116863924416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3da970 con 0x55994a3d4750 2023-10-05T19:50:42.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.380+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94116863924416] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.380+0000 7f42d782ce40 20 remove_watcher() i=5 2023-10-05T19:50:42.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.380+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94116863928256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3da970 con 0x55994a3d4750 2023-10-05T19:50:42.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.380+0000 7f42d4b60700 1 -- 172.21.15.167:0/1238999100 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94116863928256] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42c000f560 con 0x55994a3d4750 2023-10-05T19:50:42.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.380+0000 7f42d782ce40 20 remove_watcher() i=6 2023-10-05T19:50:42.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.380+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94116863930544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3de7c0 con 0x55994a39bb90 2023-10-05T19:50:42.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.384+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94116863930544] v30'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a39bb90 2023-10-05T19:50:42.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.384+0000 7f42d782ce40 20 remove_watcher() i=7 2023-10-05T19:50:42.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.384+0000 7f42a5feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.384+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94116863931648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55994a3da970 con 0x55994a3cb480 2023-10-05T19:50:42.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94116863931648] v30'155 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f42d0033040 con 0x55994a3cb480 2023-10-05T19:50:42.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a3cf7d0 msgr2=0x55994a3d1bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a3cf7d0 0x55994a3d1bb0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55994a3cb480 msgr2=0x55994a3cd860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55994a3cb480 0x55994a3cd860 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55994a39bb90 msgr2=0x7f42c8025aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55994a39bb90 0x7f42c8025aa0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55994a3d4750 msgr2=0x55994a3d6b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55994a3d4750 0x55994a3d6b30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f42bc030ca0 msgr2=0x7f42bc033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f42bc030ca0 0x7f42bc033150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f42c000b300 tx=0x7f42c0001470 comp rx=0 tx=0).stop 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d5b62700 1 -- 172.21.15.167:0/1238999100 reap_dead start 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39c4a0 msgr2=0x55994a3c1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39c4a0 0x55994a3c1a50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f42c801e040 tx=0x7f42c801c000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 shutdown_connections 2023-10-05T19:50:42.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/1238999100 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a39c4a0 0x55994a3c1a50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 >> 172.21.15.167:0/1238999100 conn(0x55994a30f540 msgr2=0x55994a3b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 shutdown_connections 2023-10-05T19:50:42.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/1238999100 wait complete. 2023-10-05T19:50:42.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a45e610 msgr2=0x55994a4609f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a45e610 0x55994a4609f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4214030c50 msgr2=0x7f4214033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4214030c50 0x7f4214033100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55994a3dff80 tx=0x7f42d000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:42.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 msgr2=0x55994a3f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3f71a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f42c8013040 tx=0x7f42c0037000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 shutdown_connections 2023-10-05T19:50:42.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55994a45e610 0x55994a4609f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4214030c50 0x7f4214033100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 --2- 172.21.15.167:0/3155832412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55994a30ff00 0x55994a3f71a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 >> 172.21.15.167:0/3155832412 conn(0x55994a3e85c0 msgr2=0x55994a3e6660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 shutdown_connections 2023-10-05T19:50:42.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.388+0000 7f42d782ce40 1 -- 172.21.15.167:0/3155832412 wait complete. 2023-10-05T19:50:42.402 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4'] 2023-10-05T19:50:42.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4'] 2023-10-05T19:50:42.402 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4 2023-10-05T19:50:42.441 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:42.441 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:42.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.432+0000 7f54eb6a9e40 1 Processor -- start 2023-10-05T19:50:42.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.432+0000 7f54eb6a9e40 1 -- start start 2023-10-05T19:50:42.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.432+0000 7f54eb6a9e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x555afea8bf30 0x555afea8aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.432+0000 7f54eb6a9e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555afe9d8bd0 con 0x555afea8c300 2023-10-05T19:50:42.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.432+0000 7f54eb6a9e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x555afe995ee0 con 0x555afea8bf30 2023-10-05T19:50:42.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e91de700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x555afea8bf30 0x555afea8aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e89dd700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x555afea8c300 0x555afea8b020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51838/0 (socket says 172.21.15.167:51838) 2023-10-05T19:50:42.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e89dd700 1 -- 172.21.15.167:0/3389112648 learned_addr learned my addr 172.21.15.167:0/3389112648 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:42.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e3fff700 1 -- 172.21.15.167:0/3389112648 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88297491 0 0) 0x555afe9d8bd0 con 0x555afea8c300 2023-10-05T19:50:42.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e3fff700 1 -- 172.21.15.167:0/3389112648 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54cc001e10 con 0x555afea8c300 2023-10-05T19:50:42.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e91de700 1 -- 172.21.15.167:0/3389112648 >> v1:172.21.15.118:6789/0 conn(0x555afea8c300 legacy=0x555afea8b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e91de700 1 -- 172.21.15.167:0/3389112648 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555afea8b7f0 con 0x555afea8bf30 2023-10-05T19:50:42.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e91de700 1 --2- 172.21.15.167:0/3389112648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afea8aae0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f54e400a5d0 tx=0x7f54e4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86f11ae862a21e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e3fff700 1 -- 172.21.15.167:0/3389112648 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54e4007610 con 0x555afea8bf30 2023-10-05T19:50:42.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e3fff700 1 -- 172.21.15.167:0/3389112648 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e4007770 con 0x555afea8bf30 2023-10-05T19:50:42.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54e3fff700 1 -- 172.21.15.167:0/3389112648 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54e4007a40 con 0x555afea8bf30 2023-10-05T19:50:42.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/3389112648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 msgr2=0x555afea8aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/3389112648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afea8aae0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f54e400a5d0 tx=0x7f54e4005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:42.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/3389112648 shutdown_connections 2023-10-05T19:50:42.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/3389112648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afea8aae0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/3389112648 >> 172.21.15.167:0/3389112648 conn(0x555afea86240 msgr2=0x555afea88650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/3389112648 shutdown_connections 2023-10-05T19:50:42.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/3389112648 wait complete. 2023-10-05T19:50:42.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 Processor -- start 2023-10-05T19:50:42.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 -- start start 2023-10-05T19:50:42.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeaaca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.436+0000 7f54eb6a9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afe959e30 con 0x555afea8bf30 2023-10-05T19:50:42.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e91de700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeaaca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e91de700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeaaca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46296/0 (socket says 172.21.15.167:46296) 2023-10-05T19:50:42.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e91de700 1 -- 172.21.15.167:0/649527173 learned_addr learned my addr 172.21.15.167:0/649527173 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e91de700 1 -- 172.21.15.167:0/649527173 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e4005cf0 con 0x555afea8bf30 2023-10-05T19:50:42.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e91de700 1 --2- 172.21.15.167:0/649527173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeaaca60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f54e4000c00 tx=0x7f54e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e8256a0e4157d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e2ffd700 1 -- 172.21.15.167:0/649527173 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54e40078e0 con 0x555afea8bf30 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e2ffd700 1 -- 172.21.15.167:0/649527173 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e4007a40 con 0x555afea8bf30 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e2ffd700 1 -- 172.21.15.167:0/649527173 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54e4007bd0 con 0x555afea8bf30 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/649527173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 msgr2=0x555afeaaca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/649527173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeaaca60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f54e4000c00 tx=0x7f54e4014000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/649527173 shutdown_connections 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/649527173 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeaaca60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/649527173 >> 172.21.15.167:0/649527173 conn(0x555afea86240 msgr2=0x555afeaa8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/649527173 shutdown_connections 2023-10-05T19:50:42.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/649527173 wait complete. 2023-10-05T19:50:42.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 Processor -- start 2023-10-05T19:50:42.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 -- start start 2023-10-05T19:50:42.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeab3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54eb6a9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afe92ced0 con 0x555afea8bf30 2023-10-05T19:50:42.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e91de700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeab3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e91de700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeab3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46310/0 (socket says 172.21.15.167:46310) 2023-10-05T19:50:42.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.440+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 learned_addr learned my addr 172.21.15.167:0/61517220 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555afea8b7f0 con 0x555afea8bf30 2023-10-05T19:50:42.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e91de700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeab3790 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f54e401f040 tx=0x7f54e401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e17fa700 1 -- 172.21.15.167:0/61517220 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54e40078e0 con 0x555afea8bf30 2023-10-05T19:50:42.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e17fa700 1 -- 172.21.15.167:0/61517220 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e4026650 con 0x555afea8bf30 2023-10-05T19:50:42.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555afeab3cd0 con 0x555afea8bf30 2023-10-05T19:50:42.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e17fa700 1 -- 172.21.15.167:0/61517220 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54e4026820 con 0x555afea8bf30 2023-10-05T19:50:42.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555afeab4110 con 0x555afea8bf30 2023-10-05T19:50:42.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e17fa700 1 -- 172.21.15.167:0/61517220 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f54e4026980 con 0x555afea8bf30 2023-10-05T19:50:42.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e17fa700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f54d0030c90 0x7f54d0033140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e17fa700 1 -- 172.21.15.167:0/61517220 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f54e4046ad0 con 0x555afea8bf30 2023-10-05T19:50:42.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e89dd700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f54d0030c90 0x7f54d0033140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555afea8c300 0x555afeabf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeabf890 con 0x555afea8c300 2023-10-05T19:50:42.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.444+0000 7f54e99df700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555afea8c300 0x555afeabf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54e89dd700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f54d0030c90 0x7f54d0033140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f54d40044f0 tx=0x7f54d4006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54e99df700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555afea8c300 0x555afeabf220 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f54dc00a500 con 0x555afea8c300 2023-10-05T19:50:42.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 20 realm 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeabc880 con 0x555afea8c300 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f54dc00a500 con 0x555afea8c300 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac0370 con 0x555afea8c300 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f54dc00a500 con 0x555afea8c300 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeabffa0 0x555afeac31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac3910 con 0x555afeabffa0 2023-10-05T19:50:42.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54e91de700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeabffa0 0x555afeac31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.448+0000 7f54e91de700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeabffa0 0x555afeac31e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54eb6a9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac41e0 con 0x555afea8c300 2023-10-05T19:50:42.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f54dc00a500 con 0x555afea8c300 2023-10-05T19:50:42.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54eb6a9e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54eb6a9e40 20 searching for the correct realm 2023-10-05T19:50:42.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555afeac3d50 0x555afeac7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeac3d50 2023-10-05T19:50:42.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e89dd700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555afeac3d50 0x555afeac7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e89dd700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555afeac3d50 0x555afeac7fb0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d4004520 con 0x555afeac3d50 2023-10-05T19:50:42.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeabffa0 2023-10-05T19:50:42.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e91de700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f54e4007030 0x7f54e40115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x7f54e4007030 2023-10-05T19:50:42.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.452+0000 7f54e99df700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f54e4007030 0x7f54e40115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e99df700 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f54e4007030 0x7f54e40115e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x7f54e4007030 2023-10-05T19:50:42.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeac3d50 2023-10-05T19:50:42.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d4004520 con 0x555afeac3d50 2023-10-05T19:50:42.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeabffa0 2023-10-05T19:50:42.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.456+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeabffa0 2023-10-05T19:50:42.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x7f54e4007030 2023-10-05T19:50:42.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x7f54e4007030 2023-10-05T19:50:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x7f54e4007030 2023-10-05T19:50:42.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x7f54e4007030 2023-10-05T19:50:42.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeabffa0 2023-10-05T19:50:42.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeac3d50 2023-10-05T19:50:42.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d4004520 con 0x555afeac3d50 2023-10-05T19:50:42.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.460+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeabffa0 2023-10-05T19:50:42.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeac3d50 2023-10-05T19:50:42.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeac3d50 2023-10-05T19:50:42.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.464+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x7f54e4007030 2023-10-05T19:50:42.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x7f54e4007030 2023-10-05T19:50:42.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afea8c300 2023-10-05T19:50:42.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x7f54e4007030 2023-10-05T19:50:42.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x7f54e4007030 2023-10-05T19:50:42.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeac3d50 2023-10-05T19:50:42.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x7f54e4007030 2023-10-05T19:50:42.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x7f54e4007030 2023-10-05T19:50:42.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeabffa0 2023-10-05T19:50:42.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeabffa0 2023-10-05T19:50:42.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.468+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8590 con 0x555afeac3d50 2023-10-05T19:50:42.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f54d4021040 con 0x555afeabffa0 2023-10-05T19:50:42.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f54d4021040 con 0x555afeabffa0 2023-10-05T19:50:42.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54eb6a9e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54eb6a9e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54eb6a9e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54eb6a9e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac4d50 con 0x555afea8c300 2023-10-05T19:50:42.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.472+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac56d0 con 0x555afeabffa0 2023-10-05T19:50:42.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac4940 con 0x555afeabffa0 2023-10-05T19:50:42.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac8f40 con 0x555afeac3d50 2023-10-05T19:50:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac96a0 con 0x555afeabffa0 2023-10-05T19:50:42.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.476+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacaa60 con 0x555afeac3d50 2023-10-05T19:50:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacaa60 con 0x555afeabffa0 2023-10-05T19:50:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacaa60 con 0x7f54e4007030 2023-10-05T19:50:42.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x7f54e4007030 2023-10-05T19:50:42.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeac3d50 2023-10-05T19:50:42.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.480+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeabffa0 2023-10-05T19:50:42.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeabffa0 2023-10-05T19:50:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x7f54e4007030 2023-10-05T19:50:42.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x7f54e4007030 2023-10-05T19:50:42.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x7f54e4007030 2023-10-05T19:50:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x7f54e4007030 2023-10-05T19:50:42.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.484+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeabffa0 2023-10-05T19:50:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeac3d50 2023-10-05T19:50:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeabffa0 2023-10-05T19:50:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeac3d50 2023-10-05T19:50:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc014040 con 0x555afea8c300 2023-10-05T19:50:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.488+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeac3d50 2023-10-05T19:50:42.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x7f54e4007030 2023-10-05T19:50:42.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afea8c300 2023-10-05T19:50:42.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x7f54e4007030 2023-10-05T19:50:42.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeac3d50 2023-10-05T19:50:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.492+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x7f54e4007030 2023-10-05T19:50:42.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeabffa0 2023-10-05T19:50:42.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeabffa0 2023-10-05T19:50:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeac3d50 2023-10-05T19:50:42.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeabffa0 2023-10-05T19:50:42.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.496+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac92f0 con 0x555afeabffa0 2023-10-05T19:50:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac9a50 con 0x555afeabffa0 2023-10-05T19:50:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeac9e00 con 0x555afea8c300 2023-10-05T19:50:42.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeaca6a0 con 0x555afeabffa0 2023-10-05T19:50:42.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.500+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacaa50 con 0x555afeabffa0 2023-10-05T19:50:42.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeaca2e0 con 0x7f54e4007030 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 zone default found 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 4 Realm: () 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 zonegroup default 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacaf40 con 0x7f54e4007030 2023-10-05T19:50:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacc8c0 con 0x555afeac3d50 2023-10-05T19:50:42.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.504+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeaccc70 con 0x555afeac3d50 2023-10-05T19:50:42.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.508+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.508+0000 7f54eb6a9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.508+0000 7f54eb6a9e40 20 started sync module instance, tier type = 2023-10-05T19:50:42.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.508+0000 7f54eb6a9e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:42.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.508+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacbf80 con 0x555afeabffa0 2023-10-05T19:50:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.508+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.508+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93849308150416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacc4d0 con 0x555afeabffa0 2023-10-05T19:50:42.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.508+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacbf70 con 0x555afea8c300 2023-10-05T19:50:42.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.512+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.512+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93849308150416] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.512+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93849308157200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacbf70 con 0x555afea8c300 2023-10-05T19:50:42.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.512+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeace340 con 0x555afeabffa0 2023-10-05T19:50:42.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.512+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93849308157200] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.512+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.512+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93849308158304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacbf70 con 0x555afeabffa0 2023-10-05T19:50:42.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.512+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeace900 con 0x7f54e4007030 2023-10-05T19:50:42.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.516+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.516+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93849308161040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeaced50 con 0x7f54e4007030 2023-10-05T19:50:42.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.516+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacf760 con 0x555afeabffa0 2023-10-05T19:50:42.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.516+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93849308158304] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.516+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93849308161040] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.520+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.520+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93849308162144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacecb0 con 0x555afeabffa0 2023-10-05T19:50:42.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.520+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacfc50 con 0x555afeac3d50 2023-10-05T19:50:42.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.520+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93849308162144] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.520+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.520+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93849308164720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afead0000 con 0x555afeac3d50 2023-10-05T19:50:42.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.520+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afead08a0 con 0x555afeac3d50 2023-10-05T19:50:42.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.520+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93849308171344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afead1590 con 0x555afeac3d50 2023-10-05T19:50:42.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afead1fa0 con 0x7f54e4007030 2023-10-05T19:50:42.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 93849308164720] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93849308165824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afead1fa0 con 0x7f54e4007030 2023-10-05T19:50:42.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 20 add_watcher() i=0 2023-10-05T19:50:42.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 20 add_watcher() i=1 2023-10-05T19:50:42.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 20 add_watcher() i=2 2023-10-05T19:50:42.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 20 add_watcher() i=3 2023-10-05T19:50:42.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 20 add_watcher() i=4 2023-10-05T19:50:42.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 20 add_watcher() i=5 2023-10-05T19:50:42.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93849308171344] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 20 add_watcher() i=6 2023-10-05T19:50:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93849308165824] v30'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 20 add_watcher() i=7 2023-10-05T19:50:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afead4fd0 con 0x555afea8c300 2023-10-05T19:50:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.524+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93849308175024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afead23f0 con 0x555afea8c300 2023-10-05T19:50:42.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93849308175024] v30'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54b9feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54eb6a9e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54eb6a9e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54eb6a9e40 1 Processor -- start 2023-10-05T19:50:42.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54eb6a9e40 1 -- start start 2023-10-05T19:50:42.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54eb6a9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeadf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54eb6a9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afeadfa60 con 0x555afeadf150 2023-10-05T19:50:42.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54e89dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeadf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54e89dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeadf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46316/0 (socket says 172.21.15.167:46316) 2023-10-05T19:50:42.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54e89dd700 1 -- 172.21.15.167:0/2764116776 learned_addr learned my addr 172.21.15.167:0/2764116776 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54e89dd700 1 -- 172.21.15.167:0/2764116776 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555afeadfba0 con 0x555afeadf150 2023-10-05T19:50:42.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54e89dd700 1 --2- 172.21.15.167:0/2764116776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeadf520 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f54d4001330 tx=0x7f54d4006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad5daa470b5690 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54b97ea700 1 -- 172.21.15.167:0/2764116776 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54d401a040 con 0x555afeadf150 2023-10-05T19:50:42.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54b97ea700 1 -- 172.21.15.167:0/2764116776 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d402da30 con 0x555afeadf150 2023-10-05T19:50:42.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.528+0000 7f54b97ea700 1 -- 172.21.15.167:0/2764116776 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54d402dbc0 con 0x555afeadf150 2023-10-05T19:50:42.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/2764116776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 msgr2=0x555afeadf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/2764116776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeadf520 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f54d4001330 tx=0x7f54d4006000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/2764116776 shutdown_connections 2023-10-05T19:50:42.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/2764116776 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeadf520 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/2764116776 >> 172.21.15.167:0/2764116776 conn(0x555afeada510 msgr2=0x555afead86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/2764116776 shutdown_connections 2023-10-05T19:50:42.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/2764116776 wait complete. 2023-10-05T19:50:42.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 Processor -- start 2023-10-05T19:50:42.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 -- start start 2023-10-05T19:50:42.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeae4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555afeae5c20 con 0x555afeadf150 2023-10-05T19:50:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54e89dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeae4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54e89dd700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeae4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46324/0 (socket says 172.21.15.167:46324) 2023-10-05T19:50:42.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54e89dd700 1 -- 172.21.15.167:0/1675244814 learned_addr learned my addr 172.21.15.167:0/1675244814 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54e89dd700 1 -- 172.21.15.167:0/1675244814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc001e10 con 0x555afeadf150 2023-10-05T19:50:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54e89dd700 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeae4c20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f54e400a5d0 tx=0x7f54d4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54337fe700 1 -- 172.21.15.167:0/1675244814 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54d401a040 con 0x555afeadf150 2023-10-05T19:50:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54337fe700 1 -- 172.21.15.167:0/1675244814 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d4004260 con 0x555afeadf150 2023-10-05T19:50:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555afeae5220 con 0x555afeadf150 2023-10-05T19:50:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54337fe700 1 -- 172.21.15.167:0/1675244814 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54d40149d0 con 0x555afeadf150 2023-10-05T19:50:42.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.532+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555afeae56c0 con 0x555afeadf150 2023-10-05T19:50:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f54337fe700 1 -- 172.21.15.167:0/1675244814 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f54d4014b30 con 0x555afeadf150 2023-10-05T19:50:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f54337fe700 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5428030c00 0x7f54280330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f54337fe700 1 -- 172.21.15.167:0/1675244814 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f54d4027040 con 0x555afeadf150 2023-10-05T19:50:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f54e99df700 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5428030c00 0x7f54280330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f54eb6a9e40 5 note: GC not initialized 2023-10-05T19:50:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f54e99df700 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5428030c00 0x7f54280330b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x555afead12e0 tx=0x7f54dc00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f5430ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f54267fc700 20 reqs_thread_entry: start 2023-10-05T19:50:42.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f54eb6a9e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:42.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.536+0000 7f54eb6a9e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f5424ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:12 2023 2023-10-05T19:50:42.548 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f540bfff700 20 reqs_thread_entry: start 2023-10-05T19:50:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54eb6a9e40 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T19:50:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeb4c110 0x555afeb4e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.3 6:c741032d:::2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeb4ea30 con 0x555afeb4c110 2023-10-05T19:50:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54e91de700 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeb4c110 0x555afeb4e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54e91de700 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeb4c110 0x555afeb4e4f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54e91de700 1 -- 172.21.15.167:0/1675244814 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4 [read 0~850 out=850b] v0'0 uv33 ondisk = 0) v8 ==== 208+0+850 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeb4c110 2023-10-05T19:50:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54eb6a9e40 10 read 850 2023-10-05T19:50:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54eb6a9e40 10 log_show_next pos 850 bl 850 off 419 eof 1 2023-10-05T19:50:42.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54eb6a9e40 10 log_show_next pos 850 bl 850 off 850 eof 1 2023-10-05T19:50:42.549 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:42.549 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4", 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_owner": "foo", 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "log_entries": [ 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:37.109016Z", 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:37.109016+0000", 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "create_bucket", 2023-10-05T19:50:42.550 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "PUT /myfoo4/ HTTP/1.1", 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 15, 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx0000041f4d45c5971c0d7-00651f138d-1085-default", 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.551 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:37.321011Z", 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:37.321011+0000", 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "delete_bucket", 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "DELETE /myfoo4/ HTTP/1.1", 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "204", 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "NoContent", 2023-10-05T19:50:42.552 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 71, 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx000004a66f63eb1c67c7a-00651f138d-1085-default", 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:42.553 INFO:teuthology.orchestra.run.smithi167.stdout: "log_sum": { 2023-10-05T19:50:42.554 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.554 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.554 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 86, 2023-10-05T19:50:42.554 INFO:teuthology.orchestra.run.smithi167.stdout: "total_entries": 2 2023-10-05T19:50:42.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:42.554 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:42.554 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:42.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.540+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93849308150416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeb0b740 con 0x555afeabffa0 2023-10-05T19:50:42.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.544+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 93849308150416] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.544+0000 7f54eb6a9e40 20 remove_watcher() i=0 2023-10-05T19:50:42.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.544+0000 7f54eb6a9e40 2 removed watcher, disabling cache 2023-10-05T19:50:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.544+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93849308157200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacba90 con 0x555afea8c300 2023-10-05T19:50:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.544+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 93849308157200] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.544+0000 7f54eb6a9e40 20 remove_watcher() i=1 2023-10-05T19:50:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.544+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93849308158304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacba90 con 0x555afeabffa0 2023-10-05T19:50:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.548+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 93849308158304] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.548+0000 7f54eb6a9e40 20 remove_watcher() i=2 2023-10-05T19:50:42.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.548+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93849308161040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacda00 con 0x7f54e4007030 2023-10-05T19:50:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.548+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 93849308161040] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.548+0000 7f54eb6a9e40 20 remove_watcher() i=3 2023-10-05T19:50:42.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.548+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93849308162144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacda00 con 0x555afeabffa0 2023-10-05T19:50:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.552+0000 7f54e91de700 1 -- 172.21.15.167:0/61517220 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 93849308162144] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54e40129c0 con 0x555afeabffa0 2023-10-05T19:50:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.552+0000 7f54eb6a9e40 20 remove_watcher() i=4 2023-10-05T19:50:42.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.552+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93849308164720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacda00 con 0x555afeac3d50 2023-10-05T19:50:42.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.552+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 93849308164720] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.552+0000 7f54eb6a9e40 20 remove_watcher() i=5 2023-10-05T19:50:42.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.552+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93849308171344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacda00 con 0x555afeac3d50 2023-10-05T19:50:42.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.556+0000 7f54e89dd700 1 -- 172.21.15.167:0/61517220 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 93849308171344] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54d401d040 con 0x555afeac3d50 2023-10-05T19:50:42.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.556+0000 7f54eb6a9e40 20 remove_watcher() i=6 2023-10-05T19:50:42.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.556+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93849308165824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeacda00 con 0x7f54e4007030 2023-10-05T19:50:42.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.556+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 93849308165824] v30'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x7f54e4007030 2023-10-05T19:50:42.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.556+0000 7f54eb6a9e40 20 remove_watcher() i=7 2023-10-05T19:50:42.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54b9feb700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93849308175024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x555afeace900 con 0x555afea8c300 2023-10-05T19:50:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 93849308175024] v30'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f54dc033040 con 0x555afea8c300 2023-10-05T19:50:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeabffa0 msgr2=0x555afeac31e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeabffa0 0x555afeac31e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555afea8c300 msgr2=0x555afeabf220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555afea8c300 0x555afeabf220 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f54e4007030 msgr2=0x7f54e40115e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f54e4007030 0x7f54e40115e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555afeac3d50 msgr2=0x555afeac7fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555afeac3d50 0x555afeac7fb0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f54d0030c90 msgr2=0x7f54d0033140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f54d0030c90 0x7f54d0033140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f54d40044f0 tx=0x7f54d4006690 comp rx=0 tx=0).stop 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54e99df700 1 -- 172.21.15.167:0/61517220 reap_dead start 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 msgr2=0x555afeab3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeab3790 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f54e401f040 tx=0x7f54e401c000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 shutdown_connections 2023-10-05T19:50:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/61517220 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afea8bf30 0x555afeab3790 secure :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f54e401f040 tx=0x7f54e401c000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 >> 172.21.15.167:0/61517220 conn(0x555afea86240 msgr2=0x555afeaa70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 shutdown_connections 2023-10-05T19:50:42.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/61517220 wait complete. 2023-10-05T19:50:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeb4c110 msgr2=0x555afeb4e4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.560+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeb4c110 0x555afeb4e4f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5428030c00 msgr2=0x7f54280330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5428030c00 0x7f54280330b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x555afead12e0 tx=0x7f54dc00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:42.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 msgr2=0x555afeae4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeae4c20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f54e400a5d0 tx=0x7f54d4030000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 shutdown_connections 2023-10-05T19:50:42.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555afeb4c110 0x555afeb4e4f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5428030c00 0x7f54280330b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 --2- 172.21.15.167:0/1675244814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555afeadf150 0x555afeae4c20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 >> 172.21.15.167:0/1675244814 conn(0x555afeada510 msgr2=0x555afead8610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 shutdown_connections 2023-10-05T19:50:42.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.564+0000 7f54eb6a9e40 1 -- 172.21.15.167:0/1675244814 wait complete. 2023-10-05T19:50:42.576 DEBUG:tasks.util.rgw: json result: {'bucket_id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4', 'bucket_owner': 'foo', 'bucket': 'myfoo4', 'log_entries': [{'bucket': 'myfoo4', 'time': '2023-10-05T19:50:37.109016Z', 'time_local': '2023-10-05T19:50:37.109016+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'create_bucket', 'uri': 'PUT /myfoo4/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 15, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx0000041f4d45c5971c0d7-00651f138d-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo4', 'time': '2023-10-05T19:50:37.321011Z', 'time_local': '2023-10-05T19:50:37.321011+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_bucket', 'uri': 'DELETE /myfoo4/ HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 71, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx000004a66f63eb1c67c7a-00651f138d-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 0, 'bytes_received': 0, 'total_time': 86, 'total_entries': 2}} 2023-10-05T19:50:42.576 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.576 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.576 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4'] 2023-10-05T19:50:42.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4'] 2023-10-05T19:50:42.576 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4 2023-10-05T19:50:42.659 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:42.659 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:42.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb3c7be40 1 Processor -- start 2023-10-05T19:50:42.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb3c7be40 1 -- start start 2023-10-05T19:50:42.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb3c7be40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5600f3662b50 0x5600f3662f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb3c7be40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5600f35adbd0 con 0x5600f3663460 2023-10-05T19:50:42.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb3c7be40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5600f356aee0 con 0x5600f3662b50 2023-10-05T19:50:42.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb17b0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5600f3662b50 0x5600f3662f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb0faf700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x5600f3663460 0x5600f3663ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51842/0 (socket says 172.21.15.167:51842) 2023-10-05T19:50:42.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2870879480 learned_addr learned my addr 172.21.15.167:0/2870879480 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:42.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2870879480 >> v1:172.21.15.118:6789/0 conn(0x5600f3663460 legacy=0x5600f3663ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2870879480 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600f3664600 con 0x5600f3662b50 2023-10-05T19:50:42.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2bb17b0700 1 --2- 172.21.15.167:0/2870879480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3662f20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00a520 tx=0x7f2b9c005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60b6b7d5751c73c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2babfff700 1 -- 172.21.15.167:0/2870879480 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c00f590 con 0x5600f3662b50 2023-10-05T19:50:42.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2babfff700 1 -- 172.21.15.167:0/2870879480 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c00f6f0 con 0x5600f3662b50 2023-10-05T19:50:42.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.652+0000 7f2babfff700 1 -- 172.21.15.167:0/2870879480 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c00f880 con 0x5600f3662b50 2023-10-05T19:50:42.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2870879480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 msgr2=0x5600f3662f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2870879480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3662f20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00a520 tx=0x7f2b9c005d40 comp rx=0 tx=0).stop 2023-10-05T19:50:42.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2870879480 shutdown_connections 2023-10-05T19:50:42.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2870879480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3662f20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2870879480 >> 172.21.15.167:0/2870879480 conn(0x5600f35d65c0 msgr2=0x5600f35d69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2870879480 shutdown_connections 2023-10-05T19:50:42.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2870879480 wait complete. 2023-10-05T19:50:42.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 Processor -- start 2023-10-05T19:50:42.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 -- start start 2023-10-05T19:50:42.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3681bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb3c7be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600f352ee30 con 0x5600f3662b50 2023-10-05T19:50:42.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb17b0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3681bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb17b0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3681bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46344/0 (socket says 172.21.15.167:46344) 2023-10-05T19:50:42.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb17b0700 1 -- 172.21.15.167:0/957967033 learned_addr learned my addr 172.21.15.167:0/957967033 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb17b0700 1 -- 172.21.15.167:0/957967033 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c00a0e0 con 0x5600f3662b50 2023-10-05T19:50:42.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2bb17b0700 1 --2- 172.21.15.167:0/957967033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3681bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00a470 tx=0x7f2b9c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8504109707ac64a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2baaffd700 1 -- 172.21.15.167:0/957967033 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c00f860 con 0x5600f3662b50 2023-10-05T19:50:42.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2baaffd700 1 -- 172.21.15.167:0/957967033 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c00f9e0 con 0x5600f3662b50 2023-10-05T19:50:42.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.656+0000 7f2baaffd700 1 -- 172.21.15.167:0/957967033 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c00fb90 con 0x5600f3662b50 2023-10-05T19:50:42.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/957967033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 msgr2=0x5600f3681bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/957967033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3681bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00a470 tx=0x7f2b9c014000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/957967033 shutdown_connections 2023-10-05T19:50:42.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/957967033 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3681bf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/957967033 >> 172.21.15.167:0/957967033 conn(0x5600f35d65c0 msgr2=0x5600f367d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/957967033 shutdown_connections 2023-10-05T19:50:42.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/957967033 wait complete. 2023-10-05T19:50:42.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 Processor -- start 2023-10-05T19:50:42.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 -- start start 2023-10-05T19:50:42.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3688850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600f3501ed0 con 0x5600f3662b50 2023-10-05T19:50:42.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb17b0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3688850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb17b0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3688850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46346/0 (socket says 172.21.15.167:46346) 2023-10-05T19:50:42.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 learned_addr learned my addr 172.21.15.167:0/2385799324 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600f3664600 con 0x5600f3662b50 2023-10-05T19:50:42.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb17b0700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3688850 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00a470 tx=0x7f2b9c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2ba97fa700 1 -- 172.21.15.167:0/2385799324 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c01ce00 con 0x5600f3662b50 2023-10-05T19:50:42.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2ba97fa700 1 -- 172.21.15.167:0/2385799324 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c010630 con 0x5600f3662b50 2023-10-05T19:50:42.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600f3688d90 con 0x5600f3662b50 2023-10-05T19:50:42.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2ba97fa700 1 -- 172.21.15.167:0/2385799324 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c010820 con 0x5600f3662b50 2023-10-05T19:50:42.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.660+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600f36891d0 con 0x5600f3662b50 2023-10-05T19:50:42.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2ba97fa700 1 -- 172.21.15.167:0/2385799324 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2b9c010980 con 0x5600f3662b50 2023-10-05T19:50:42.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2ba97fa700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b94030c50 0x7f2b94033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2ba97fa700 1 -- 172.21.15.167:0/2385799324 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2b9c02b070 con 0x5600f3662b50 2023-10-05T19:50:42.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb0faf700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b94030c50 0x7f2b94033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5600f3663460 0x5600f36942e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f3694950 con 0x5600f3663460 2023-10-05T19:50:42.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb1fb1700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5600f3663460 0x5600f36942e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb0faf700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b94030c50 0x7f2b94033100 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bac004170 tx=0x7f2bac001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb1fb1700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5600f3663460 0x5600f36942e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ba400a500 con 0x5600f3663460 2023-10-05T19:50:42.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb3c7be40 20 realm 2023-10-05T19:50:42.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.664+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f3691940 con 0x5600f3663460 2023-10-05T19:50:42.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ba400a500 con 0x5600f3663460 2023-10-05T19:50:42.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:42.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f3695430 con 0x5600f3663460 2023-10-05T19:50:42.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ba400a500 con 0x5600f3663460 2023-10-05T19:50:42.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3696260 0x5600f3698640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f3698b80 con 0x5600f3696260 2023-10-05T19:50:42.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb17b0700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3696260 0x5600f3698640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb17b0700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3696260 0x5600f3698640 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f3699420 con 0x5600f3663460 2023-10-05T19:50:42.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2ba400a500 con 0x5600f3663460 2023-10-05T19:50:42.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 20 searching for the correct realm 2023-10-05T19:50:42.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5600f369b1e0 0x5600f369d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f369b1e0 2023-10-05T19:50:42.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb0faf700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5600f369b1e0 0x5600f369d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.668+0000 7f2bb0faf700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5600f369b1e0 0x5600f369d5c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac006070 con 0x5600f369b1e0 2023-10-05T19:50:42.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3696260 2023-10-05T19:50:42.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb17b0700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2b9c044040 0x7f2b9c013120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x7f2b9c044040 2023-10-05T19:50:42.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2b9c044040 0x7f2b9c013120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2b9c044040 0x7f2b9c013120 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x7f2b9c044040 2023-10-05T19:50:42.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f369b1e0 2023-10-05T19:50:42.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac006070 con 0x5600f369b1e0 2023-10-05T19:50:42.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.672+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3696260 2023-10-05T19:50:42.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3696260 2023-10-05T19:50:42.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x7f2b9c044040 2023-10-05T19:50:42.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x7f2b9c044040 2023-10-05T19:50:42.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x7f2b9c044040 2023-10-05T19:50:42.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x7f2b9c044040 2023-10-05T19:50:42.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.676+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3696260 2023-10-05T19:50:42.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f369b1e0 2023-10-05T19:50:42.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac006070 con 0x5600f369b1e0 2023-10-05T19:50:42.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3696260 2023-10-05T19:50:42.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f369b1e0 2023-10-05T19:50:42.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac006070 con 0x5600f369b1e0 2023-10-05T19:50:42.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.680+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f369b1e0 2023-10-05T19:50:42.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac006070 con 0x5600f369b1e0 2023-10-05T19:50:42.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x7f2b9c044040 2023-10-05T19:50:42.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x7f2b9c044040 2023-10-05T19:50:42.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3663460 2023-10-05T19:50:42.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x7f2b9c044040 2023-10-05T19:50:42.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x7f2b9c044040 2023-10-05T19:50:42.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f369b1e0 2023-10-05T19:50:42.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac006070 con 0x5600f369b1e0 2023-10-05T19:50:42.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.684+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x7f2b9c044040 2023-10-05T19:50:42.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x7f2b9c044040 2023-10-05T19:50:42.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3696260 2023-10-05T19:50:42.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3696260 2023-10-05T19:50:42.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f369b1e0 2023-10-05T19:50:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac006070 con 0x5600f369b1e0 2023-10-05T19:50:42.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3696260 2023-10-05T19:50:42.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369db00 con 0x5600f3696260 2023-10-05T19:50:42.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb3c7be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb3c7be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb3c7be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb3c7be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.688+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f3699f90 con 0x5600f3663460 2023-10-05T19:50:42.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369a8e0 con 0x5600f3696260 2023-10-05T19:50:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369df40 con 0x5600f3696260 2023-10-05T19:50:42.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e2f0 con 0x5600f369b1e0 2023-10-05T19:50:42.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2bac006070 con 0x5600f369b1e0 2023-10-05T19:50:42.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f3663460 2023-10-05T19:50:42.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.692+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369a480 con 0x5600f3696260 2023-10-05T19:50:42.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb3c7be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369ffa0 con 0x5600f369b1e0 2023-10-05T19:50:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369ffa0 con 0x5600f3696260 2023-10-05T19:50:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369ffa0 con 0x7f2b9c044040 2023-10-05T19:50:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x7f2b9c044040 2023-10-05T19:50:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f3663460 2023-10-05T19:50:42.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.696+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f3663460 2023-10-05T19:50:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f369b1e0 2023-10-05T19:50:42.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f3663460 2023-10-05T19:50:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f3696260 2023-10-05T19:50:42.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f3696260 2023-10-05T19:50:42.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f3663460 2023-10-05T19:50:42.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.700+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x7f2b9c044040 2023-10-05T19:50:42.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x7f2b9c044040 2023-10-05T19:50:42.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f3663460 2023-10-05T19:50:42.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x7f2b9c044040 2023-10-05T19:50:42.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x7f2b9c044040 2023-10-05T19:50:42.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f3696260 2023-10-05T19:50:42.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369e6a0 con 0x5600f369b1e0 2023-10-05T19:50:42.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3663460 2023-10-05T19:50:42.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3696260 2023-10-05T19:50:42.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.704+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f369b1e0 2023-10-05T19:50:42.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3663460 2023-10-05T19:50:42.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4014040 con 0x5600f3663460 2023-10-05T19:50:42.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3663460 2023-10-05T19:50:42.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3663460 2023-10-05T19:50:42.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f369b1e0 2023-10-05T19:50:42.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x7f2b9c044040 2023-10-05T19:50:42.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.708+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3663460 2023-10-05T19:50:42.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x7f2b9c044040 2023-10-05T19:50:42.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f369b1e0 2023-10-05T19:50:42.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x7f2b9c044040 2023-10-05T19:50:42.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3696260 2023-10-05T19:50:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3696260 2023-10-05T19:50:42.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.712+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f369b1e0 2023-10-05T19:50:42.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3696260 2023-10-05T19:50:42.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bac028040 con 0x5600f3696260 2023-10-05T19:50:42.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369ef90 con 0x5600f3696260 2023-10-05T19:50:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369ef90 con 0x5600f3663460 2023-10-05T19:50:42.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.716+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369f830 con 0x5600f3696260 2023-10-05T19:50:42.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369f830 con 0x5600f3696260 2023-10-05T19:50:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369f930 con 0x7f2b9c044040 2023-10-05T19:50:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 zone default found 2023-10-05T19:50:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 4 Realm: () 2023-10-05T19:50:42.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 zonegroup default 2023-10-05T19:50:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f369f930 con 0x7f2b9c044040 2023-10-05T19:50:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.720+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a12b0 con 0x5600f369b1e0 2023-10-05T19:50:42.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb3c7be40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a1660 con 0x5600f369b1e0 2023-10-05T19:50:42.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb3c7be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb3c7be40 20 started sync module instance, tier type = 2023-10-05T19:50:42.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb3c7be40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:42.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a0970 con 0x5600f3696260 2023-10-05T19:50:42.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94562083800480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a0ee0 con 0x5600f3696260 2023-10-05T19:50:42.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.724+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a1fa0 con 0x5600f3663460 2023-10-05T19:50:42.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.728+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.728+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94562083805808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a0ee0 con 0x5600f3663460 2023-10-05T19:50:42.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.728+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a2ef0 con 0x5600f3696260 2023-10-05T19:50:42.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.728+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94562083800480] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.732+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94562083805808] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.732+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.732+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94562083801584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a24c0 con 0x5600f3696260 2023-10-05T19:50:42.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.732+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a33e0 con 0x7f2b9c044040 2023-10-05T19:50:42.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.732+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.732+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94562083811056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a24c0 con 0x7f2b9c044040 2023-10-05T19:50:42.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.732+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a3ed0 con 0x5600f3696260 2023-10-05T19:50:42.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.732+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94562083801584] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.732+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94562083811056] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.736+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.736+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94562083812160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a24c0 con 0x5600f3696260 2023-10-05T19:50:42.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.736+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a42d0 con 0x5600f369b1e0 2023-10-05T19:50:42.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.736+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.736+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94562083813792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a4b70 con 0x5600f369b1e0 2023-10-05T19:50:42.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.736+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a55e0 con 0x5600f369b1e0 2023-10-05T19:50:42.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.736+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94562083812160] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.736+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.736+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94562083813792] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94562083809792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a59e0 con 0x5600f369b1e0 2023-10-05T19:50:42.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a6280 con 0x7f2b9c044040 2023-10-05T19:50:42.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94562083809792] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94562083822048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a6320 con 0x7f2b9c044040 2023-10-05T19:50:42.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 20 add_watcher() i=0 2023-10-05T19:50:42.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 20 add_watcher() i=1 2023-10-05T19:50:42.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 20 add_watcher() i=2 2023-10-05T19:50:42.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 20 add_watcher() i=3 2023-10-05T19:50:42.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 20 add_watcher() i=4 2023-10-05T19:50:42.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 20 add_watcher() i=5 2023-10-05T19:50:42.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 20 add_watcher() i=6 2023-10-05T19:50:42.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94562083822048] v30'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 20 add_watcher() i=7 2023-10-05T19:50:42.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:42.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.740+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a94c0 con 0x5600f3663460 2023-10-05T19:50:42.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94562083823520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a6a30 con 0x5600f3663460 2023-10-05T19:50:42.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94562083823520] v30'158 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2b827e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb3c7be40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:42.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb3c7be40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb3c7be40 1 Processor -- start 2023-10-05T19:50:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb3c7be40 1 -- start start 2023-10-05T19:50:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb3c7be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb3c7be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600f36b4480 con 0x5600f36b3b70 2023-10-05T19:50:42.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb0faf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb0faf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46352/0 (socket says 172.21.15.167:46352) 2023-10-05T19:50:42.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.744+0000 7f2bb0faf700 1 -- 172.21.15.167:0/1367724830 learned_addr learned my addr 172.21.15.167:0/1367724830 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb0faf700 1 -- 172.21.15.167:0/1367724830 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600f36b45c0 con 0x5600f36b3b70 2023-10-05T19:50:42.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb0faf700 1 --2- 172.21.15.167:0/1367724830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b3f40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x5600f3695b60 tx=0x7f2bac010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c24aaed861ba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2b81fe3700 1 -- 172.21.15.167:0/1367724830 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bac03b070 con 0x5600f36b3b70 2023-10-05T19:50:42.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2b81fe3700 1 -- 172.21.15.167:0/1367724830 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac022040 con 0x5600f36b3b70 2023-10-05T19:50:42.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2b81fe3700 1 -- 172.21.15.167:0/1367724830 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bac021040 con 0x5600f36b3b70 2023-10-05T19:50:42.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/1367724830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 msgr2=0x5600f36b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/1367724830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b3f40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x5600f3695b60 tx=0x7f2bac010000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/1367724830 shutdown_connections 2023-10-05T19:50:42.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/1367724830 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b3f40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/1367724830 >> 172.21.15.167:0/1367724830 conn(0x5600f36aef30 msgr2=0x5600f36ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/1367724830 shutdown_connections 2023-10-05T19:50:42.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/1367724830 wait complete. 2023-10-05T19:50:42.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 Processor -- start 2023-10-05T19:50:42.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 -- start start 2023-10-05T19:50:42.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb3c7be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600f36ba670 con 0x5600f36b3b70 2023-10-05T19:50:42.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb0faf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb0faf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46354/0 (socket says 172.21.15.167:46354) 2023-10-05T19:50:42.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb0faf700 1 -- 172.21.15.167:0/146609647 learned_addr learned my addr 172.21.15.167:0/146609647 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.748+0000 7f2bb0faf700 1 -- 172.21.15.167:0/146609647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600f35adbd0 con 0x5600f36b3b70 2023-10-05T19:50:42.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2bb0faf700 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b9670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x5600f36adbf0 tx=0x7f2bac037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2af3fff700 1 -- 172.21.15.167:0/146609647 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bac021070 con 0x5600f36b3b70 2023-10-05T19:50:42.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2af3fff700 1 -- 172.21.15.167:0/146609647 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac034e80 con 0x5600f36b3b70 2023-10-05T19:50:42.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2af3fff700 1 -- 172.21.15.167:0/146609647 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bac046070 con 0x5600f36b3b70 2023-10-05T19:50:42.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600f36b9c70 con 0x5600f36b3b70 2023-10-05T19:50:42.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600f36ba110 con 0x5600f36b3b70 2023-10-05T19:50:42.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2af3fff700 1 -- 172.21.15.167:0/146609647 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2bac03e020 con 0x5600f36b3b70 2023-10-05T19:50:42.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2af3fff700 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2af8030c00 0x7f2af80330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2af3fff700 1 -- 172.21.15.167:0/146609647 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f2bac02e040 con 0x5600f36b3b70 2023-10-05T19:50:42.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2bb1fb1700 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2af8030c00 0x7f2af80330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2bb3c7be40 5 note: GC not initialized 2023-10-05T19:50:42.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.752+0000 7f2bb1fb1700 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2af8030c00 0x7f2af80330b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5600f36a6990 tx=0x7f2ba400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2af17fa700 20 reqs_thread_entry: start 2023-10-05T19:50:42.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2aeaffd700 20 reqs_thread_entry: start 2023-10-05T19:50:42.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2bb3c7be40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:42.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2bb3c7be40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:42.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2ae97fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:13 2023 2023-10-05T19:50:42.764 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:42.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2ae8ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:42.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3720d40 0x5600f3723120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.3 6:c741032d:::2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f3723660 con 0x5600f3720d40 2023-10-05T19:50:42.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2bb17b0700 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3720d40 0x5600f3723120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.756+0000 7f2bb17b0700 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3720d40 0x5600f3723120 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.760+0000 7f2bb17b0700 1 -- 172.21.15.167:0/146609647 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.4-myfoo4 [delete] v30'46 uv46 ondisk = 0) v8 ==== 208+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3720d40 2023-10-05T19:50:42.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.760+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94562083800480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36dfe80 con 0x5600f3696260 2023-10-05T19:50:42.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.760+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94562083800480] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.760+0000 7f2bb3c7be40 20 remove_watcher() i=0 2023-10-05T19:50:42.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.760+0000 7f2bb3c7be40 2 removed watcher, disabling cache 2023-10-05T19:50:42.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.760+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94562083805808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a05a0 con 0x5600f3663460 2023-10-05T19:50:42.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.764+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94562083805808] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.764+0000 7f2bb3c7be40 20 remove_watcher() i=1 2023-10-05T19:50:42.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.764+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94562083801584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a05a0 con 0x5600f3696260 2023-10-05T19:50:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.764+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94562083801584] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.764+0000 7f2bb3c7be40 20 remove_watcher() i=2 2023-10-05T19:50:42.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.764+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94562083811056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a1a70 con 0x7f2b9c044040 2023-10-05T19:50:42.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.768+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94562083811056] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.768+0000 7f2bb3c7be40 20 remove_watcher() i=3 2023-10-05T19:50:42.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.768+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94562083812160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a1a70 con 0x5600f3696260 2023-10-05T19:50:42.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.768+0000 7f2bb17b0700 1 -- 172.21.15.167:0/2385799324 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94562083812160] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2b9c024920 con 0x5600f3696260 2023-10-05T19:50:42.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.768+0000 7f2bb3c7be40 20 remove_watcher() i=4 2023-10-05T19:50:42.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.768+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94562083813792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a1a70 con 0x5600f369b1e0 2023-10-05T19:50:42.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.772+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94562083813792] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.772+0000 7f2bb3c7be40 20 remove_watcher() i=5 2023-10-05T19:50:42.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.772+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94562083809792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a1a70 con 0x5600f369b1e0 2023-10-05T19:50:42.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.772+0000 7f2bb0faf700 1 -- 172.21.15.167:0/2385799324 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94562083809792] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2bac024040 con 0x5600f369b1e0 2023-10-05T19:50:42.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.772+0000 7f2bb3c7be40 20 remove_watcher() i=6 2023-10-05T19:50:42.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.772+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94562083822048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a1a70 con 0x7f2b9c044040 2023-10-05T19:50:42.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.776+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94562083822048] v30'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x7f2b9c044040 2023-10-05T19:50:42.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.776+0000 7f2bb3c7be40 20 remove_watcher() i=7 2023-10-05T19:50:42.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.776+0000 7f2b827e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.776+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94562083823520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5600f36a1a70 con 0x5600f3663460 2023-10-05T19:50:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94562083823520] v30'159 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2ba4033040 con 0x5600f3663460 2023-10-05T19:50:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3696260 msgr2=0x5600f3698640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3696260 0x5600f3698640 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5600f3663460 msgr2=0x5600f36942e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5600f3663460 0x5600f36942e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2b9c044040 msgr2=0x7f2b9c013120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2b9c044040 0x7f2b9c013120 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5600f369b1e0 msgr2=0x5600f369d5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5600f369b1e0 0x5600f369d5c0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b94030c50 msgr2=0x7f2b94033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2b94030c50 0x7f2b94033100 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bac004170 tx=0x7f2bac001380 comp rx=0 tx=0).stop 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 msgr2=0x5600f3688850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/2385799324 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f3662b50 0x5600f3688850 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00a470 tx=0x7f2b9c01d000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb1fb1700 1 -- 172.21.15.167:0/2385799324 reap_dead start 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 shutdown_connections 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 >> 172.21.15.167:0/2385799324 conn(0x5600f35d65c0 msgr2=0x5600f367c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 shutdown_connections 2023-10-05T19:50:42.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/2385799324 wait complete. 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3720d40 msgr2=0x5600f3723120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3720d40 0x5600f3723120 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2af8030c00 msgr2=0x7f2af80330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2af8030c00 0x7f2af80330b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5600f36a6990 tx=0x7f2ba400e040 comp rx=0 tx=0).stop 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 msgr2=0x5600f36b9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b9670 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x5600f36adbf0 tx=0x7f2bac037000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 shutdown_connections 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5600f3720d40 0x5600f3723120 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2af8030c00 0x7f2af80330b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 --2- 172.21.15.167:0/146609647 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5600f36b3b70 0x5600f36b9670 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 >> 172.21.15.167:0/146609647 conn(0x5600f36aef30 msgr2=0x5600f36acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 shutdown_connections 2023-10-05T19:50:42.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.780+0000 7f2bb3c7be40 1 -- 172.21.15.167:0/146609647 wait complete. 2023-10-05T19:50:42.795 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2'] 2023-10-05T19:50:42.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2'] 2023-10-05T19:50:42.795 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2 2023-10-05T19:50:42.836 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:42.836 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:42.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.828+0000 7f86c561ee40 1 Processor -- start 2023-10-05T19:50:42.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.828+0000 7f86c561ee40 1 -- start start 2023-10-05T19:50:42.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.828+0000 7f86c561ee40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55b360ac1920 0x55b360ac1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.828+0000 7f86c561ee40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b360a0ebd0 con 0x55b360ac2230 2023-10-05T19:50:42.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.828+0000 7f86c561ee40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b3609cbee0 con 0x55b360ac1920 2023-10-05T19:50:42.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.828+0000 7f86c3153700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55b360ac1920 0x55b360ac1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.828+0000 7f86c2952700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55b360ac2230 0x55b360ac2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51856/0 (socket says 172.21.15.167:51856) 2023-10-05T19:50:42.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.828+0000 7f86c3153700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55b360ac1920 0x55b360ac1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46358/0 (socket says 172.21.15.167:46358) 2023-10-05T19:50:42.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.828+0000 7f86c2952700 1 -- 172.21.15.167:0/3099230467 learned_addr learned my addr 172.21.15.167:0/3099230467 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:42.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c3153700 1 -- 172.21.15.167:0/3099230467 >> v1:172.21.15.118:6789/0 conn(0x55b360ac2230 legacy=0x55b360ac2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c2151700 1 -- 172.21.15.167:0/3099230467 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857285214 0 0) 0x55b360a0ebd0 con 0x55b360ac2230 2023-10-05T19:50:42.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c3153700 1 -- 172.21.15.167:0/3099230467 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b360ac33e0 con 0x55b360ac1920 2023-10-05T19:50:42.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c3153700 1 --2- 172.21.15.167:0/3099230467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ac1cf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f86b400a5d0 tx=0x7f86b4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f455f2b09c22d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c2151700 1 -- 172.21.15.167:0/3099230467 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86b40086a0 con 0x55b360ac1920 2023-10-05T19:50:42.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c2151700 1 -- 172.21.15.167:0/3099230467 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4008800 con 0x55b360ac1920 2023-10-05T19:50:42.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c2151700 1 -- 172.21.15.167:0/3099230467 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86b4008ad0 con 0x55b360ac1920 2023-10-05T19:50:42.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 -- 172.21.15.167:0/3099230467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 msgr2=0x55b360ac1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 --2- 172.21.15.167:0/3099230467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ac1cf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f86b400a5d0 tx=0x7f86b4005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:42.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 -- 172.21.15.167:0/3099230467 shutdown_connections 2023-10-05T19:50:42.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 --2- 172.21.15.167:0/3099230467 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ac1cf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 -- 172.21.15.167:0/3099230467 >> 172.21.15.167:0/3099230467 conn(0x55b360abd340 msgr2=0x55b360abf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 -- 172.21.15.167:0/3099230467 shutdown_connections 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 -- 172.21.15.167:0/3099230467 wait complete. 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 Processor -- start 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 -- start start 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c561ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36098fe30 con 0x55b360ac1920 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c3153700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c3153700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46372/0 (socket says 172.21.15.167:46372) 2023-10-05T19:50:42.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c3153700 1 -- 172.21.15.167:0/2138300547 learned_addr learned my addr 172.21.15.167:0/2138300547 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.832+0000 7f86c3153700 1 -- 172.21.15.167:0/2138300547 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b4005cf0 con 0x55b360ac1920 2023-10-05T19:50:42.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c3153700 1 --2- 172.21.15.167:0/2138300547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae0810 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f86b4005a90 tx=0x7f86b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648d9e2108dc47ed server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c114f700 1 -- 172.21.15.167:0/2138300547 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86b4008a40 con 0x55b360ac1920 2023-10-05T19:50:42.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c114f700 1 -- 172.21.15.167:0/2138300547 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4008ba0 con 0x55b360ac1920 2023-10-05T19:50:42.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c114f700 1 -- 172.21.15.167:0/2138300547 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86b4008e70 con 0x55b360ac1920 2023-10-05T19:50:42.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 -- 172.21.15.167:0/2138300547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 msgr2=0x55b360ae0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 --2- 172.21.15.167:0/2138300547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae0810 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f86b4005a90 tx=0x7f86b4015000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 -- 172.21.15.167:0/2138300547 shutdown_connections 2023-10-05T19:50:42.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 --2- 172.21.15.167:0/2138300547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae0810 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 -- 172.21.15.167:0/2138300547 >> 172.21.15.167:0/2138300547 conn(0x55b360abd340 msgr2=0x55b360adc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 -- 172.21.15.167:0/2138300547 shutdown_connections 2023-10-05T19:50:42.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 -- 172.21.15.167:0/2138300547 wait complete. 2023-10-05T19:50:42.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 Processor -- start 2023-10-05T19:50:42.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 -- start start 2023-10-05T19:50:42.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c561ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b360962ed0 con 0x55b360ac1920 2023-10-05T19:50:42.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c3153700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c3153700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46378/0 (socket says 172.21.15.167:46378) 2023-10-05T19:50:42.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.836+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 learned_addr learned my addr 172.21.15.167:0/498471465 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b360ac33e0 con 0x55b360ac1920 2023-10-05T19:50:42.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86c3153700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae7470 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f86b4005a90 tx=0x7f86b4003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86bb7fe700 1 -- 172.21.15.167:0/498471465 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86b4012ba0 con 0x55b360ac1920 2023-10-05T19:50:42.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86bb7fe700 1 -- 172.21.15.167:0/498471465 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b402a070 con 0x55b360ac1920 2023-10-05T19:50:42.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b360ae79b0 con 0x55b360ac1920 2023-10-05T19:50:42.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86bb7fe700 1 -- 172.21.15.167:0/498471465 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86b4012e60 con 0x55b360ac1920 2023-10-05T19:50:42.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b360ae7e50 con 0x55b360ac1920 2023-10-05T19:50:42.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86bb7fe700 1 -- 172.21.15.167:0/498471465 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f86b4019070 con 0x55b360ac1920 2023-10-05T19:50:42.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86bb7fe700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86a4030c40 0x7f86a40330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86bb7fe700 1 -- 172.21.15.167:0/498471465 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f86b402c070 con 0x55b360ac1920 2023-10-05T19:50:42.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86c2952700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86a4030c40 0x7f86a40330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b360ac2230 0x55b360af2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af35a0 con 0x55b360ac2230 2023-10-05T19:50:42.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.840+0000 7f86c3954700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b360ac2230 0x55b360af2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c2952700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86a4030c40 0x7f86a40330f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0011e0 tx=0x7f86ac0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c3954700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b360ac2230 0x55b360af2e70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.851 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 20 realm 2023-10-05T19:50:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af0410 con 0x55b360ac2230 2023-10-05T19:50:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af4080 con 0x55b360ac2230 2023-10-05T19:50:42.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b360af3cb0 0x55b360af6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af7620 con 0x55b360af3cb0 2023-10-05T19:50:42.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c3153700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b360af3cb0 0x55b360af6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c3153700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b360af3cb0 0x55b360af6ef0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f86b4022020 con 0x55b360af3cb0 2023-10-05T19:50:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.844+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af7ef0 con 0x55b360ac2230 2023-10-05T19:50:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c561ee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c561ee40 20 searching for the correct realm 2023-10-05T19:50:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360af7a60 0x55b360afbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af7a60 2023-10-05T19:50:42.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c2952700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360af7a60 0x55b360afbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c2952700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360af7a60 0x55b360afbcc0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac006070 con 0x55b360af7a60 2023-10-05T19:50:42.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af3cb0 2023-10-05T19:50:42.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4022020 con 0x55b360af3cb0 2023-10-05T19:50:42.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c3153700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f86b4007030 0x7f86b4000ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x7f86b4007030 2023-10-05T19:50:42.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c3954700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f86b4007030 0x7f86b4000ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c3954700 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f86b4007030 0x7f86b4000ed0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.848+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af7a60 2023-10-05T19:50:42.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac006070 con 0x55b360af7a60 2023-10-05T19:50:42.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af3cb0 2023-10-05T19:50:42.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4022020 con 0x55b360af3cb0 2023-10-05T19:50:42.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.852+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af3cb0 2023-10-05T19:50:42.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4022020 con 0x55b360af3cb0 2023-10-05T19:50:42.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x7f86b4007030 2023-10-05T19:50:42.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x7f86b4007030 2023-10-05T19:50:42.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af3cb0 2023-10-05T19:50:42.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b404f040 con 0x55b360af3cb0 2023-10-05T19:50:42.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af7a60 2023-10-05T19:50:42.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac006070 con 0x55b360af7a60 2023-10-05T19:50:42.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.856+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af3cb0 2023-10-05T19:50:42.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b404f040 con 0x55b360af3cb0 2023-10-05T19:50:42.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af7a60 2023-10-05T19:50:42.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac006070 con 0x55b360af7a60 2023-10-05T19:50:42.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.860+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af7a60 2023-10-05T19:50:42.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac006070 con 0x55b360af7a60 2023-10-05T19:50:42.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x7f86b4007030 2023-10-05T19:50:42.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360ac2230 2023-10-05T19:50:42.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x7f86b4007030 2023-10-05T19:50:42.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af7a60 2023-10-05T19:50:42.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac006070 con 0x55b360af7a60 2023-10-05T19:50:42.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x7f86b4007030 2023-10-05T19:50:42.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af3cb0 2023-10-05T19:50:42.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b404f040 con 0x55b360af3cb0 2023-10-05T19:50:42.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.864+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af3cb0 2023-10-05T19:50:42.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b404f040 con 0x55b360af3cb0 2023-10-05T19:50:42.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af7a60 2023-10-05T19:50:42.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac006070 con 0x55b360af7a60 2023-10-05T19:50:42.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af3cb0 2023-10-05T19:50:42.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f86b404f040 con 0x55b360af3cb0 2023-10-05T19:50:42.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc2a0 con 0x55b360af3cb0 2023-10-05T19:50:42.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b404f040 con 0x55b360af3cb0 2023-10-05T19:50:42.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c561ee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c561ee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c561ee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c561ee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af8a30 con 0x55b360ac2230 2023-10-05T19:50:42.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.868+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af93b0 con 0x55b360af3cb0 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360af3cb0 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af8fa0 con 0x55b360af7a60 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f86ac006070 con 0x55b360af7a60 2023-10-05T19:50:42.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afc740 con 0x55b360ac2230 2023-10-05T19:50:42.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.872+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afd170 con 0x55b360af3cb0 2023-10-05T19:50:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c561ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afd140 con 0x55b360af7a60 2023-10-05T19:50:42.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afd140 con 0x55b360af3cb0 2023-10-05T19:50:42.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x7f86b4007030 2023-10-05T19:50:42.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360ac2230 2023-10-05T19:50:42.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.876+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360ac2230 2023-10-05T19:50:42.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360af7a60 2023-10-05T19:50:42.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360ac2230 2023-10-05T19:50:42.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360af3cb0 2023-10-05T19:50:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360af3cb0 2023-10-05T19:50:42.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360ac2230 2023-10-05T19:50:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x7f86b4007030 2023-10-05T19:50:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.880+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360ac2230 2023-10-05T19:50:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x7f86b4007030 2023-10-05T19:50:42.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360af3cb0 2023-10-05T19:50:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360af85f0 con 0x55b360af7a60 2023-10-05T19:50:42.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360ac2230 2023-10-05T19:50:42.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.884+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360af3cb0 2023-10-05T19:50:42.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360af7a60 2023-10-05T19:50:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360ac2230 2023-10-05T19:50:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360ac2230 2023-10-05T19:50:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360ac2230 2023-10-05T19:50:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360af7a60 2023-10-05T19:50:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x7f86b4007030 2023-10-05T19:50:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360ac2230 2023-10-05T19:50:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.888+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x7f86b4007030 2023-10-05T19:50:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360af7a60 2023-10-05T19:50:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x7f86b4007030 2023-10-05T19:50:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360af3cb0 2023-10-05T19:50:42.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360af3cb0 2023-10-05T19:50:42.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.892+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360af7a60 2023-10-05T19:50:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360af3cb0 2023-10-05T19:50:42.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f86ac028040 con 0x55b360af3cb0 2023-10-05T19:50:42.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f86b4059040 con 0x55b360af3cb0 2023-10-05T19:50:42.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c561ee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:42.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c561ee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:42.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c561ee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:42.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c561ee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:42.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afd140 con 0x55b360af3cb0 2023-10-05T19:50:42.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c561ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.896+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afd140 con 0x55b360ac2230 2023-10-05T19:50:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:42.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afda90 con 0x55b360af3cb0 2023-10-05T19:50:42.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:42.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afd5a0 con 0x55b360af3cb0 2023-10-05T19:50:42.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:42.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afd9a0 con 0x7f86b4007030 2023-10-05T19:50:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 zone default found 2023-10-05T19:50:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 4 Realm: () 2023-10-05T19:50:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:42.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 zonegroup default 2023-10-05T19:50:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afd9a0 con 0x7f86b4007030 2023-10-05T19:50:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.900+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afd9a0 con 0x55b360af7a60 2023-10-05T19:50:42.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.904+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.904+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.904+0000 7f86c561ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:42.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.904+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360afff80 con 0x55b360af7a60 2023-10-05T19:50:42.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.904+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.904+0000 7f86c561ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:42.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.904+0000 7f86c561ee40 20 started sync module instance, tier type = 2023-10-05T19:50:42.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.904+0000 7f86c561ee40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:42.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.904+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360aff460 con 0x55b360af3cb0 2023-10-05T19:50:42.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.908+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.908+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94228909652064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360aff460 con 0x55b360af3cb0 2023-10-05T19:50:42.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.908+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b00820 con 0x55b360ac2230 2023-10-05T19:50:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.908+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.908+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94228909652064] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.908+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94228909654832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360aff460 con 0x55b360ac2230 2023-10-05T19:50:42.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.908+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b00de0 con 0x55b360af3cb0 2023-10-05T19:50:42.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.912+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94228909654832] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.912+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.912+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94228909650064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b00de0 con 0x55b360af3cb0 2023-10-05T19:50:42.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.912+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b01680 con 0x7f86b4007030 2023-10-05T19:50:42.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.912+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.912+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94228909650064] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.912+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94228909656304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b01230 con 0x7f86b4007030 2023-10-05T19:50:42.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.912+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b01cd0 con 0x55b360af3cb0 2023-10-05T19:50:42.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.916+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94228909656304] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.916+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.916+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94228909657968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b01cd0 con 0x55b360af3cb0 2023-10-05T19:50:42.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.916+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b026e0 con 0x55b360af7a60 2023-10-05T19:50:42.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.916+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94228909657968] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.916+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.916+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94228909660128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b01c30 con 0x55b360af7a60 2023-10-05T19:50:42.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.916+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b034c0 con 0x55b360af7a60 2023-10-05T19:50:42.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94228909660128] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94228909665552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b03db0 con 0x55b360af7a60 2023-10-05T19:50:42.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b04650 con 0x7f86b4007030 2023-10-05T19:50:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94228909665552] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94228909669104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b04430 con 0x7f86b4007030 2023-10-05T19:50:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 20 add_watcher() i=0 2023-10-05T19:50:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 20 add_watcher() i=1 2023-10-05T19:50:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 20 add_watcher() i=2 2023-10-05T19:50:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 20 add_watcher() i=3 2023-10-05T19:50:42.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 20 add_watcher() i=4 2023-10-05T19:50:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 20 add_watcher() i=5 2023-10-05T19:50:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.920+0000 7f86c561ee40 20 add_watcher() i=6 2023-10-05T19:50:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94228909669104] v30'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 20 add_watcher() i=7 2023-10-05T19:50:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:42.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b07a80 con 0x55b360ac2230 2023-10-05T19:50:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94228909670672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b04ed0 con 0x55b360ac2230 2023-10-05T19:50:42.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94228909670672] v30'160 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f8694fe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:42.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 1 Processor -- start 2023-10-05T19:50:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 1 -- start start 2023-10-05T19:50:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b12160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.924+0000 7f86c561ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b360b126a0 con 0x55b360b11d90 2023-10-05T19:50:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c2952700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b12160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c2952700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b12160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46386/0 (socket says 172.21.15.167:46386) 2023-10-05T19:50:42.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c2952700 1 -- 172.21.15.167:0/1250426896 learned_addr learned my addr 172.21.15.167:0/1250426896 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c2952700 1 -- 172.21.15.167:0/1250426896 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b360b127e0 con 0x55b360b11d90 2023-10-05T19:50:42.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c2952700 1 --2- 172.21.15.167:0/1250426896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b12160 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f86ac000fb0 tx=0x7f86ac010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c54de019e58a69 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f860ffff700 1 -- 172.21.15.167:0/1250426896 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86ac03b070 con 0x55b360b11d90 2023-10-05T19:50:42.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f860ffff700 1 -- 172.21.15.167:0/1250426896 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac022040 con 0x55b360b11d90 2023-10-05T19:50:42.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f860ffff700 1 -- 172.21.15.167:0/1250426896 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86ac021040 con 0x55b360b11d90 2023-10-05T19:50:42.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 -- 172.21.15.167:0/1250426896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 msgr2=0x55b360b12160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 --2- 172.21.15.167:0/1250426896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b12160 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f86ac000fb0 tx=0x7f86ac010000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 -- 172.21.15.167:0/1250426896 shutdown_connections 2023-10-05T19:50:42.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 --2- 172.21.15.167:0/1250426896 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b12160 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 -- 172.21.15.167:0/1250426896 >> 172.21.15.167:0/1250426896 conn(0x55b360b0d150 msgr2=0x55b360b0b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 -- 172.21.15.167:0/1250426896 shutdown_connections 2023-10-05T19:50:42.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 -- 172.21.15.167:0/1250426896 wait complete. 2023-10-05T19:50:42.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 Processor -- start 2023-10-05T19:50:42.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 -- start start 2023-10-05T19:50:42.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b178a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c561ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b360b188a0 con 0x55b360b11d90 2023-10-05T19:50:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c2952700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c2952700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b178a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46388/0 (socket says 172.21.15.167:46388) 2023-10-05T19:50:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.928+0000 7f86c2952700 1 -- 172.21.15.167:0/2361766813 learned_addr learned my addr 172.21.15.167:0/2361766813 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:42.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f86c2952700 1 -- 172.21.15.167:0/2361766813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac00eaf0 con 0x55b360b11d90 2023-10-05T19:50:42.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f86c2952700 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b178a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f86b4032b80 tx=0x7f86ac037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f860e7fc700 1 -- 172.21.15.167:0/2361766813 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86ac021070 con 0x55b360b11d90 2023-10-05T19:50:42.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f860e7fc700 1 -- 172.21.15.167:0/2361766813 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac036e70 con 0x55b360b11d90 2023-10-05T19:50:42.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b360b17ea0 con 0x55b360b11d90 2023-10-05T19:50:42.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f860e7fc700 1 -- 172.21.15.167:0/2361766813 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f86ac046070 con 0x55b360b11d90 2023-10-05T19:50:42.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b360b18340 con 0x55b360b11d90 2023-10-05T19:50:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f860e7fc700 1 -- 172.21.15.167:0/2361766813 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f86ac03e020 con 0x55b360b11d90 2023-10-05T19:50:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f860e7fc700 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8604030c50 0x7f8604033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f860e7fc700 1 -- 172.21.15.167:0/2361766813 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f86ac02e040 con 0x55b360b11d90 2023-10-05T19:50:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f86c3954700 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8604030c50 0x7f8604033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.932+0000 7f86c561ee40 5 note: GC not initialized 2023-10-05T19:50:42.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86c3954700 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8604030c50 0x7f8604033100 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55b360b046b0 tx=0x7f86bc00d5f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86037fe700 20 reqs_thread_entry: start 2023-10-05T19:50:42.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86017fa700 20 reqs_thread_entry: start 2023-10-05T19:50:42.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86c561ee40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:42.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86c561ee40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:42.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f85ef7fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:13 2023 2023-10-05T19:50:42.945 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:42.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86c561ee40 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T19:50:42.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f85eeffd700 20 reqs_thread_entry: start 2023-10-05T19:50:42.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86c561ee40 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360b7eff0 0x55b360b813d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:42.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:1 6.1b 6:de9123b8:::2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b81910 con 0x55b360b7eff0 2023-10-05T19:50:42.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86c3153700 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360b7eff0 0x55b360b813d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:42.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86c3153700 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360b7eff0 0x55b360b813d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:42.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.936+0000 7f86c3153700 1 -- 172.21.15.167:0/2361766813 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(1 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2 [read 0~850 out=850b] v0'0 uv11 ondisk = 0) v8 ==== 208+0+850 (crc 0 0 0) 0x7f86b4064040 con 0x55b360b7eff0 2023-10-05T19:50:42.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.940+0000 7f86c561ee40 10 read 850 2023-10-05T19:50:42.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.940+0000 7f86c561ee40 10 log_show_next pos 850 bl 850 off 419 eof 1 2023-10-05T19:50:42.947 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:42.947 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2", 2023-10-05T19:50:42.947 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_owner": "foo", 2023-10-05T19:50:42.947 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:50:42.947 INFO:teuthology.orchestra.run.smithi167.stdout: "log_entries": [ 2023-10-05T19:50:42.947 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.947 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:50:42.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:37.077017Z", 2023-10-05T19:50:42.947 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:37.077017+0000", 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "create_bucket", 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "PUT /myfoo2/ HTTP/1.1", 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:42.948 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 15, 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx00000e1f0a5ca746a0447-00651f138d-1085-default", 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:37.173014Z", 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:37.173014+0000", 2023-10-05T19:50:42.949 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "delete_bucket", 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "DELETE /myfoo2/ HTTP/1.1", 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "204", 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "NoContent", 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 75, 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:42.950 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx0000096a9ebdf80d3f330-00651f138d-1085-default", 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: "log_sum": { 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 90, 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: "total_entries": 2 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:42.951 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:42.952 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:42.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.940+0000 7f86c561ee40 10 log_show_next pos 850 bl 850 off 850 eof 1 2023-10-05T19:50:42.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.940+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94228909652064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b3e620 con 0x55b360af3cb0 2023-10-05T19:50:42.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.940+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94228909652064] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.940+0000 7f86c561ee40 20 remove_watcher() i=0 2023-10-05T19:50:42.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.940+0000 7f86c561ee40 2 removed watcher, disabling cache 2023-10-05T19:50:42.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.940+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94228909654832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360aff860 con 0x55b360ac2230 2023-10-05T19:50:42.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.944+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94228909654832] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.944+0000 7f86c561ee40 20 remove_watcher() i=1 2023-10-05T19:50:42.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.944+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94228909650064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b00330 con 0x55b360af3cb0 2023-10-05T19:50:42.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.944+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94228909650064] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.944+0000 7f86c561ee40 20 remove_watcher() i=2 2023-10-05T19:50:42.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.944+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94228909656304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b00330 con 0x7f86b4007030 2023-10-05T19:50:42.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.948+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94228909656304] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.948+0000 7f86c561ee40 20 remove_watcher() i=3 2023-10-05T19:50:42.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.948+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94228909657968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b008f0 con 0x55b360af3cb0 2023-10-05T19:50:42.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.948+0000 7f86c3153700 1 -- 172.21.15.167:0/498471465 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94228909657968] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86b4064040 con 0x55b360af3cb0 2023-10-05T19:50:42.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.948+0000 7f86c561ee40 20 remove_watcher() i=4 2023-10-05T19:50:42.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.948+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94228909660128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b00330 con 0x55b360af7a60 2023-10-05T19:50:42.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.952+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94228909660128] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.952+0000 7f86c561ee40 20 remove_watcher() i=5 2023-10-05T19:50:42.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.952+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94228909665552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b00f70 con 0x55b360af7a60 2023-10-05T19:50:42.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.952+0000 7f86c2952700 1 -- 172.21.15.167:0/498471465 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94228909665552] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86ac024040 con 0x55b360af7a60 2023-10-05T19:50:42.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.952+0000 7f86c561ee40 20 remove_watcher() i=6 2023-10-05T19:50:42.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.952+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94228909669104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b008f0 con 0x7f86b4007030 2023-10-05T19:50:42.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.956+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94228909669104] v30'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x7f86b4007030 2023-10-05T19:50:42.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.956+0000 7f86c561ee40 20 remove_watcher() i=7 2023-10-05T19:50:42.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.956+0000 7f8694fe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:42.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.956+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94228909670672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b360b017e0 con 0x55b360ac2230 2023-10-05T19:50:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94228909670672] v30'161 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f86bc00a5a0 con 0x55b360ac2230 2023-10-05T19:50:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b360af3cb0 msgr2=0x55b360af6ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b360af3cb0 0x55b360af6ef0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b360ac2230 msgr2=0x55b360af2e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b360ac2230 0x55b360af2e70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f86b4007030 msgr2=0x7f86b4000ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f86b4007030 0x7f86b4000ed0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360af7a60 msgr2=0x55b360afbcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360af7a60 0x55b360afbcc0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86a4030c40 msgr2=0x7f86a40330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f86a4030c40 0x7f86a40330f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0011e0 tx=0x7f86ac0013a0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c3954700 1 -- 172.21.15.167:0/498471465 reap_dead start 2023-10-05T19:50:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 msgr2=0x55b360ae7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae7470 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f86b4005a90 tx=0x7f86b4003050 comp rx=0 tx=0).stop 2023-10-05T19:50:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 shutdown_connections 2023-10-05T19:50:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/498471465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360ac1920 0x55b360ae7470 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 >> 172.21.15.167:0/498471465 conn(0x55b360abd340 msgr2=0x55b360adae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 shutdown_connections 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/498471465 wait complete. 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360b7eff0 msgr2=0x55b360b813d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360b7eff0 0x55b360b813d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8604030c50 msgr2=0x7f8604033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8604030c50 0x7f8604033100 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55b360b046b0 tx=0x7f86bc00d5f0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 msgr2=0x55b360b178a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b178a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f86b4032b80 tx=0x7f86ac037000 comp rx=0 tx=0).stop 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 shutdown_connections 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b360b7eff0 0x55b360b813d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8604030c50 0x7f8604033100 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 --2- 172.21.15.167:0/2361766813 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b360b11d90 0x55b360b178a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 >> 172.21.15.167:0/2361766813 conn(0x55b360b0d150 msgr2=0x55b360b0b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 shutdown_connections 2023-10-05T19:50:42.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:42.960+0000 7f86c561ee40 1 -- 172.21.15.167:0/2361766813 wait complete. 2023-10-05T19:50:42.975 DEBUG:tasks.util.rgw: json result: {'bucket_id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2', 'bucket_owner': 'foo', 'bucket': 'myfoo2', 'log_entries': [{'bucket': 'myfoo2', 'time': '2023-10-05T19:50:37.077017Z', 'time_local': '2023-10-05T19:50:37.077017+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'create_bucket', 'uri': 'PUT /myfoo2/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 15, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000e1f0a5ca746a0447-00651f138d-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo2', 'time': '2023-10-05T19:50:37.173014Z', 'time_local': '2023-10-05T19:50:37.173014+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_bucket', 'uri': 'DELETE /myfoo2/ HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 75, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx0000096a9ebdf80d3f330-00651f138d-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 0, 'bytes_received': 0, 'total_time': 90, 'total_entries': 2}} 2023-10-05T19:50:42.975 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.975 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:42.975 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2'] 2023-10-05T19:50:42.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2'] 2023-10-05T19:50:42.975 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2 2023-10-05T19:50:43.014 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:43.014 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:43.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 Processor -- start 2023-10-05T19:50:43.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 -- start start 2023-10-05T19:50:43.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559b35f46b50 0x559b35f46f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559b35e91bd0 con 0x559b35f47460 2023-10-05T19:50:43.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x559b35e4eee0 con 0x559b35f46b50 2023-10-05T19:50:43.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f947699a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559b35f46b50 0x559b35f46f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9476199700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x559b35f47460 0x559b35f47ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51858/0 (socket says 172.21.15.167:51858) 2023-10-05T19:50:43.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9476199700 1 -- 172.21.15.167:0/489467215 learned_addr learned my addr 172.21.15.167:0/489467215 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:43.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9475998700 1 -- 172.21.15.167:0/489467215 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143748880 0 0) 0x559b35e91bd0 con 0x559b35f47460 2023-10-05T19:50:43.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9475998700 1 -- 172.21.15.167:0/489467215 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9464001e10 con 0x559b35f47460 2023-10-05T19:50:43.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f947699a700 1 -- 172.21.15.167:0/489467215 >> v1:172.21.15.118:6789/0 conn(0x559b35f47460 legacy=0x559b35f47ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f947699a700 1 -- 172.21.15.167:0/489467215 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b35f48600 con 0x559b35f46b50 2023-10-05T19:50:43.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f947699a700 1 --2- 172.21.15.167:0/489467215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 0x559b35f46f20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f946000a5d0 tx=0x7f9460005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c696bcfb8a4aaf64 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9475998700 1 -- 172.21.15.167:0/489467215 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9460007610 con 0x559b35f46b50 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9475998700 1 -- 172.21.15.167:0/489467215 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9460007770 con 0x559b35f46b50 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9475998700 1 -- 172.21.15.167:0/489467215 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9460007a20 con 0x559b35f46b50 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 -- 172.21.15.167:0/489467215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 msgr2=0x559b35f46f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 --2- 172.21.15.167:0/489467215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 0x559b35f46f20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f946000a5d0 tx=0x7f9460005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 -- 172.21.15.167:0/489467215 shutdown_connections 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 --2- 172.21.15.167:0/489467215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 0x559b35f46f20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 -- 172.21.15.167:0/489467215 >> 172.21.15.167:0/489467215 conn(0x559b35eba5c0 msgr2=0x559b35eba9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 -- 172.21.15.167:0/489467215 shutdown_connections 2023-10-05T19:50:43.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.008+0000 7f9478e65e40 1 -- 172.21.15.167:0/489467215 wait complete. 2023-10-05T19:50:43.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 Processor -- start 2023-10-05T19:50:43.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 -- start start 2023-10-05T19:50:43.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 0x559b35f65a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b35e12e30 con 0x559b35f46b50 2023-10-05T19:50:43.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f947699a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 0x559b35f65a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f947699a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 0x559b35f65a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46418/0 (socket says 172.21.15.167:46418) 2023-10-05T19:50:43.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f947699a700 1 -- 172.21.15.167:0/2443680452 learned_addr learned my addr 172.21.15.167:0/2443680452 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f947699a700 1 -- 172.21.15.167:0/2443680452 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460005cf0 con 0x559b35f46b50 2023-10-05T19:50:43.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f947699a700 1 --2- 172.21.15.167:0/2443680452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 0x559b35f65a60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9460005cc0 tx=0x7f9460014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bd58408ae4df2c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9474996700 1 -- 172.21.15.167:0/2443680452 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9460007a30 con 0x559b35f46b50 2023-10-05T19:50:43.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9474996700 1 -- 172.21.15.167:0/2443680452 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9460007b90 con 0x559b35f46b50 2023-10-05T19:50:43.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9474996700 1 -- 172.21.15.167:0/2443680452 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9460007e80 con 0x559b35f46b50 2023-10-05T19:50:43.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 -- 172.21.15.167:0/2443680452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 msgr2=0x559b35f65a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 --2- 172.21.15.167:0/2443680452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 0x559b35f65a60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9460005cc0 tx=0x7f9460014000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 -- 172.21.15.167:0/2443680452 shutdown_connections 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 --2- 172.21.15.167:0/2443680452 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f46b50 0x559b35f65a60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 -- 172.21.15.167:0/2443680452 >> 172.21.15.167:0/2443680452 conn(0x559b35eba5c0 msgr2=0x559b35f61620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 -- 172.21.15.167:0/2443680452 shutdown_connections 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 -- 172.21.15.167:0/2443680452 wait complete. 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 Processor -- start 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 -- start start 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f47460 0x559b35f6c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.012+0000 7f9478e65e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b35de5ed0 con 0x559b35f47460 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f947699a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f47460 0x559b35f6c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f947699a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f47460 0x559b35f6c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46424/0 (socket says 172.21.15.167:46424) 2023-10-05T19:50:43.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 learned_addr learned my addr 172.21.15.167:0/4168447438 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b35f48600 con 0x559b35f47460 2023-10-05T19:50:43.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f947699a700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f47460 0x559b35f6c7d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f946000afd0 tx=0x7f946001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f946effd700 1 -- 172.21.15.167:0/4168447438 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f946001dc10 con 0x559b35f47460 2023-10-05T19:50:43.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f946effd700 1 -- 172.21.15.167:0/4168447438 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946001dd90 con 0x559b35f47460 2023-10-05T19:50:43.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f946effd700 1 -- 172.21.15.167:0/4168447438 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9460012580 con 0x559b35f47460 2023-10-05T19:50:43.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559b35f6cd10 con 0x559b35f47460 2023-10-05T19:50:43.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b35f6d1b0 con 0x559b35f47460 2023-10-05T19:50:43.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f946effd700 1 -- 172.21.15.167:0/4168447438 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f946002d070 con 0x559b35f47460 2023-10-05T19:50:43.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f946effd700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9458030c00 0x7f94580330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f946effd700 1 -- 172.21.15.167:0/4168447438 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f9460045ca0 con 0x559b35f47460 2023-10-05T19:50:43.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.016+0000 7f9476199700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9458030c00 0x7f94580330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b35f76210 0x559b35f78620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f78d50 con 0x559b35f76210 2023-10-05T19:50:43.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f947719b700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b35f76210 0x559b35f78620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9476199700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9458030c00 0x7f94580330b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f94700044f0 tx=0x7f9470006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f947719b700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b35f76210 0x559b35f78620 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f946800a500 con 0x559b35f76210 2023-10-05T19:50:43.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 20 realm 2023-10-05T19:50:43.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f757f0 con 0x559b35f76210 2023-10-05T19:50:43.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f946800a500 con 0x559b35f76210 2023-10-05T19:50:43.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:43.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f79830 con 0x559b35f76210 2023-10-05T19:50:43.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f946800a500 con 0x559b35f76210 2023-10-05T19:50:43.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b35f7a660 0x559b35f7ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f7cf80 con 0x559b35f7a660 2023-10-05T19:50:43.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f947699a700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b35f7a660 0x559b35f7ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.020+0000 7f947699a700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b35f7a660 0x559b35f7ca40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9478e65e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f7d820 con 0x559b35f76210 2023-10-05T19:50:43.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f946800a500 con 0x559b35f76210 2023-10-05T19:50:43.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9478e65e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9478e65e40 20 searching for the correct realm 2023-10-05T19:50:43.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b35f7f5e0 0x559b35f819c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7f5e0 2023-10-05T19:50:43.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9476199700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b35f7f5e0 0x559b35f819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9476199700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b35f7f5e0 0x559b35f819c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9470004520 con 0x559b35f7f5e0 2023-10-05T19:50:43.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7a660 2023-10-05T19:50:43.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f947699a700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9460038040 0x7f94600275e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x7f9460038040 2023-10-05T19:50:43.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f947719b700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9460038040 0x7f94600275e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f947719b700 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9460038040 0x7f94600275e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x7f9460038040 2023-10-05T19:50:43.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.024+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7f5e0 2023-10-05T19:50:43.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9470004520 con 0x559b35f7f5e0 2023-10-05T19:50:43.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7a660 2023-10-05T19:50:43.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7a660 2023-10-05T19:50:43.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.028+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x7f9460038040 2023-10-05T19:50:43.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x7f9460038040 2023-10-05T19:50:43.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x7f9460038040 2023-10-05T19:50:43.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x7f9460038040 2023-10-05T19:50:43.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7a660 2023-10-05T19:50:43.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7f5e0 2023-10-05T19:50:43.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9470004520 con 0x559b35f7f5e0 2023-10-05T19:50:43.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7a660 2023-10-05T19:50:43.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.032+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7f5e0 2023-10-05T19:50:43.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7f5e0 2023-10-05T19:50:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x7f9460038040 2023-10-05T19:50:43.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x7f9460038040 2023-10-05T19:50:43.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f76210 2023-10-05T19:50:43.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.036+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x7f9460038040 2023-10-05T19:50:43.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x7f9460038040 2023-10-05T19:50:43.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7f5e0 2023-10-05T19:50:43.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x7f9460038040 2023-10-05T19:50:43.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x7f9460038040 2023-10-05T19:50:43.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7a660 2023-10-05T19:50:43.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7a660 2023-10-05T19:50:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7f5e0 2023-10-05T19:50:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.040+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7a660 2023-10-05T19:50:43.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f81f00 con 0x559b35f7a660 2023-10-05T19:50:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f7e390 con 0x559b35f76210 2023-10-05T19:50:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f7ece0 con 0x559b35f7a660 2023-10-05T19:50:43.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f822b0 con 0x559b35f7a660 2023-10-05T19:50:43.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.044+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82660 con 0x559b35f7f5e0 2023-10-05T19:50:43.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f7e880 con 0x559b35f7a660 2023-10-05T19:50:43.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9478e65e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f84310 con 0x559b35f7f5e0 2023-10-05T19:50:43.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f84310 con 0x559b35f7a660 2023-10-05T19:50:43.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f84310 con 0x7f9460038040 2023-10-05T19:50:43.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x7f9460038040 2023-10-05T19:50:43.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.048+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7f5e0 2023-10-05T19:50:43.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7a660 2023-10-05T19:50:43.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7a660 2023-10-05T19:50:43.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.052+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x7f9460038040 2023-10-05T19:50:43.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x7f9460038040 2023-10-05T19:50:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x7f9460038040 2023-10-05T19:50:43.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x7f9460038040 2023-10-05T19:50:43.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7a660 2023-10-05T19:50:43.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7f5e0 2023-10-05T19:50:43.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.056+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7a660 2023-10-05T19:50:43.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7f5e0 2023-10-05T19:50:43.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468014040 con 0x559b35f76210 2023-10-05T19:50:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7f5e0 2023-10-05T19:50:43.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.060+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x7f9460038040 2023-10-05T19:50:43.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f76210 2023-10-05T19:50:43.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x7f9460038040 2023-10-05T19:50:43.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7f5e0 2023-10-05T19:50:43.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x7f9460038040 2023-10-05T19:50:43.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7a660 2023-10-05T19:50:43.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.064+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7a660 2023-10-05T19:50:43.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7f5e0 2023-10-05T19:50:43.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7a660 2023-10-05T19:50:43.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f82a10 con 0x559b35f7a660 2023-10-05T19:50:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f9478e65e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f9478e65e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f9478e65e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f9478e65e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f83300 con 0x559b35f7a660 2023-10-05T19:50:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.068+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f83300 con 0x559b35f76210 2023-10-05T19:50:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f83ba0 con 0x559b35f7a660 2023-10-05T19:50:43.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f83ba0 con 0x559b35f7a660 2023-10-05T19:50:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f83ba0 con 0x7f9460038040 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 zone default found 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 4 Realm: () 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 zonegroup default 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.072+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f83ba0 con 0x7f9460038040 2023-10-05T19:50:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f85520 con 0x559b35f7f5e0 2023-10-05T19:50:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f858d0 con 0x559b35f7f5e0 2023-10-05T19:50:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 20 started sync module instance, tier type = 2023-10-05T19:50:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:43.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.076+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f84c30 con 0x559b35f7a660 2023-10-05T19:50:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.080+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.080+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94125113755456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f85150 con 0x559b35f7a660 2023-10-05T19:50:43.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.080+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f866b0 con 0x559b35f76210 2023-10-05T19:50:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.080+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.080+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94125113755456] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.080+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94125113762240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f85150 con 0x559b35f76210 2023-10-05T19:50:43.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.080+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f85cd0 con 0x559b35f7a660 2023-10-05T19:50:43.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.084+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94125113762240] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.084+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.084+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94125113763344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f86cd0 con 0x559b35f7a660 2023-10-05T19:50:43.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.084+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f87570 con 0x7f9460038040 2023-10-05T19:50:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.084+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.084+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94125113765360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f877b0 con 0x7f9460038040 2023-10-05T19:50:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.084+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f88370 con 0x559b35f7a660 2023-10-05T19:50:43.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.084+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94125113763344] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.088+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.088+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94125113765360] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.088+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94125113760976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f87e40 con 0x559b35f7a660 2023-10-05T19:50:43.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.088+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f88c60 con 0x559b35f7f5e0 2023-10-05T19:50:43.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.088+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94125113760976] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.088+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.088+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94125113771888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f87e40 con 0x559b35f7f5e0 2023-10-05T19:50:43.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.088+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f89670 con 0x559b35f7f5e0 2023-10-05T19:50:43.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94125113776672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f8a360 con 0x559b35f7f5e0 2023-10-05T19:50:43.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f8ad70 con 0x7f9460038040 2023-10-05T19:50:43.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94125113771888] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94125113780352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f8b1c0 con 0x7f9460038040 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 20 add_watcher() i=0 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 20 add_watcher() i=1 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 20 add_watcher() i=2 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 20 add_watcher() i=3 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 20 add_watcher() i=4 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 20 add_watcher() i=5 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94125113776672] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 20 add_watcher() i=6 2023-10-05T19:50:43.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94125113780352] v30'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 20 add_watcher() i=7 2023-10-05T19:50:43.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:43.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.092+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f8dd00 con 0x559b35f76210 2023-10-05T19:50:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94125113777776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f8b260 con 0x559b35f76210 2023-10-05T19:50:43.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94125113777776] v30'162 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f93c3fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f9478e65e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:43.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f9478e65e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f9478e65e40 1 Processor -- start 2023-10-05T19:50:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f9478e65e40 1 -- start start 2023-10-05T19:50:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f9478e65e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f98910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f9478e65e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b35f98e50 con 0x559b35f98540 2023-10-05T19:50:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.096+0000 7f9476199700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f98910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9476199700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f98910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46440/0 (socket says 172.21.15.167:46440) 2023-10-05T19:50:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9476199700 1 -- 172.21.15.167:0/282162718 learned_addr learned my addr 172.21.15.167:0/282162718 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9476199700 1 -- 172.21.15.167:0/282162718 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b35f98f90 con 0x559b35f98540 2023-10-05T19:50:43.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9476199700 1 --2- 172.21.15.167:0/282162718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f98910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x559b35f793d0 tx=0x7f9470006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8daa2aad87097b82 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f93c37fe700 1 -- 172.21.15.167:0/282162718 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f947001a040 con 0x559b35f98540 2023-10-05T19:50:43.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f93c37fe700 1 -- 172.21.15.167:0/282162718 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947001b040 con 0x559b35f98540 2023-10-05T19:50:43.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f93c37fe700 1 -- 172.21.15.167:0/282162718 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9470004990 con 0x559b35f98540 2023-10-05T19:50:43.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 -- 172.21.15.167:0/282162718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 msgr2=0x559b35f98910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 --2- 172.21.15.167:0/282162718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f98910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x559b35f793d0 tx=0x7f9470006000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 -- 172.21.15.167:0/282162718 shutdown_connections 2023-10-05T19:50:43.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 --2- 172.21.15.167:0/282162718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f98910 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 -- 172.21.15.167:0/282162718 >> 172.21.15.167:0/282162718 conn(0x559b35f93900 msgr2=0x559b35f91a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 -- 172.21.15.167:0/282162718 shutdown_connections 2023-10-05T19:50:43.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 -- 172.21.15.167:0/282162718 wait complete. 2023-10-05T19:50:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 Processor -- start 2023-10-05T19:50:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 -- start start 2023-10-05T19:50:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f9e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9478e65e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b35f9f090 con 0x559b35f98540 2023-10-05T19:50:43.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9476199700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f9e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9476199700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f9e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46442/0 (socket says 172.21.15.167:46442) 2023-10-05T19:50:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.100+0000 7f9476199700 1 -- 172.21.15.167:0/4010085970 learned_addr learned my addr 172.21.15.167:0/4010085970 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f9476199700 1 -- 172.21.15.167:0/4010085970 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9464001e10 con 0x559b35f98540 2023-10-05T19:50:43.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f9476199700 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f9e090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x559b35f925c0 tx=0x7f9470030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f93c1ffb700 1 -- 172.21.15.167:0/4010085970 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f947001a070 con 0x559b35f98540 2023-10-05T19:50:43.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f93c1ffb700 1 -- 172.21.15.167:0/4010085970 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9470004260 con 0x559b35f98540 2023-10-05T19:50:43.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559b35f9e690 con 0x559b35f98540 2023-10-05T19:50:43.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f93c1ffb700 1 -- 172.21.15.167:0/4010085970 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f947002c940 con 0x559b35f98540 2023-10-05T19:50:43.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b35f9ead0 con 0x559b35f98540 2023-10-05T19:50:43.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f93c1ffb700 1 -- 172.21.15.167:0/4010085970 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f947002caa0 con 0x559b35f98540 2023-10-05T19:50:43.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f93c1ffb700 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93b4030c00 0x7f93b40330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f93c1ffb700 1 -- 172.21.15.167:0/4010085970 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f9470027040 con 0x559b35f98540 2023-10-05T19:50:43.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f947719b700 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93b4030c00 0x7f93b40330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f9478e65e40 5 note: GC not initialized 2023-10-05T19:50:43.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.104+0000 7f947719b700 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93b4030c00 0x7f93b40330b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x559b35f8b1c0 tx=0x7f946800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f93baffd700 20 reqs_thread_entry: start 2023-10-05T19:50:43.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f93b8ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f9478e65e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:43.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f9478e65e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:43.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f93aeffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:13 2023 2023-10-05T19:50:43.117 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:43.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f93ae7fc700 20 reqs_thread_entry: start 2023-10-05T19:50:43.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b36005700 0x559b36007ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:1 6.1b 6:de9123b8:::2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b36008020 con 0x559b36005700 2023-10-05T19:50:43.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f947699a700 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b36005700 0x559b36007ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.108+0000 7f947699a700 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b36005700 0x559b36007ae0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.112+0000 7f947699a700 1 -- 172.21.15.167:0/4010085970 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(1 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.2-myfoo2 [delete] v30'16 uv16 ondisk = 0) v8 ==== 208+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b36005700 2023-10-05T19:50:43.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.112+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94125113755456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35fc4840 con 0x559b35f7a660 2023-10-05T19:50:43.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.112+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94125113755456] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.112+0000 7f9478e65e40 20 remove_watcher() i=0 2023-10-05T19:50:43.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.112+0000 7f9478e65e40 2 removed watcher, disabling cache 2023-10-05T19:50:43.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.112+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94125113762240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f84740 con 0x559b35f76210 2023-10-05T19:50:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.116+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94125113762240] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.116+0000 7f9478e65e40 20 remove_watcher() i=1 2023-10-05T19:50:43.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.116+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94125113763344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f84740 con 0x559b35f7a660 2023-10-05T19:50:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.116+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94125113763344] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.116+0000 7f9478e65e40 20 remove_watcher() i=2 2023-10-05T19:50:43.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.116+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94125113765360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f84740 con 0x7f9460038040 2023-10-05T19:50:43.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.120+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94125113765360] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.120+0000 7f9478e65e40 20 remove_watcher() i=3 2023-10-05T19:50:43.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.120+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94125113760976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f84740 con 0x559b35f7a660 2023-10-05T19:50:43.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.120+0000 7f947699a700 1 -- 172.21.15.167:0/4168447438 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94125113760976] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f946002c030 con 0x559b35f7a660 2023-10-05T19:50:43.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.120+0000 7f9478e65e40 20 remove_watcher() i=4 2023-10-05T19:50:43.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.120+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94125113771888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f85cd0 con 0x559b35f7f5e0 2023-10-05T19:50:43.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.124+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94125113771888] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.124+0000 7f9478e65e40 20 remove_watcher() i=5 2023-10-05T19:50:43.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.124+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94125113776672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f84740 con 0x559b35f7f5e0 2023-10-05T19:50:43.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.124+0000 7f9476199700 1 -- 172.21.15.167:0/4168447438 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94125113776672] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f947001d040 con 0x559b35f7f5e0 2023-10-05T19:50:43.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.124+0000 7f9478e65e40 20 remove_watcher() i=6 2023-10-05T19:50:43.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.124+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94125113780352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35f85cd0 con 0x7f9460038040 2023-10-05T19:50:43.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.128+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94125113780352] v30'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9468033040 con 0x7f9460038040 2023-10-05T19:50:43.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.128+0000 7f9478e65e40 20 remove_watcher() i=7 2023-10-05T19:50:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.128+0000 7f93c3fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.128+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94125113777776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559b35fc74b0 con 0x559b35f76210 2023-10-05T19:50:43.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94125113777776] v30'163 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9468033040 con 0x559b35f76210 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b35f7a660 msgr2=0x559b35f7ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559b35f7a660 0x559b35f7ca40 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b35f76210 msgr2=0x559b35f78620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559b35f76210 0x559b35f78620 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9460038040 msgr2=0x7f94600275e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9460038040 0x7f94600275e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b35f7f5e0 msgr2=0x559b35f819c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b35f7f5e0 0x559b35f819c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9458030c00 msgr2=0x7f94580330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9458030c00 0x7f94580330b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f94700044f0 tx=0x7f9470006690 comp rx=0 tx=0).stop 2023-10-05T19:50:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f947719b700 1 -- 172.21.15.167:0/4168447438 reap_dead start 2023-10-05T19:50:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f47460 msgr2=0x559b35f6c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f47460 0x559b35f6c7d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f946000afd0 tx=0x7f946001c000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 shutdown_connections 2023-10-05T19:50:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4168447438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f47460 0x559b35f6c7d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 >> 172.21.15.167:0/4168447438 conn(0x559b35eba5c0 msgr2=0x559b35f600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 shutdown_connections 2023-10-05T19:50:43.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4168447438 wait complete. 2023-10-05T19:50:43.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b36005700 msgr2=0x559b36007ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b36005700 0x559b36007ae0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93b4030c00 msgr2=0x7f93b40330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93b4030c00 0x7f93b40330b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x559b35f8b1c0 tx=0x7f946800e040 comp rx=0 tx=0).stop 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 msgr2=0x559b35f9e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f9e090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x559b35f925c0 tx=0x7f9470030000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 shutdown_connections 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559b36005700 0x559b36007ae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f93b4030c00 0x7f93b40330b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 --2- 172.21.15.167:0/4010085970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559b35f98540 0x559b35f9e090 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 >> 172.21.15.167:0/4010085970 conn(0x559b35f93900 msgr2=0x559b35f919a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 shutdown_connections 2023-10-05T19:50:43.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.132+0000 7f9478e65e40 1 -- 172.21.15.167:0/4010085970 wait complete. 2023-10-05T19:50:43.147 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'show', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3'] 2023-10-05T19:50:43.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'show', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3'] 2023-10-05T19:50:43.147 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log show --object 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3 2023-10-05T19:50:43.187 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d672ee40 1 Processor -- start 2023-10-05T19:50:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d672ee40 1 -- start start 2023-10-05T19:50:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d672ee40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c6f2d18ad0 0x55c6f2daca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d672ee40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c6f2cf0bd0 con 0x55c6f2d19de0 2023-10-05T19:50:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d672ee40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c6f2cadee0 con 0x55c6f2d18ad0 2023-10-05T19:50:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d4263700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55c6f2d19de0 0x55c6f2d183c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51872/0 (socket says 172.21.15.167:51872) 2023-10-05T19:50:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d4263700 1 -- 172.21.15.167:0/2362013930 learned_addr learned my addr 172.21.15.167:0/2362013930 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d3a62700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c6f2d18ad0 0x55c6f2daca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d3a62700 1 -- 172.21.15.167:0/2362013930 >> v1:172.21.15.118:6789/0 conn(0x55c6f2d19de0 legacy=0x55c6f2d183c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.180+0000 7fa2d3a62700 1 -- 172.21.15.167:0/2362013930 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f2d1a270 con 0x55c6f2d18ad0 2023-10-05T19:50:43.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d3a62700 1 --2- 172.21.15.167:0/2362013930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2daca70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00a5d0 tx=0x7fa2bc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdb5f48cf305ec server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d3261700 1 -- 172.21.15.167:0/2362013930 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2bc0086a0 con 0x55c6f2d18ad0 2023-10-05T19:50:43.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d3261700 1 -- 172.21.15.167:0/2362013930 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc008800 con 0x55c6f2d18ad0 2023-10-05T19:50:43.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d3261700 1 -- 172.21.15.167:0/2362013930 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2bc008ad0 con 0x55c6f2d18ad0 2023-10-05T19:50:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2362013930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 msgr2=0x55c6f2daca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/2362013930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2daca70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00a5d0 tx=0x7fa2bc005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2362013930 shutdown_connections 2023-10-05T19:50:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/2362013930 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2daca70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2362013930 >> 172.21.15.167:0/2362013930 conn(0x55c6f2d9f360 msgr2=0x55c6f2da1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2362013930 shutdown_connections 2023-10-05T19:50:43.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2362013930 wait complete. 2023-10-05T19:50:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 Processor -- start 2023-10-05T19:50:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 -- start start 2023-10-05T19:50:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dc4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d672ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2c71e30 con 0x55c6f2d18ad0 2023-10-05T19:50:43.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d4263700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dc4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d4263700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dc4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46464/0 (socket says 172.21.15.167:46464) 2023-10-05T19:50:43.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d4263700 1 -- 172.21.15.167:0/2304625182 learned_addr learned my addr 172.21.15.167:0/2304625182 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.184+0000 7fa2d4263700 1 -- 172.21.15.167:0/2304625182 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc005cf0 con 0x55c6f2d18ad0 2023-10-05T19:50:43.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d4263700 1 --2- 172.21.15.167:0/2304625182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dc4c70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40014a0 tx=0x7fa2c4006b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117dd636f2fe647e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d225f700 1 -- 172.21.15.167:0/2304625182 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2c4006110 con 0x55c6f2d18ad0 2023-10-05T19:50:43.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d225f700 1 -- 172.21.15.167:0/2304625182 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c4006270 con 0x55c6f2d18ad0 2023-10-05T19:50:43.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d225f700 1 -- 172.21.15.167:0/2304625182 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2c4004520 con 0x55c6f2d18ad0 2023-10-05T19:50:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2304625182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 msgr2=0x55c6f2dc4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/2304625182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dc4c70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40014a0 tx=0x7fa2c4006b90 comp rx=0 tx=0).stop 2023-10-05T19:50:43.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2304625182 shutdown_connections 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/2304625182 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dc4c70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2304625182 >> 172.21.15.167:0/2304625182 conn(0x55c6f2d9f360 msgr2=0x55c6f2dc0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2304625182 shutdown_connections 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 -- 172.21.15.167:0/2304625182 wait complete. 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 Processor -- start 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 -- start start 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dcba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2c44ed0 con 0x55c6f2d18ad0 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d4263700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dcba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d4263700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dcba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46472/0 (socket says 172.21.15.167:46472) 2023-10-05T19:50:43.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 learned_addr learned my addr 172.21.15.167:0/1921267380 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f2cf0bd0 con 0x55c6f2d18ad0 2023-10-05T19:50:43.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d4263700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dcba40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4006bd0 tx=0x7fa2c4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d0a5c700 1 -- 172.21.15.167:0/1921267380 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2c4006110 con 0x55c6f2d18ad0 2023-10-05T19:50:43.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d0a5c700 1 -- 172.21.15.167:0/1921267380 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c40063e0 con 0x55c6f2d18ad0 2023-10-05T19:50:43.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c6f2dcbf80 con 0x55c6f2d18ad0 2023-10-05T19:50:43.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d0a5c700 1 -- 172.21.15.167:0/1921267380 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2c4013d00 con 0x55c6f2d18ad0 2023-10-05T19:50:43.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.188+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6f2dcc3c0 con 0x55c6f2d18ad0 2023-10-05T19:50:43.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d0a5c700 1 -- 172.21.15.167:0/1921267380 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fa2c4004030 con 0x55c6f2d18ad0 2023-10-05T19:50:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d0a5c700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa2b4030c50 0x7fa2b4033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d0a5c700 1 -- 172.21.15.167:0/1921267380 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fa2c40448a0 con 0x55c6f2d18ad0 2023-10-05T19:50:43.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d3a62700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa2b4030c50 0x7fa2b4033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c6f2d19de0 0x55c6f2dd74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2dd7b80 con 0x55c6f2d19de0 2023-10-05T19:50:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d4a64700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c6f2d19de0 0x55c6f2dd74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d3a62700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa2b4030c50 0x7fa2b4033100 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc005a90 tx=0x7fa2bc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d4a64700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c6f2d19de0 0x55c6f2dd74d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.192+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa2cc00a500 con 0x55c6f2d19de0 2023-10-05T19:50:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 realm 2023-10-05T19:50:43.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2dd4b30 con 0x55c6f2d19de0 2023-10-05T19:50:43.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa2cc00a500 con 0x55c6f2d19de0 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2dd8660 con 0x55c6f2d19de0 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa2cc00a500 con 0x55c6f2d19de0 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c6f2dd8290 0x55c6f2ddb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2ddbc00 con 0x55c6f2dd8290 2023-10-05T19:50:43.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d4263700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c6f2dd8290 0x55c6f2ddb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d4263700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c6f2dd8290 0x55c6f2ddb4d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2ddc4d0 con 0x55c6f2d19de0 2023-10-05T19:50:43.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa2cc00a500 con 0x55c6f2d19de0 2023-10-05T19:50:43.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 20 searching for the correct realm 2023-10-05T19:50:43.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2ddc040 0x55c6f2de02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2ddc040 2023-10-05T19:50:43.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.196+0000 7fa2d3a62700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2ddc040 0x55c6f2de02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d3a62700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2ddc040 0x55c6f2de02a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2dd8290 2023-10-05T19:50:43.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d4263700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa2c4027360 0x7fa2c40440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x7fa2c4027360 2023-10-05T19:50:43.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d4a64700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa2c4027360 0x7fa2c40440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d4a64700 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa2c4027360 0x7fa2c40440b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x7fa2c4027360 2023-10-05T19:50:43.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.200+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2ddc040 2023-10-05T19:50:43.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2dd8290 2023-10-05T19:50:43.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2dd8290 2023-10-05T19:50:43.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.204+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x7fa2c4027360 2023-10-05T19:50:43.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x7fa2c4027360 2023-10-05T19:50:43.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x7fa2c4027360 2023-10-05T19:50:43.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x7fa2c4027360 2023-10-05T19:50:43.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2dd8290 2023-10-05T19:50:43.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2ddc040 2023-10-05T19:50:43.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.208+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2dd8290 2023-10-05T19:50:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2ddc040 2023-10-05T19:50:43.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2ddc040 2023-10-05T19:50:43.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x7fa2c4027360 2023-10-05T19:50:43.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x7fa2c4027360 2023-10-05T19:50:43.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2d19de0 2023-10-05T19:50:43.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.212+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x7fa2c4027360 2023-10-05T19:50:43.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x7fa2c4027360 2023-10-05T19:50:43.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2ddc040 2023-10-05T19:50:43.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x7fa2c4027360 2023-10-05T19:50:43.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x7fa2c4027360 2023-10-05T19:50:43.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2dd8290 2023-10-05T19:50:43.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2dd8290 2023-10-05T19:50:43.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2ddc040 2023-10-05T19:50:43.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.216+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2dd8290 2023-10-05T19:50:43.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de0880 con 0x55c6f2dd8290 2023-10-05T19:50:43.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2ddd040 con 0x55c6f2d19de0 2023-10-05T19:50:43.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2ddd9c0 con 0x55c6f2dd8290 2023-10-05T19:50:43.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.220+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2ddcc30 con 0x55c6f2dd8290 2023-10-05T19:50:43.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de1230 con 0x55c6f2ddc040 2023-10-05T19:50:43.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de1990 con 0x55c6f2dd8290 2023-10-05T19:50:43.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de2d50 con 0x55c6f2ddc040 2023-10-05T19:50:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.224+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de2d50 con 0x55c6f2dd8290 2023-10-05T19:50:43.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de2d50 con 0x7fa2c4027360 2023-10-05T19:50:43.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x7fa2c4027360 2023-10-05T19:50:43.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2ddc040 2023-10-05T19:50:43.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.228+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2dd8290 2023-10-05T19:50:43.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2dd8290 2023-10-05T19:50:43.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x7fa2c4027360 2023-10-05T19:50:43.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x7fa2c4027360 2023-10-05T19:50:43.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x7fa2c4027360 2023-10-05T19:50:43.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x7fa2c4027360 2023-10-05T19:50:43.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.232+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2dd8290 2023-10-05T19:50:43.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2ddc040 2023-10-05T19:50:43.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2dd8290 2023-10-05T19:50:43.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2ddc040 2023-10-05T19:50:43.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.236+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc014040 con 0x55c6f2d19de0 2023-10-05T19:50:43.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2ddc040 2023-10-05T19:50:43.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x7fa2c4027360 2023-10-05T19:50:43.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2d19de0 2023-10-05T19:50:43.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x7fa2c4027360 2023-10-05T19:50:43.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.240+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2ddc040 2023-10-05T19:50:43.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x7fa2c4027360 2023-10-05T19:50:43.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2dd8290 2023-10-05T19:50:43.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2dd8290 2023-10-05T19:50:43.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2ddc040 2023-10-05T19:50:43.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.244+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2dd8290 2023-10-05T19:50:43.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de15e0 con 0x55c6f2dd8290 2023-10-05T19:50:43.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de1d40 con 0x55c6f2dd8290 2023-10-05T19:50:43.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de20f0 con 0x55c6f2d19de0 2023-10-05T19:50:43.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.248+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de2990 con 0x55c6f2dd8290 2023-10-05T19:50:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de2d40 con 0x55c6f2dd8290 2023-10-05T19:50:43.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de2d40 con 0x7fa2c4027360 2023-10-05T19:50:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 zone default found 2023-10-05T19:50:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 4 Realm: () 2023-10-05T19:50:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 zonegroup default 2023-10-05T19:50:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de2d40 con 0x7fa2c4027360 2023-10-05T19:50:43.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de46c0 con 0x55c6f2ddc040 2023-10-05T19:50:43.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.252+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de4a70 con 0x55c6f2ddc040 2023-10-05T19:50:43.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.256+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.256+0000 7fa2d672ee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.256+0000 7fa2d672ee40 20 started sync module instance, tier type = 2023-10-05T19:50:43.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.256+0000 7fa2d672ee40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:43.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.256+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de3d80 con 0x55c6f2dd8290 2023-10-05T19:50:43.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.256+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.256+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94312966530208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de4e20 con 0x55c6f2dd8290 2023-10-05T19:50:43.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.256+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de56c0 con 0x55c6f2d19de0 2023-10-05T19:50:43.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.260+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94312966530208] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.260+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.260+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94312966537600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de5310 con 0x55c6f2d19de0 2023-10-05T19:50:43.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.260+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de5dc0 con 0x55c6f2dd8290 2023-10-05T19:50:43.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.264+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94312966537600] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.264+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.264+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94312966543504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de5310 con 0x55c6f2dd8290 2023-10-05T19:50:43.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.264+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de66b0 con 0x7fa2c4027360 2023-10-05T19:50:43.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.264+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.264+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94312966545856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de6b00 con 0x7fa2c4027360 2023-10-05T19:50:43.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.264+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de7510 con 0x55c6f2dd8290 2023-10-05T19:50:43.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.264+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94312966543504] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.268+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94312966545856] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.268+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.268+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94312966546960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de6a60 con 0x55c6f2dd8290 2023-10-05T19:50:43.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.268+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de7a00 con 0x55c6f2ddc040 2023-10-05T19:50:43.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.268+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.268+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94312966550800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de82a0 con 0x55c6f2ddc040 2023-10-05T19:50:43.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.268+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de8cb0 con 0x55c6f2ddc040 2023-10-05T19:50:43.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.268+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94312966546960] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94312966550800] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94312966555584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de9060 con 0x55c6f2ddc040 2023-10-05T19:50:43.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de9900 con 0x7fa2c4027360 2023-10-05T19:50:43.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94312966555584] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2bc008ae0 con 0x55c6f2ddc040 2023-10-05T19:50:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94312966558736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de9d50 con 0x7fa2c4027360 2023-10-05T19:50:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 20 add_watcher() i=0 2023-10-05T19:50:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 20 add_watcher() i=1 2023-10-05T19:50:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 20 add_watcher() i=2 2023-10-05T19:50:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 20 add_watcher() i=3 2023-10-05T19:50:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 20 add_watcher() i=4 2023-10-05T19:50:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 20 add_watcher() i=5 2023-10-05T19:50:43.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 20 add_watcher() i=6 2023-10-05T19:50:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94312966558736] v30'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 20 add_watcher() i=7 2023-10-05T19:50:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:43.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.272+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2dece60 con 0x55c6f2d19de0 2023-10-05T19:50:43.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94312966559840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2dea1a0 con 0x55c6f2d19de0 2023-10-05T19:50:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94312966559840] v30'164 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2a5fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d672ee40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d672ee40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d672ee40 1 Processor -- start 2023-10-05T19:50:43.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d672ee40 1 -- start start 2023-10-05T19:50:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d672ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2df7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d672ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2df7c90 con 0x55c6f2df7380 2023-10-05T19:50:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d3a62700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2df7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d3a62700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2df7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46480/0 (socket says 172.21.15.167:46480) 2023-10-05T19:50:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1962746408 learned_addr learned my addr 172.21.15.167:0/1962746408 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.276+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1962746408 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f2df7dd0 con 0x55c6f2df7380 2023-10-05T19:50:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d3a62700 1 --2- 172.21.15.167:0/1962746408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2df7750 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x55c6f2d1a240 tx=0x7fa2bc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be90595cf37bda4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2a57e2700 1 -- 172.21.15.167:0/1962746408 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2bc02d040 con 0x55c6f2df7380 2023-10-05T19:50:43.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2a57e2700 1 -- 172.21.15.167:0/1962746408 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc028810 con 0x55c6f2df7380 2023-10-05T19:50:43.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2a57e2700 1 -- 172.21.15.167:0/1962746408 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2bc0129e0 con 0x55c6f2df7380 2023-10-05T19:50:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1962746408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 msgr2=0x55c6f2df7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1962746408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2df7750 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x55c6f2d1a240 tx=0x7fa2bc012000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1962746408 shutdown_connections 2023-10-05T19:50:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1962746408 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2df7750 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1962746408 >> 172.21.15.167:0/1962746408 conn(0x55c6f2df2740 msgr2=0x55c6f2df08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1962746408 shutdown_connections 2023-10-05T19:50:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1962746408 wait complete. 2023-10-05T19:50:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 Processor -- start 2023-10-05T19:50:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 -- start start 2023-10-05T19:50:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2dfccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2dfdcc0 con 0x55c6f2df7380 2023-10-05T19:50:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d3a62700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2dfccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d3a62700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2dfccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46492/0 (socket says 172.21.15.167:46492) 2023-10-05T19:50:43.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d3a62700 1 -- 172.21.15.167:0/961924332 learned_addr learned my addr 172.21.15.167:0/961924332 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d3a62700 1 -- 172.21.15.167:0/961924332 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f2d1a270 con 0x55c6f2df7380 2023-10-05T19:50:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d3a62700 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2dfccc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55c6f2df1460 tx=0x7fa2bc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa21f7fe700 1 -- 172.21.15.167:0/961924332 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2bc033940 con 0x55c6f2df7380 2023-10-05T19:50:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa21f7fe700 1 -- 172.21.15.167:0/961924332 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc03f070 con 0x55c6f2df7380 2023-10-05T19:50:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c6f2dfd2c0 con 0x55c6f2df7380 2023-10-05T19:50:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.280+0000 7fa21f7fe700 1 -- 172.21.15.167:0/961924332 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2bc033ac0 con 0x55c6f2df7380 2023-10-05T19:50:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6f2dfd700 con 0x55c6f2df7380 2023-10-05T19:50:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa21f7fe700 1 -- 172.21.15.167:0/961924332 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fa2bc04d440 con 0x55c6f2df7380 2023-10-05T19:50:43.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa21f7fe700 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa214030c00 0x7fa2140330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa21f7fe700 1 -- 172.21.15.167:0/961924332 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7fa2bc041070 con 0x55c6f2df7380 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa2d672ee40 5 note: GC not initialized 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa2d4a64700 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa214030c00 0x7fa2140330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa2d4a64700 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa214030c00 0x7fa2140330b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55c6f2decf30 tx=0x7fa2cc00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa21cff9700 20 reqs_thread_entry: start 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa2127fc700 20 reqs_thread_entry: start 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa2d672ee40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa2d672ee40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.284+0000 7fa210ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:13 2023 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:43.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d672ee40 10 log_show_next pos 0 bl 0 off 0 eof 0 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2e641d0 0x55c6f2e665b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:1 6.1f 6:fa76b519:::2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3:head [read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2e66af0 con 0x55c6f2e641d0 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa1f7fff700 20 reqs_thread_entry: start 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d4263700 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2e641d0 0x55c6f2e665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d4263700 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2e641d0 0x55c6f2e665b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d4263700 1 -- 172.21.15.167:0/961924332 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(1 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3 [read 0~850 out=850b] v0'0 uv17 ondisk = 0) v8 ==== 208+0+850 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2e641d0 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d672ee40 10 read 850 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d672ee40 10 log_show_next pos 850 bl 850 off 419 eof 1 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d672ee40 10 log_show_next pos 850 bl 850 off 850 eof 1 2023-10-05T19:50:43.298 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_id": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3", 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_owner": "foo", 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: "log_entries": [ 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:37.097016Z", 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:37.097016+0000", 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:43.299 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "create_bucket", 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "PUT /myfoo3/ HTTP/1.1", 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "200", 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "", 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 11, 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:43.300 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx00000496ac97a5df93ed0-00651f138d-1085-default", 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:37.249013Z", 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: "time_local": "2023-10-05T19:50:37.249013+0000", 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: "remote_addr": "172.21.0.51", 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:43.301 INFO:teuthology.orchestra.run.smithi167.stdout: "operation": "delete_bucket", 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "uri": "DELETE /myfoo3/ HTTP/1.1", 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "http_status": "204", 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "error_code": "NoContent", 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "object_size": 0, 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 67, 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "user_agent": "Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic", 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "referrer": "", 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "trans_id": "tx000004ffdd24901fb7cbf-00651f138d-1085-default", 2023-10-05T19:50:43.302 INFO:teuthology.orchestra.run.smithi167.stdout: "authentication_type": "Local", 2023-10-05T19:50:43.303 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key_id": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:43.303 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url": false 2023-10-05T19:50:43.303 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:43.303 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:43.303 INFO:teuthology.orchestra.run.smithi167.stdout: "log_sum": { 2023-10-05T19:50:43.303 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:50:43.303 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:50:43.303 INFO:teuthology.orchestra.run.smithi167.stdout: "total_time": 78, 2023-10-05T19:50:43.303 INFO:teuthology.orchestra.run.smithi167.stdout: "total_entries": 2 2023-10-05T19:50:43.304 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:43.304 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:43.304 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.288+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94312966530208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2e23800 con 0x55c6f2dd8290 2023-10-05T19:50:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.292+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94312966530208] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.292+0000 7fa2d672ee40 20 remove_watcher() i=0 2023-10-05T19:50:43.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.292+0000 7fa2d672ee40 2 removed watcher, disabling cache 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.292+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94312966537600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de24a0 con 0x55c6f2d19de0 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.292+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94312966537600] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.292+0000 7fa2d672ee40 20 remove_watcher() i=1 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.292+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94312966543504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de24a0 con 0x55c6f2dd8290 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.296+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94312966543504] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.296+0000 7fa2d672ee40 20 remove_watcher() i=2 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.296+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94312966545856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de5890 con 0x7fa2c4027360 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.296+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94312966545856] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.296+0000 7fa2d672ee40 20 remove_watcher() i=3 2023-10-05T19:50:43.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.296+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94312966546960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de24a0 con 0x55c6f2dd8290 2023-10-05T19:50:43.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.300+0000 7fa2d4263700 1 -- 172.21.15.167:0/1921267380 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94312966546960] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2c4012ca0 con 0x55c6f2dd8290 2023-10-05T19:50:43.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.300+0000 7fa2d672ee40 20 remove_watcher() i=4 2023-10-05T19:50:43.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.300+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94312966550800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de66b0 con 0x55c6f2ddc040 2023-10-05T19:50:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.300+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94312966550800] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2bc039020 con 0x55c6f2ddc040 2023-10-05T19:50:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.300+0000 7fa2d672ee40 20 remove_watcher() i=5 2023-10-05T19:50:43.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.300+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94312966555584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de66b0 con 0x55c6f2ddc040 2023-10-05T19:50:43.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.304+0000 7fa2d3a62700 1 -- 172.21.15.167:0/1921267380 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94312966555584] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2bc039020 con 0x55c6f2ddc040 2023-10-05T19:50:43.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.304+0000 7fa2d672ee40 20 remove_watcher() i=6 2023-10-05T19:50:43.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.304+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94312966558736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de66b0 con 0x7fa2c4027360 2023-10-05T19:50:43.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.304+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94312966558736] v30'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x7fa2c4027360 2023-10-05T19:50:43.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.304+0000 7fa2d672ee40 20 remove_watcher() i=7 2023-10-05T19:50:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2a5fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94312966559840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c6f2de66b0 con 0x55c6f2d19de0 2023-10-05T19:50:43.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94312966559840] v30'165 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa2cc033040 con 0x55c6f2d19de0 2023-10-05T19:50:43.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c6f2dd8290 msgr2=0x55c6f2ddb4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c6f2dd8290 0x55c6f2ddb4d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c6f2d19de0 msgr2=0x55c6f2dd74d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c6f2d19de0 0x55c6f2dd74d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa2c4027360 msgr2=0x7fa2c40440b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fa2c4027360 0x7fa2c40440b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2ddc040 msgr2=0x55c6f2de02a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2ddc040 0x55c6f2de02a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa2b4030c50 msgr2=0x7fa2b4033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa2b4030c50 0x7fa2b4033100 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc005a90 tx=0x7fa2bc015000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d4a64700 1 -- 172.21.15.167:0/1921267380 reap_dead start 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 msgr2=0x55c6f2dcba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dcba40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4006bd0 tx=0x7fa2c4014000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 shutdown_connections 2023-10-05T19:50:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/1921267380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2d18ad0 0x55c6f2dcba40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 >> 172.21.15.167:0/1921267380 conn(0x55c6f2d9f360 msgr2=0x55c6f2dbf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 shutdown_connections 2023-10-05T19:50:43.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/1921267380 wait complete. 2023-10-05T19:50:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2e641d0 msgr2=0x55c6f2e665b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2e641d0 0x55c6f2e665b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa214030c00 msgr2=0x7fa2140330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa214030c00 0x7fa2140330b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55c6f2decf30 tx=0x7fa2cc00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 msgr2=0x55c6f2dfccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.308+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2dfccc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55c6f2df1460 tx=0x7fa2bc02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.312+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 shutdown_connections 2023-10-05T19:50:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.312+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c6f2e641d0 0x55c6f2e665b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.312+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fa214030c00 0x7fa2140330b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.312+0000 7fa2d672ee40 1 --2- 172.21.15.167:0/961924332 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c6f2df7380 0x55c6f2dfccc0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.312+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 >> 172.21.15.167:0/961924332 conn(0x55c6f2df2740 msgr2=0x55c6f2df0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.312+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 shutdown_connections 2023-10-05T19:50:43.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.312+0000 7fa2d672ee40 1 -- 172.21.15.167:0/961924332 wait complete. 2023-10-05T19:50:43.325 DEBUG:tasks.util.rgw: json result: {'bucket_id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3', 'bucket_owner': 'foo', 'bucket': 'myfoo3', 'log_entries': [{'bucket': 'myfoo3', 'time': '2023-10-05T19:50:37.097016Z', 'time_local': '2023-10-05T19:50:37.097016+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'create_bucket', 'uri': 'PUT /myfoo3/ HTTP/1.1', 'http_status': '200', 'error_code': '', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 11, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx00000496ac97a5df93ed0-00651f138d-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}, {'bucket': 'myfoo3', 'time': '2023-10-05T19:50:37.249013Z', 'time_local': '2023-10-05T19:50:37.249013+0000', 'remote_addr': '172.21.0.51', 'user': 'foo', 'operation': 'delete_bucket', 'uri': 'DELETE /myfoo3/ HTTP/1.1', 'http_status': '204', 'error_code': 'NoContent', 'bytes_sent': 0, 'bytes_received': 0, 'object_size': 0, 'total_time': 67, 'user_agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-163-generic', 'referrer': '', 'trans_id': 'tx000004ffdd24901fb7cbf-00651f138d-1085-default', 'authentication_type': 'Local', 'access_key_id': '9te6NH5mcdcq0Tc5i8i1', 'temp_url': False}], 'log_sum': {'bytes_sent': 0, 'bytes_received': 0, 'total_time': 78, 'total_entries': 2}} 2023-10-05T19:50:43.325 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:43.325 DEBUG:tasks.radosgw_admin:checking log entry: 2023-10-05T19:50:43.325 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'rm', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3'] 2023-10-05T19:50:43.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'rm', '--object', '2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3'] 2023-10-05T19:50:43.325 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log rm --object 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3 2023-10-05T19:50:43.367 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:43.367 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:43.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f7686556e40 1 Processor -- start 2023-10-05T19:50:43.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f7686556e40 1 -- start start 2023-10-05T19:50:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f7686556e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55d73902a120 0x55d73902c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f7686556e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d738f70bd0 con 0x55d739025b50 2023-10-05T19:50:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f7686556e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d738f2dee0 con 0x55d73902a120 2023-10-05T19:50:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f768388a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55d73902a120 0x55d73902c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f768388a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55d73902a120 0x55d73902c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46496/0 (socket says 172.21.15.167:46496) 2023-10-05T19:50:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f768388a700 1 -- 172.21.15.167:0/3788854565 learned_addr learned my addr 172.21.15.167:0/3788854565 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f768408b700 1 --1- 172.21.15.167:0/3788854565 >> v1:172.21.15.118:6789/0 conn(0x55d739025b50 0x55d739025f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51886/0 (socket says 172.21.15.167:51886) 2023-10-05T19:50:43.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f768388a700 1 -- 172.21.15.167:0/3788854565 >> v1:172.21.15.118:6789/0 conn(0x55d739025b50 legacy=0x55d739025f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f768388a700 1 -- 172.21.15.167:0/3788854565 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d739026760 con 0x55d73902a120 2023-10-05T19:50:43.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f768388a700 1 --2- 172.21.15.167:0/3788854565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d73902a120 0x55d73902c500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f767c00a5c0 tx=0x7f767c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7578c4f2c1ebb45 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f7683089700 1 -- 172.21.15.167:0/3788854565 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f767c00e510 con 0x55d73902a120 2023-10-05T19:50:43.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.360+0000 7f7683089700 1 -- 172.21.15.167:0/3788854565 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c00e670 con 0x55d73902a120 2023-10-05T19:50:43.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7683089700 1 -- 172.21.15.167:0/3788854565 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f767c00e920 con 0x55d73902a120 2023-10-05T19:50:43.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- 172.21.15.167:0/3788854565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d73902a120 msgr2=0x55d73902c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 --2- 172.21.15.167:0/3788854565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d73902a120 0x55d73902c500 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f767c00a5c0 tx=0x7f767c005e00 comp rx=0 tx=0).stop 2023-10-05T19:50:43.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- 172.21.15.167:0/3788854565 shutdown_connections 2023-10-05T19:50:43.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 --2- 172.21.15.167:0/3788854565 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d73902a120 0x55d73902c500 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- 172.21.15.167:0/3788854565 >> 172.21.15.167:0/3788854565 conn(0x55d738f995c0 msgr2=0x55d738f999c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- 172.21.15.167:0/3788854565 shutdown_connections 2023-10-05T19:50:43.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- 172.21.15.167:0/3788854565 wait complete. 2023-10-05T19:50:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 Processor -- start 2023-10-05T19:50:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- start start 2023-10-05T19:50:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d739044c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d738ef1e30 con 0x55d739025b50 2023-10-05T19:50:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f768408b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d739044c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f768408b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d739044c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46500/0 (socket says 172.21.15.167:46500) 2023-10-05T19:50:43.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f768408b700 1 -- 172.21.15.167:0/530991769 learned_addr learned my addr 172.21.15.167:0/530991769 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f768408b700 1 -- 172.21.15.167:0/530991769 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c00a180 con 0x55d739025b50 2023-10-05T19:50:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f768408b700 1 --2- 172.21.15.167:0/530991769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d739044c60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7674001cf0 tx=0x7f76740018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0ecc7464ea285d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7682087700 1 -- 172.21.15.167:0/530991769 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7674014070 con 0x55d739025b50 2023-10-05T19:50:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7682087700 1 -- 172.21.15.167:0/530991769 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767400be10 con 0x55d739025b50 2023-10-05T19:50:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7682087700 1 -- 172.21.15.167:0/530991769 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f767400f590 con 0x55d739025b50 2023-10-05T19:50:43.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- 172.21.15.167:0/530991769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 msgr2=0x55d739044c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 --2- 172.21.15.167:0/530991769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d739044c60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7674001cf0 tx=0x7f76740018a0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- 172.21.15.167:0/530991769 shutdown_connections 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 --2- 172.21.15.167:0/530991769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d739044c60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.364+0000 7f7686556e40 1 -- 172.21.15.167:0/530991769 >> 172.21.15.167:0/530991769 conn(0x55d738f995c0 msgr2=0x55d739040820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7686556e40 1 -- 172.21.15.167:0/530991769 shutdown_connections 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7686556e40 1 -- 172.21.15.167:0/530991769 wait complete. 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7686556e40 1 Processor -- start 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7686556e40 1 -- start start 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7686556e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d73904ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7686556e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d738ec4ed0 con 0x55d739025b50 2023-10-05T19:50:43.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f768408b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d73904ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f768408b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d73904ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46514/0 (socket says 172.21.15.167:46514) 2023-10-05T19:50:43.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 learned_addr learned my addr 172.21.15.167:0/353312006 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d738f70bd0 con 0x55d739025b50 2023-10-05T19:50:43.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f768408b700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d73904ba10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f76740018e0 tx=0x7f7674016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7680884700 1 -- 172.21.15.167:0/353312006 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f767401c740 con 0x55d739025b50 2023-10-05T19:50:43.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7680884700 1 -- 172.21.15.167:0/353312006 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767401c8c0 con 0x55d739025b50 2023-10-05T19:50:43.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d73904bf50 con 0x55d739025b50 2023-10-05T19:50:43.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7680884700 1 -- 172.21.15.167:0/353312006 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f767401cbb0 con 0x55d739025b50 2023-10-05T19:50:43.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.368+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d73904c390 con 0x55d739025b50 2023-10-05T19:50:43.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7680884700 1 -- 172.21.15.167:0/353312006 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7674023020 con 0x55d739025b50 2023-10-05T19:50:43.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7680884700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7668030c00 0x7f76680330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7680884700 1 -- 172.21.15.167:0/353312006 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f7674008030 con 0x55d739025b50 2023-10-05T19:50:43.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f768388a700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7668030c00 0x7f76680330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d73902a120 0x55d7390575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739057c20 con 0x55d73902a120 2023-10-05T19:50:43.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f768488c700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d73902a120 0x55d7390575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f768388a700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7668030c00 0x7f76680330b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f767c000f80 tx=0x7f767c013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f768488c700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d73902a120 0x55d7390575c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f766c00a500 con 0x55d73902a120 2023-10-05T19:50:43.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 20 realm 2023-10-05T19:50:43.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739054c20 con 0x55d73902a120 2023-10-05T19:50:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f766c00a500 con 0x55d73902a120 2023-10-05T19:50:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:43.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.372+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739058700 con 0x55d73902a120 2023-10-05T19:50:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f766c00a500 con 0x55d73902a120 2023-10-05T19:50:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d739059530 0x55d73905b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d73905be50 con 0x55d739059530 2023-10-05T19:50:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f768408b700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d739059530 0x55d73905b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f768408b700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d739059530 0x55d73905b910 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d73905c6f0 con 0x55d73902a120 2023-10-05T19:50:43.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f766c00a500 con 0x55d73902a120 2023-10-05T19:50:43.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 20 searching for the correct realm 2023-10-05T19:50:43.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d73905e4b0 0x55d739060890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73905e4b0 2023-10-05T19:50:43.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f768388a700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d73905e4b0 0x55d739060890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.376+0000 7f768388a700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d73905e4b0 0x55d739060890 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d739059530 2023-10-05T19:50:43.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768408b700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7674030060 0x7f767403def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x7f7674030060 2023-10-05T19:50:43.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768488c700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7674030060 0x7f767403def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768488c700 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7674030060 0x7f767403def0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x7f7674030060 2023-10-05T19:50:43.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73905e4b0 2023-10-05T19:50:43.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.380+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d739059530 2023-10-05T19:50:43.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d739059530 2023-10-05T19:50:43.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x7f7674030060 2023-10-05T19:50:43.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x7f7674030060 2023-10-05T19:50:43.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x7f7674030060 2023-10-05T19:50:43.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x7f7674030060 2023-10-05T19:50:43.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.384+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d739059530 2023-10-05T19:50:43.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73905e4b0 2023-10-05T19:50:43.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d739059530 2023-10-05T19:50:43.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73905e4b0 2023-10-05T19:50:43.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.388+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73905e4b0 2023-10-05T19:50:43.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x7f7674030060 2023-10-05T19:50:43.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x7f7674030060 2023-10-05T19:50:43.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73902a120 2023-10-05T19:50:43.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x7f7674030060 2023-10-05T19:50:43.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x7f7674030060 2023-10-05T19:50:43.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73905e4b0 2023-10-05T19:50:43.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.392+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x7f7674030060 2023-10-05T19:50:43.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x7f7674030060 2023-10-05T19:50:43.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d739059530 2023-10-05T19:50:43.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d739059530 2023-10-05T19:50:43.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d73905e4b0 2023-10-05T19:50:43.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d739059530 2023-10-05T19:50:43.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739060dd0 con 0x55d739059530 2023-10-05T19:50:43.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f7686556e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f7686556e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f7686556e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f7686556e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.396+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d73905d260 con 0x55d73902a120 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d73905dbb0 con 0x55d739059530 2023-10-05T19:50:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061210 con 0x55d739059530 2023-10-05T19:50:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390615c0 con 0x55d73905e4b0 2023-10-05T19:50:43.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061d50 con 0x55d739059530 2023-10-05T19:50:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.400+0000 7f7686556e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739063190 con 0x55d73905e4b0 2023-10-05T19:50:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739063190 con 0x55d739059530 2023-10-05T19:50:43.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739063190 con 0x7f7674030060 2023-10-05T19:50:43.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x7f7674030060 2023-10-05T19:50:43.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73905e4b0 2023-10-05T19:50:43.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.404+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d739059530 2023-10-05T19:50:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d739059530 2023-10-05T19:50:43.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x7f7674030060 2023-10-05T19:50:43.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x7f7674030060 2023-10-05T19:50:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.408+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x7f7674030060 2023-10-05T19:50:43.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x7f7674030060 2023-10-05T19:50:43.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d739059530 2023-10-05T19:50:43.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73905e4b0 2023-10-05T19:50:43.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d739059530 2023-10-05T19:50:43.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.412+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73905e4b0 2023-10-05T19:50:43.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c014040 con 0x55d73902a120 2023-10-05T19:50:43.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73905e4b0 2023-10-05T19:50:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x7f7674030060 2023-10-05T19:50:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.416+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73902a120 2023-10-05T19:50:43.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x7f7674030060 2023-10-05T19:50:43.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73905e4b0 2023-10-05T19:50:43.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x7f7674030060 2023-10-05T19:50:43.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d739059530 2023-10-05T19:50:43.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d739059530 2023-10-05T19:50:43.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.420+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d73905e4b0 2023-10-05T19:50:43.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d739059530 2023-10-05T19:50:43.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739061970 con 0x55d739059530 2023-10-05T19:50:43.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f7686556e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f7686556e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f7686556e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f7686556e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062180 con 0x55d739059530 2023-10-05T19:50:43.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f7686556e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.424+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062580 con 0x55d73902a120 2023-10-05T19:50:43.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062e70 con 0x55d739059530 2023-10-05T19:50:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062e70 con 0x55d739059530 2023-10-05T19:50:43.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062e70 con 0x7f7674030060 2023-10-05T19:50:43.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 zone default found 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 4 Realm: () 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 zonegroup default 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062e70 con 0x7f7674030060 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.428+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062e70 con 0x55d73905e4b0 2023-10-05T19:50:43.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f7686556e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739064f10 con 0x55d73905e4b0 2023-10-05T19:50:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f7686556e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f7686556e40 20 started sync module instance, tier type = 2023-10-05T19:50:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f7686556e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:43.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390645d0 con 0x55d739059530 2023-10-05T19:50:43.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.432+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.436+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94382863034752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390645d0 con 0x55d739059530 2023-10-05T19:50:43.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.436+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390657b0 con 0x55d73902a120 2023-10-05T19:50:43.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.436+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.436+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94382863045312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739065c00 con 0x55d73902a120 2023-10-05T19:50:43.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.436+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390664a0 con 0x55d739059530 2023-10-05T19:50:43.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.436+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94382863034752] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.440+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94382863045312] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.440+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.440+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94382863046416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739064af0 con 0x55d739059530 2023-10-05T19:50:43.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.440+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739066710 con 0x7f7674030060 2023-10-05T19:50:43.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.440+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.440+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94382863049248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739066b60 con 0x7f7674030060 2023-10-05T19:50:43.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.440+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739067570 con 0x55d739059530 2023-10-05T19:50:43.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.440+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94382863046416] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.444+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94382863049248] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.444+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.444+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94382863052928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739066b60 con 0x55d739059530 2023-10-05T19:50:43.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.444+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390674d0 con 0x55d73905e4b0 2023-10-05T19:50:43.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.444+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.444+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94382863055216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390682b0 con 0x55d73905e4b0 2023-10-05T19:50:43.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.444+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739068d00 con 0x55d73905e4b0 2023-10-05T19:50:43.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.444+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94382863052928] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94382863055216] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94382863050352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739069100 con 0x55d73905e4b0 2023-10-05T19:50:43.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390699a0 con 0x7f7674030060 2023-10-05T19:50:43.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94382863050352] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f767c017050 con 0x55d73905e4b0 2023-10-05T19:50:43.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94382863062192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739069df0 con 0x7f7674030060 2023-10-05T19:50:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 20 add_watcher() i=0 2023-10-05T19:50:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 20 add_watcher() i=1 2023-10-05T19:50:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 20 add_watcher() i=2 2023-10-05T19:50:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 20 add_watcher() i=3 2023-10-05T19:50:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 20 add_watcher() i=4 2023-10-05T19:50:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 20 add_watcher() i=5 2023-10-05T19:50:43.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 20 add_watcher() i=6 2023-10-05T19:50:43.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94382863062192] v30'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 20 add_watcher() i=7 2023-10-05T19:50:43.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:43.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.448+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d73906ce50 con 0x55d73902a120 2023-10-05T19:50:43.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94382863063296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d73906a240 con 0x55d73902a120 2023-10-05T19:50:43.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94382863063296] v30'166 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f7654ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f7686556e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:43.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f7686556e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:43.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f7686556e40 1 Processor -- start 2023-10-05T19:50:43.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f7686556e40 1 -- start start 2023-10-05T19:50:43.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f7686556e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d739077a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f7686556e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d739077fd0 con 0x55d7390776c0 2023-10-05T19:50:43.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f768388a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d739077a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f768388a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d739077a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46530/0 (socket says 172.21.15.167:46530) 2023-10-05T19:50:43.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.452+0000 7f768388a700 1 -- 172.21.15.167:0/2949350159 learned_addr learned my addr 172.21.15.167:0/2949350159 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f768388a700 1 -- 172.21.15.167:0/2949350159 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d739078110 con 0x55d7390776c0 2023-10-05T19:50:43.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f768388a700 1 --2- 172.21.15.167:0/2949350159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d739077a90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f767c003000 tx=0x7f767c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44882139785b5404 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f75cffff700 1 -- 172.21.15.167:0/2949350159 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f767c037070 con 0x55d7390776c0 2023-10-05T19:50:43.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f75cffff700 1 -- 172.21.15.167:0/2949350159 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c010b30 con 0x55d7390776c0 2023-10-05T19:50:43.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f75cffff700 1 -- 172.21.15.167:0/2949350159 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f767c02d040 con 0x55d7390776c0 2023-10-05T19:50:43.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 -- 172.21.15.167:0/2949350159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 msgr2=0x55d739077a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 --2- 172.21.15.167:0/2949350159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d739077a90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f767c003000 tx=0x7f767c010000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 -- 172.21.15.167:0/2949350159 shutdown_connections 2023-10-05T19:50:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 --2- 172.21.15.167:0/2949350159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d739077a90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 -- 172.21.15.167:0/2949350159 >> 172.21.15.167:0/2949350159 conn(0x55d739072a80 msgr2=0x55d739070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 -- 172.21.15.167:0/2949350159 shutdown_connections 2023-10-05T19:50:43.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 -- 172.21.15.167:0/2949350159 wait complete. 2023-10-05T19:50:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 Processor -- start 2023-10-05T19:50:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 -- start start 2023-10-05T19:50:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d73907d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f7686556e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73907e140 con 0x55d7390776c0 2023-10-05T19:50:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f768388a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d73907d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f768388a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d73907d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46538/0 (socket says 172.21.15.167:46538) 2023-10-05T19:50:43.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.456+0000 7f768388a700 1 -- 172.21.15.167:0/2663960102 learned_addr learned my addr 172.21.15.167:0/2663960102 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f768388a700 1 -- 172.21.15.167:0/2663960102 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d739026760 con 0x55d7390776c0 2023-10-05T19:50:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f768388a700 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d73907d140 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f767c00ea70 tx=0x7f767c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f75ce7fc700 1 -- 172.21.15.167:0/2663960102 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f767c037050 con 0x55d7390776c0 2023-10-05T19:50:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f75ce7fc700 1 -- 172.21.15.167:0/2663960102 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c03c440 con 0x55d7390776c0 2023-10-05T19:50:43.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d73907d740 con 0x55d7390776c0 2023-10-05T19:50:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f75ce7fc700 1 -- 172.21.15.167:0/2663960102 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f767c03c5f0 con 0x55d7390776c0 2023-10-05T19:50:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d73907db80 con 0x55d7390776c0 2023-10-05T19:50:43.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f75ce7fc700 1 -- 172.21.15.167:0/2663960102 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f767c03c750 con 0x55d7390776c0 2023-10-05T19:50:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f75ce7fc700 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f75c4030ca0 0x7f75c4033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f75ce7fc700 1 -- 172.21.15.167:0/2663960102 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f767c046c20 con 0x55d7390776c0 2023-10-05T19:50:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f768488c700 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f75c4030ca0 0x7f75c4033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f7686556e40 5 note: GC not initialized 2023-10-05T19:50:43.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.460+0000 7f768488c700 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f75c4030ca0 0x7f75c4033150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55d73906cf20 tx=0x7f766c00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f75c37fe700 20 reqs_thread_entry: start 2023-10-05T19:50:43.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f75c17fa700 20 reqs_thread_entry: start 2023-10-05T19:50:43.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f7686556e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:43.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f7686556e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:43.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f75af7fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:13 2023 2023-10-05T19:50:43.472 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:43.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f75aeffd700 20 reqs_thread_entry: start 2023-10-05T19:50:43.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f7686556e40 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d7390e46d0 0x55d7390e6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:1 6.1f 6:fa76b519:::2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390e6ff0 con 0x55d7390e46d0 2023-10-05T19:50:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f768408b700 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d7390e46d0 0x55d7390e6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.464+0000 7f768408b700 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d7390e46d0 0x55d7390e6ab0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.468+0000 7f768408b700 1 -- 172.21.15.167:0/2663960102 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(1 2023-10-05-19-e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.3-myfoo3 [delete] v30'22 uv22 ondisk = 0) v8 ==== 208+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d7390e46d0 2023-10-05T19:50:43.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.468+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94382863034752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390a3810 con 0x55d739059530 2023-10-05T19:50:43.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.468+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94382863034752] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.468+0000 7f7686556e40 20 remove_watcher() i=0 2023-10-05T19:50:43.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.468+0000 7f7686556e40 2 removed watcher, disabling cache 2023-10-05T19:50:43.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.468+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94382863045312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062980 con 0x55d73902a120 2023-10-05T19:50:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.472+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94382863045312] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.472+0000 7f7686556e40 20 remove_watcher() i=1 2023-10-05T19:50:43.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.472+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94382863046416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062980 con 0x55d739059530 2023-10-05T19:50:43.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.472+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94382863046416] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.472+0000 7f7686556e40 20 remove_watcher() i=2 2023-10-05T19:50:43.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.472+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94382863049248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062980 con 0x7f7674030060 2023-10-05T19:50:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.476+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94382863049248] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.476+0000 7f7686556e40 20 remove_watcher() i=3 2023-10-05T19:50:43.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.476+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94382863052928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062980 con 0x55d739059530 2023-10-05T19:50:43.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.476+0000 7f768408b700 1 -- 172.21.15.167:0/353312006 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94382863052928] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7674016070 con 0x55d739059530 2023-10-05T19:50:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.476+0000 7f7686556e40 20 remove_watcher() i=4 2023-10-05T19:50:43.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.476+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94382863055216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739067080 con 0x55d73905e4b0 2023-10-05T19:50:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.480+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94382863055216] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f767c042070 con 0x55d73905e4b0 2023-10-05T19:50:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.480+0000 7f7686556e40 20 remove_watcher() i=5 2023-10-05T19:50:43.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.480+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94382863050352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739062980 con 0x55d73905e4b0 2023-10-05T19:50:43.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.480+0000 7f768388a700 1 -- 172.21.15.167:0/353312006 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94382863050352] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f767c042070 con 0x55d73905e4b0 2023-10-05T19:50:43.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.480+0000 7f7686556e40 20 remove_watcher() i=6 2023-10-05T19:50:43.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.480+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94382863062192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d739067970 con 0x7f7674030060 2023-10-05T19:50:43.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.484+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94382863062192] v30'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f766c033040 con 0x7f7674030060 2023-10-05T19:50:43.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.484+0000 7f7686556e40 20 remove_watcher() i=7 2023-10-05T19:50:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.484+0000 7f7654ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.484+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94382863063296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7390a6480 con 0x55d73902a120 2023-10-05T19:50:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94382863063296] v30'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f766c033040 con 0x55d73902a120 2023-10-05T19:50:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d739059530 msgr2=0x55d73905b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d739059530 0x55d73905b910 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d73902a120 msgr2=0x55d7390575c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d73902a120 0x55d7390575c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7674030060 msgr2=0x7f767403def0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7674030060 0x7f767403def0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d73905e4b0 msgr2=0x55d739060890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d73905e4b0 0x55d739060890 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7668030c00 msgr2=0x7f76680330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7668030c00 0x7f76680330b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f767c000f80 tx=0x7f767c013000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f768488c700 1 -- 172.21.15.167:0/353312006 reap_dead start 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 msgr2=0x55d73904ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d73904ba10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f76740018e0 tx=0x7f7674016000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 shutdown_connections 2023-10-05T19:50:43.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/353312006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d739025b50 0x55d73904ba10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 >> 172.21.15.167:0/353312006 conn(0x55d738f995c0 msgr2=0x55d73903f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 shutdown_connections 2023-10-05T19:50:43.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/353312006 wait complete. 2023-10-05T19:50:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d7390e46d0 msgr2=0x55d7390e6ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d7390e46d0 0x55d7390e6ab0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f75c4030ca0 msgr2=0x7f75c4033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f75c4030ca0 0x7f75c4033150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55d73906cf20 tx=0x7f766c00e040 comp rx=0 tx=0).stop 2023-10-05T19:50:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 msgr2=0x55d73907d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d73907d140 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f767c00ea70 tx=0x7f767c02c000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 shutdown_connections 2023-10-05T19:50:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d7390e46d0 0x55d7390e6ab0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f75c4030ca0 0x7f75c4033150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 --2- 172.21.15.167:0/2663960102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d7390776c0 0x55d73907d140 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 >> 172.21.15.167:0/2663960102 conn(0x55d739072a80 msgr2=0x55d739070b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 shutdown_connections 2023-10-05T19:50:43.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.488+0000 7f7686556e40 1 -- 172.21.15.167:0/2663960102 wait complete. 2023-10-05T19:50:43.503 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2023-10-05T19:50:43.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2023-10-05T19:50:43.503 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2023-10-05T19:50:43.586 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:43.586 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:43.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 Processor -- start 2023-10-05T19:50:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 -- start start 2023-10-05T19:50:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a4638fa920 0x55a4638facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a463847bd0 con 0x55a4638fb230 2023-10-05T19:50:43.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a463804ee0 con 0x55a4638fa920 2023-10-05T19:50:43.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dd9ab700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a4638fa920 0x55a4638facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dd1aa700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55a4638fb230 0x55a4638fbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51892/0 (socket says 172.21.15.167:51892) 2023-10-05T19:50:43.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dd1aa700 1 -- 172.21.15.167:0/979702635 learned_addr learned my addr 172.21.15.167:0/979702635 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:43.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dd9ab700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a4638fa920 0x55a4638facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46544/0 (socket says 172.21.15.167:46544) 2023-10-05T19:50:43.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dd9ab700 1 -- 172.21.15.167:0/979702635 >> v1:172.21.15.118:6789/0 conn(0x55a4638fb230 legacy=0x55a4638fbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dd9ab700 1 -- 172.21.15.167:0/979702635 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4638fc3e0 con 0x55a4638fa920 2023-10-05T19:50:43.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dd9ab700 1 --2- 172.21.15.167:0/979702635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a4638facf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f44d000a5d0 tx=0x7f44d0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec78c7f4a93faedf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dc9a9700 1 -- 172.21.15.167:0/979702635 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d00086a0 con 0x55a4638fa920 2023-10-05T19:50:43.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dc9a9700 1 -- 172.21.15.167:0/979702635 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d0008800 con 0x55a4638fa920 2023-10-05T19:50:43.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dc9a9700 1 -- 172.21.15.167:0/979702635 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d0008ad0 con 0x55a4638fa920 2023-10-05T19:50:43.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 -- 172.21.15.167:0/979702635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 msgr2=0x55a4638facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/979702635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a4638facf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f44d000a5d0 tx=0x7f44d0005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:43.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 -- 172.21.15.167:0/979702635 shutdown_connections 2023-10-05T19:50:43.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/979702635 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a4638facf0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 -- 172.21.15.167:0/979702635 >> 172.21.15.167:0/979702635 conn(0x55a4638f6340 msgr2=0x55a4638f8750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 -- 172.21.15.167:0/979702635 shutdown_connections 2023-10-05T19:50:43.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.580+0000 7f44dfe76e40 1 -- 172.21.15.167:0/979702635 wait complete. 2023-10-05T19:50:43.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 Processor -- start 2023-10-05T19:50:43.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 -- start start 2023-10-05T19:50:43.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a463870230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4637c8e30 con 0x55a4638fa920 2023-10-05T19:50:43.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dd9ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a463870230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dd9ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a463870230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46548/0 (socket says 172.21.15.167:46548) 2023-10-05T19:50:43.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dd9ab700 1 -- 172.21.15.167:0/1376249480 learned_addr learned my addr 172.21.15.167:0/1376249480 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dd9ab700 1 -- 172.21.15.167:0/1376249480 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d0005cf0 con 0x55a4638fa920 2023-10-05T19:50:43.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dd9ab700 1 --2- 172.21.15.167:0/1376249480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a463870230 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f44d0000c00 tx=0x7f44d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544a34e4d685d641 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44cf7fe700 1 -- 172.21.15.167:0/1376249480 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d0008970 con 0x55a4638fa920 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44cf7fe700 1 -- 172.21.15.167:0/1376249480 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d0008af0 con 0x55a4638fa920 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44cf7fe700 1 -- 172.21.15.167:0/1376249480 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d0008de0 con 0x55a4638fa920 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 -- 172.21.15.167:0/1376249480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 msgr2=0x55a463870230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/1376249480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a463870230 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f44d0000c00 tx=0x7f44d0015000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 -- 172.21.15.167:0/1376249480 shutdown_connections 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/1376249480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a463870230 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 -- 172.21.15.167:0/1376249480 >> 172.21.15.167:0/1376249480 conn(0x55a4638f6340 msgr2=0x55a463915560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 -- 172.21.15.167:0/1376249480 shutdown_connections 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 -- 172.21.15.167:0/1376249480 wait complete. 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 Processor -- start 2023-10-05T19:50:43.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 -- start start 2023-10-05T19:50:43.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a4639227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.584+0000 7f44dfe76e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46379bed0 con 0x55a4638fa920 2023-10-05T19:50:43.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44dd9ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a4639227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44dd9ab700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a4639227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46564/0 (socket says 172.21.15.167:46564) 2023-10-05T19:50:43.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 learned_addr learned my addr 172.21.15.167:0/3198313912 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4638fc3e0 con 0x55a4638fa920 2023-10-05T19:50:43.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44dd9ab700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a4639227d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f44d0008fd0 tx=0x7f44d0003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44cdffb700 1 -- 172.21.15.167:0/3198313912 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d0012b70 con 0x55a4638fa920 2023-10-05T19:50:43.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44cdffb700 1 -- 172.21.15.167:0/3198313912 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d002a070 con 0x55a4638fa920 2023-10-05T19:50:43.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a463922d10 con 0x55a4638fa920 2023-10-05T19:50:43.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44cdffb700 1 -- 172.21.15.167:0/3198313912 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d0031480 con 0x55a4638fa920 2023-10-05T19:50:43.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4639231b0 con 0x55a4638fa920 2023-10-05T19:50:43.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.588+0000 7f44cdffb700 1 -- 172.21.15.167:0/3198313912 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f44d0019070 con 0x55a4638fa920 2023-10-05T19:50:43.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44cdffb700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44c0030c50 0x7f44c0033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44cdffb700 1 -- 172.21.15.167:0/3198313912 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f44d002c070 con 0x55a4638fa920 2023-10-05T19:50:43.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dd1aa700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44c0030c50 0x7f44c0033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a4638fb230 0x55a46392e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46392e910 con 0x55a4638fb230 2023-10-05T19:50:43.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44de1ac700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a4638fb230 0x55a46392e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dd1aa700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44c0030c50 0x7f44c0033100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44d4004170 tx=0x7f44d4001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44de1ac700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a4638fb230 0x55a46392e2f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 20 realm 2023-10-05T19:50:43.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46392b950 con 0x55a4638fb230 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46392f3f0 con 0x55a4638fb230 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a463930220 0x55a463932600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463932b40 con 0x55a463930220 2023-10-05T19:50:43.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.592+0000 7f44dd9ab700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a463930220 0x55a463932600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dd9ab700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a463930220 0x55a463932600 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f44d0022020 con 0x55a463930220 2023-10-05T19:50:43.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639333e0 con 0x55a4638fb230 2023-10-05T19:50:43.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dfe76e40 20 searching for the correct realm 2023-10-05T19:50:43.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a4639351a0 0x55a463937580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4639351a0 2023-10-05T19:50:43.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dd1aa700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a4639351a0 0x55a463937580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dd1aa700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a4639351a0 0x55a463937580 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4006070 con 0x55a4639351a0 2023-10-05T19:50:43.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.596+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a463930220 2023-10-05T19:50:43.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0022020 con 0x55a463930220 2023-10-05T19:50:43.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44dd9ab700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f44d0007030 0x7f44d000b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x7f44d0007030 2023-10-05T19:50:43.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f44d0007030 0x7f44d000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f44d0007030 0x7f44d000b750 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4639351a0 2023-10-05T19:50:43.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4006070 con 0x55a4639351a0 2023-10-05T19:50:43.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.600+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a463930220 2023-10-05T19:50:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0022020 con 0x55a463930220 2023-10-05T19:50:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a463930220 2023-10-05T19:50:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0022020 con 0x55a463930220 2023-10-05T19:50:43.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x7f44d0007030 2023-10-05T19:50:43.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x7f44d0007030 2023-10-05T19:50:43.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.604+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a463930220 2023-10-05T19:50:43.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d004f040 con 0x55a463930220 2023-10-05T19:50:43.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4639351a0 2023-10-05T19:50:43.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4006070 con 0x55a4639351a0 2023-10-05T19:50:43.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a463930220 2023-10-05T19:50:43.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d004f040 con 0x55a463930220 2023-10-05T19:50:43.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4639351a0 2023-10-05T19:50:43.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4006070 con 0x55a4639351a0 2023-10-05T19:50:43.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.608+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4639351a0 2023-10-05T19:50:43.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4006070 con 0x55a4639351a0 2023-10-05T19:50:43.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x7f44d0007030 2023-10-05T19:50:43.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4638fb230 2023-10-05T19:50:43.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x7f44d0007030 2023-10-05T19:50:43.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4639351a0 2023-10-05T19:50:43.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4006070 con 0x55a4639351a0 2023-10-05T19:50:43.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x7f44d0007030 2023-10-05T19:50:43.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.612+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a463930220 2023-10-05T19:50:43.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d004f040 con 0x55a463930220 2023-10-05T19:50:43.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a463930220 2023-10-05T19:50:43.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d004f040 con 0x55a463930220 2023-10-05T19:50:43.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a4639351a0 2023-10-05T19:50:43.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4006070 con 0x55a4639351a0 2023-10-05T19:50:43.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a463930220 2023-10-05T19:50:43.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f44d004f040 con 0x55a463930220 2023-10-05T19:50:43.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937ac0 con 0x55a463930220 2023-10-05T19:50:43.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d004f040 con 0x55a463930220 2023-10-05T19:50:43.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dfe76e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dfe76e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dfe76e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dfe76e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463933ef0 con 0x55a4638fb230 2023-10-05T19:50:43.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.616+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463933af0 con 0x55a463930220 2023-10-05T19:50:43.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a463930220 2023-10-05T19:50:43.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463938220 con 0x55a4639351a0 2023-10-05T19:50:43.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f44d4006070 con 0x55a4639351a0 2023-10-05T19:50:43.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639385d0 con 0x55a4638fb230 2023-10-05T19:50:43.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639343b0 con 0x55a463930220 2023-10-05T19:50:43.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.620+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463934380 con 0x55a4639351a0 2023-10-05T19:50:43.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463934380 con 0x55a463930220 2023-10-05T19:50:43.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x7f44d0007030 2023-10-05T19:50:43.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a4638fb230 2023-10-05T19:50:43.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a4638fb230 2023-10-05T19:50:43.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a4639351a0 2023-10-05T19:50:43.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a4638fb230 2023-10-05T19:50:43.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a463930220 2023-10-05T19:50:43.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.624+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a463930220 2023-10-05T19:50:43.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a4638fb230 2023-10-05T19:50:43.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x7f44d0007030 2023-10-05T19:50:43.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a4638fb230 2023-10-05T19:50:43.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x7f44d0007030 2023-10-05T19:50:43.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a463930220 2023-10-05T19:50:43.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463937e70 con 0x55a4639351a0 2023-10-05T19:50:43.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.628+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a4638fb230 2023-10-05T19:50:43.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a463930220 2023-10-05T19:50:43.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a4639351a0 2023-10-05T19:50:43.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a4638fb230 2023-10-05T19:50:43.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a4638fb230 2023-10-05T19:50:43.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a4638fb230 2023-10-05T19:50:43.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a4639351a0 2023-10-05T19:50:43.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.632+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x7f44d0007030 2023-10-05T19:50:43.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a4638fb230 2023-10-05T19:50:43.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x7f44d0007030 2023-10-05T19:50:43.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a4639351a0 2023-10-05T19:50:43.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x7f44d0007030 2023-10-05T19:50:43.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a463930220 2023-10-05T19:50:43.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a463930220 2023-10-05T19:50:43.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.636+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a4639351a0 2023-10-05T19:50:43.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a463930220 2023-10-05T19:50:43.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44d4028040 con 0x55a463930220 2023-10-05T19:50:43.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f44d0059040 con 0x55a463930220 2023-10-05T19:50:43.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463934380 con 0x55a463930220 2023-10-05T19:50:43.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463934380 con 0x55a4638fb230 2023-10-05T19:50:43.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.640+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463939140 con 0x55a463930220 2023-10-05T19:50:43.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639391d0 con 0x55a463930220 2023-10-05T19:50:43.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463939610 con 0x7f44d0007030 2023-10-05T19:50:43.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 zone default found 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 4 Realm: () 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 zonegroup default 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463939610 con 0x7f44d0007030 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463939610 con 0x55a4639351a0 2023-10-05T19:50:43.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.644+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463939a40 con 0x55a4639351a0 2023-10-05T19:50:43.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.648+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.648+0000 7f44dfe76e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.648+0000 7f44dfe76e40 20 started sync module instance, tier type = 2023-10-05T19:50:43.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.648+0000 7f44dfe76e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:43.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.648+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393af10 con 0x55a463930220 2023-10-05T19:50:43.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.648+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.648+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94164533611552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393b400 con 0x55a463930220 2023-10-05T19:50:43.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.648+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393bca0 con 0x55a4638fb230 2023-10-05T19:50:43.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.652+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.652+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94164533622048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393be60 con 0x55a4638fb230 2023-10-05T19:50:43.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.652+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393c9f0 con 0x55a463930220 2023-10-05T19:50:43.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.652+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94164533611552] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.652+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94164533622048] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.652+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.652+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94164533620496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393b970 con 0x55a463930220 2023-10-05T19:50:43.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.652+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393d2e0 con 0x7f44d0007030 2023-10-05T19:50:43.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.656+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.656+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94164533620496] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.656+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94164533628400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393b970 con 0x7f44d0007030 2023-10-05T19:50:43.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.656+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393d730 con 0x55a463930220 2023-10-05T19:50:43.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.656+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94164533628400] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.656+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.656+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94164533626048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393d730 con 0x55a463930220 2023-10-05T19:50:43.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.656+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393dfd0 con 0x55a4639351a0 2023-10-05T19:50:43.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.660+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94164533626048] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.660+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.660+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94164533630064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393e380 con 0x55a4639351a0 2023-10-05T19:50:43.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.660+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393ed90 con 0x55a4639351a0 2023-10-05T19:50:43.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.660+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94164533630064] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.660+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.660+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94164533631168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393f630 con 0x55a4639351a0 2023-10-05T19:50:43.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.660+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393fed0 con 0x7f44d0007030 2023-10-05T19:50:43.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94164533631168] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94164533638000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a46393fcb0 con 0x7f44d0007030 2023-10-05T19:50:43.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 20 add_watcher() i=0 2023-10-05T19:50:43.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 20 add_watcher() i=1 2023-10-05T19:50:43.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 20 add_watcher() i=2 2023-10-05T19:50:43.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 20 add_watcher() i=3 2023-10-05T19:50:43.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 20 add_watcher() i=4 2023-10-05T19:50:43.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 20 add_watcher() i=5 2023-10-05T19:50:43.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 20 add_watcher() i=6 2023-10-05T19:50:43.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94164533638000] v30'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 20 add_watcher() i=7 2023-10-05T19:50:43.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:43.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463943300 con 0x55a4638fb230 2023-10-05T19:50:43.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.664+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94164533639568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463940750 con 0x55a4638fb230 2023-10-05T19:50:43.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94164533639568] v30'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44aefe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dfe76e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:43.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dfe76e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:43.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dfe76e40 1 Processor -- start 2023-10-05T19:50:43.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dfe76e40 1 -- start start 2023-10-05T19:50:43.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dfe76e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a46394dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dfe76e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a46394e240 con 0x55a46394d930 2023-10-05T19:50:43.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dd1aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a46394dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dd1aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a46394dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46572/0 (socket says 172.21.15.167:46572) 2023-10-05T19:50:43.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3582818548 learned_addr learned my addr 172.21.15.167:0/3582818548 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3582818548 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a46394e380 con 0x55a46394d930 2023-10-05T19:50:43.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44dd1aa700 1 --2- 172.21.15.167:0/3582818548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a46394dd00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55a46392faf0 tx=0x7f44d4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4077edea816b0e03 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44ae7e4700 1 -- 172.21.15.167:0/3582818548 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d403b070 con 0x55a46394d930 2023-10-05T19:50:43.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44ae7e4700 1 -- 172.21.15.167:0/3582818548 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d4022040 con 0x55a46394d930 2023-10-05T19:50:43.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.668+0000 7f44ae7e4700 1 -- 172.21.15.167:0/3582818548 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d4021040 con 0x55a46394d930 2023-10-05T19:50:43.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3582818548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 msgr2=0x55a46394dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3582818548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a46394dd00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x55a46392faf0 tx=0x7f44d4010000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3582818548 shutdown_connections 2023-10-05T19:50:43.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3582818548 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a46394dd00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3582818548 >> 172.21.15.167:0/3582818548 conn(0x55a463948cf0 msgr2=0x55a463946e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3582818548 shutdown_connections 2023-10-05T19:50:43.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3582818548 wait complete. 2023-10-05T19:50:43.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 Processor -- start 2023-10-05T19:50:43.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 -- start start 2023-10-05T19:50:43.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a4639534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dfe76e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4639544c0 con 0x55a46394d930 2023-10-05T19:50:43.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dd1aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a4639534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dd1aa700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a4639534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46582/0 (socket says 172.21.15.167:46582) 2023-10-05T19:50:43.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dd1aa700 1 -- 172.21.15.167:0/559671304 learned_addr learned my addr 172.21.15.167:0/559671304 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dd1aa700 1 -- 172.21.15.167:0/559671304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a463847bd0 con 0x55a46394d930 2023-10-05T19:50:43.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.672+0000 7f44dd1aa700 1 --2- 172.21.15.167:0/559671304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a4639534c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55a4639479b0 tx=0x7f44d4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44acfe1700 1 -- 172.21.15.167:0/559671304 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d4021070 con 0x55a46394d930 2023-10-05T19:50:43.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44acfe1700 1 -- 172.21.15.167:0/559671304 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d4041630 con 0x55a46394d930 2023-10-05T19:50:43.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44dfe76e40 1 -- 172.21.15.167:0/559671304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a463953ac0 con 0x55a46394d930 2023-10-05T19:50:43.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44acfe1700 1 -- 172.21.15.167:0/559671304 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44d4046070 con 0x55a46394d930 2023-10-05T19:50:43.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44dfe76e40 1 -- 172.21.15.167:0/559671304 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a463953f60 con 0x55a46394d930 2023-10-05T19:50:43.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44acfe1700 1 -- 172.21.15.167:0/559671304 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f44d403e020 con 0x55a46394d930 2023-10-05T19:50:43.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44acfe1700 1 --2- 172.21.15.167:0/559671304 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4424030c50 0x7f4424033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44acfe1700 1 -- 172.21.15.167:0/559671304 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f44d402e040 con 0x55a46394d930 2023-10-05T19:50:43.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44de1ac700 1 --2- 172.21.15.167:0/559671304 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4424030c50 0x7f4424033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44dfe76e40 5 note: GC not initialized 2023-10-05T19:50:43.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.676+0000 7f44de1ac700 1 --2- 172.21.15.167:0/559671304 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4424030c50 0x7f4424033100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55a46393ff30 tx=0x7f44d800d630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f441dffb700 20 reqs_thread_entry: start 2023-10-05T19:50:43.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44177fe700 20 reqs_thread_entry: start 2023-10-05T19:50:43.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:43.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:43.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f4415ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:13 2023 2023-10-05T19:50:43.688 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:43.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44157fa700 20 reqs_thread_entry: start 2023-10-05T19:50:43.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 20 get_system_obj_state: rctx=0x7ffd387fe778 obj=default.rgw.meta:users.uid:foo state=0x55a4637d40b0 s->prefetch_data=0 2023-10-05T19:50:43.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:43.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639bbdf0 con 0x55a4638fb230 2023-10-05T19:50:43.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639be880 con 0x55a4638fb230 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:43.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:43.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:43.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.680+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639be880 con 0x7f44d0007030 2023-10-05T19:50:43.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 disabling bucket name=myfoo 2023-10-05T19:50:43.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 get_system_obj_state: rctx=0x7ffd387fdf50 obj=default.rgw.meta:root:myfoo state=0x55a4637d40b0 s->prefetch_data=0 2023-10-05T19:50:43.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:50:43.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639bd080 con 0x7f44d0007030 2023-10-05T19:50:43.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(105 myfoo [getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+91 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x6 2023-10-05T19:50:43.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:43.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x1, cached=0x6) 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639bd080 con 0x7f44d0007030 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(106 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 get_system_obj_state: rctx=0x7ffd387fdf50 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x55a4637aa2b0 s->prefetch_data=0 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : miss 2023-10-05T19:50:43.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639bf690 con 0x55a4638fb230 2023-10-05T19:50:43.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(107 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x16 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639c2270 con 0x55a4638fb230 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(108 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:43.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x13 2023-10-05T19:50:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:43.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.684+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639c73a0 con 0x55a4638fb230 2023-10-05T19:50:43.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(109 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'7 uv7 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x17 2023-10-05T19:50:43.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:43.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:43.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1, ofs0, ns] 2023-10-05T19:50:43.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [notify cookie 94164534194960 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639c62c0 con 0x7f44d0007030 2023-10-05T19:50:43.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== watch-notify(notify (1) cookie 94164533638000 notify 128849018895 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f44d8047040 con 0x7f44d0007030 2023-10-05T19:50:43.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44ceffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94164533638000 notifier 4601 bl.length()=725 2023-10-05T19:50:43.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44ceffd700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x17 2023-10-05T19:50:43.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44ceffd700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:43.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44ceffd700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:43.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44ceffd700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f44bc003d90 con 0x7f44d0007030 2023-10-05T19:50:43.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(110 notify.7 [notify cookie 94164534194960 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(111 notify.7 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== watch-notify(notify_complete (2) cookie 94164534194960 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f44d8042990 con 0x7f44d0007030 2023-10-05T19:50:43.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_sources= new_sources= 2023-10-05T19:50:43.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential sources added=[] removed=[] 2023-10-05T19:50:43.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_dests= new_dests= 2023-10-05T19:50:43.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential dests added=[] removed=[] 2023-10-05T19:50:43.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.688+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639c1040 con 0x55a4638fb230 2023-10-05T19:50:43.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(112 foo [delete,create,call,writefull 0~357] v30'12 uv12 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44dfe76e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:43.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44dfe76e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:43.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44dfe76e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:43.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 7.d 7:b4812045:::notify.4:head [notify cookie 94164534150000 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639c0520 con 0x55a463930220 2023-10-05T19:50:43.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94164533626048 notify 128849018913 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55a4639231b0 con 0x55a463930220 2023-10-05T19:50:43.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44cf7fe700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018913 cookie 94164533626048 notifier 4601 bl.length()=533 2023-10-05T19:50:43.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(113 notify.4 [notify cookie 94164534150000 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44cf7fe700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:43.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44cf7fe700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:43.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44cf7fe700 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f442c003440 con 0x55a463930220 2023-10-05T19:50:43.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(114 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.692+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94164534150000 notify 128849018913 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a463922d10 con 0x55a463930220 2023-10-05T19:50:43.702 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:43.702 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:43.702 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:43.702 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 1, 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:43.703 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:43.704 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:43.705 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:43.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.696+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:115 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94164533611552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a4639bf000 con 0x55a463930220 2023-10-05T19:50:43.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.696+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(115 notify.0 [watch unwatch cookie 94164533611552] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.696+0000 7f44dfe76e40 20 remove_watcher() i=0 2023-10-05T19:50:43.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.696+0000 7f44dfe76e40 2 removed watcher, disabling cache 2023-10-05T19:50:43.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.696+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:116 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94164533622048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463910240 con 0x55a4638fb230 2023-10-05T19:50:43.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.700+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(116 notify.1 [watch unwatch cookie 94164533622048] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.700+0000 7f44dfe76e40 20 remove_watcher() i=1 2023-10-05T19:50:43.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.700+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:117 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94164533620496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463910240 con 0x55a463930220 2023-10-05T19:50:43.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.700+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(117 notify.2 [watch unwatch cookie 94164533620496] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.700+0000 7f44dfe76e40 20 remove_watcher() i=2 2023-10-05T19:50:43.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.700+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:118 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94164533628400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463910240 con 0x7f44d0007030 2023-10-05T19:50:43.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.704+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(118 notify.3 [watch unwatch cookie 94164533628400] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.704+0000 7f44dfe76e40 20 remove_watcher() i=3 2023-10-05T19:50:43.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.704+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94164533626048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463910240 con 0x55a463930220 2023-10-05T19:50:43.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.704+0000 7f44dd9ab700 1 -- 172.21.15.167:0/3198313912 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(119 notify.4 [watch unwatch cookie 94164533626048] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d0064040 con 0x55a463930220 2023-10-05T19:50:43.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.704+0000 7f44dfe76e40 20 remove_watcher() i=4 2023-10-05T19:50:43.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.704+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94164533630064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463910240 con 0x55a4639351a0 2023-10-05T19:50:43.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.708+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(120 notify.5 [watch unwatch cookie 94164533630064] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.708+0000 7f44dfe76e40 20 remove_watcher() i=5 2023-10-05T19:50:43.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.708+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:121 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94164533631168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463910240 con 0x55a4639351a0 2023-10-05T19:50:43.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.708+0000 7f44dd1aa700 1 -- 172.21.15.167:0/3198313912 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(121 notify.6 [watch unwatch cookie 94164533631168] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d4024040 con 0x55a4639351a0 2023-10-05T19:50:43.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.708+0000 7f44dfe76e40 20 remove_watcher() i=6 2023-10-05T19:50:43.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.708+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:122 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94164533638000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463910240 con 0x7f44d0007030 2023-10-05T19:50:43.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.712+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(122 notify.7 [watch unwatch cookie 94164533638000] v30'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x7f44d0007030 2023-10-05T19:50:43.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.712+0000 7f44dfe76e40 20 remove_watcher() i=7 2023-10-05T19:50:43.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.712+0000 7f44aefe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.712+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:123 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94164533639568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a463910240 con 0x55a4638fb230 2023-10-05T19:50:43.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(123 data_loggenerations_metadata [watch unwatch cookie 94164533639568] v30'169 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f44d800a5a0 con 0x55a4638fb230 2023-10-05T19:50:43.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a463930220 msgr2=0x55a463932600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a463930220 0x55a463932600 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a4638fb230 msgr2=0x55a46392e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a4638fb230 0x55a46392e2f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f44d0007030 msgr2=0x7f44d000b750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f44d0007030 0x7f44d000b750 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a4639351a0 msgr2=0x55a463937580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a4639351a0 0x55a463937580 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44c0030c50 msgr2=0x7f44c0033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44c0030c50 0x7f44c0033100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44d4004170 tx=0x7f44d4001380 comp rx=0 tx=0).stop 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44de1ac700 1 -- 172.21.15.167:0/3198313912 reap_dead start 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 msgr2=0x55a4639227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a4639227d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f44d0008fd0 tx=0x7f44d0003050 comp rx=0 tx=0).stop 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 shutdown_connections 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/3198313912 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a4638fa920 0x55a4639227d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 >> 172.21.15.167:0/3198313912 conn(0x55a4638f6340 msgr2=0x55a463913fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 shutdown_connections 2023-10-05T19:50:43.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/3198313912 wait complete. 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/559671304 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4424030c50 msgr2=0x7f4424033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/559671304 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4424030c50 0x7f4424033100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55a46393ff30 tx=0x7f44d800d630 comp rx=0 tx=0).stop 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/559671304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 msgr2=0x55a4639534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/559671304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a4639534c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x55a4639479b0 tx=0x7f44d4037000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/559671304 shutdown_connections 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/559671304 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4424030c50 0x7f4424033100 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 --2- 172.21.15.167:0/559671304 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a46394d930 0x55a4639534c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/559671304 >> 172.21.15.167:0/559671304 conn(0x55a463948cf0 msgr2=0x55a463946d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/559671304 shutdown_connections 2023-10-05T19:50:43.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.716+0000 7f44dfe76e40 1 -- 172.21.15.167:0/559671304 wait complete. 2023-10-05T19:50:43.730 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:43.732 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2023-10-05T19:50:43.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2023-10-05T19:50:43.733 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2023-10-05T19:50:43.772 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:43.772 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:43.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.764+0000 7f9589ab7e40 1 Processor -- start 2023-10-05T19:50:43.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.764+0000 7f9589ab7e40 1 -- start start 2023-10-05T19:50:43.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.764+0000 7f9589ab7e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a094cfc920 0x55a094cfccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.764+0000 7f9589ab7e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a094c49bd0 con 0x55a094cfd230 2023-10-05T19:50:43.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.764+0000 7f9589ab7e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a094c06ee0 con 0x55a094cfc920 2023-10-05T19:50:43.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.764+0000 7f95875ec700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a094cfc920 0x55a094cfccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.764+0000 7f9586deb700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55a094cfd230 0x55a094cfdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:51896/0 (socket says 172.21.15.167:51896) 2023-10-05T19:50:43.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.764+0000 7f9586deb700 1 -- 172.21.15.167:0/3174770330 learned_addr learned my addr 172.21.15.167:0/3174770330 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:43.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.764+0000 7f95875ec700 1 -- 172.21.15.167:0/3174770330 >> v1:172.21.15.118:6789/0 conn(0x55a094cfd230 legacy=0x55a094cfdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f95875ec700 1 -- 172.21.15.167:0/3174770330 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a094cfe3e0 con 0x55a094cfc920 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f95875ec700 1 --2- 172.21.15.167:0/3174770330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094cfccf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f957800a5d0 tx=0x7f9578005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19bc2978b9d9042 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f95865ea700 1 -- 172.21.15.167:0/3174770330 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95780086a0 con 0x55a094cfc920 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f95865ea700 1 -- 172.21.15.167:0/3174770330 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9578008800 con 0x55a094cfc920 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f95865ea700 1 -- 172.21.15.167:0/3174770330 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9578008ad0 con 0x55a094cfc920 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3174770330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 msgr2=0x55a094cfccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/3174770330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094cfccf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f957800a5d0 tx=0x7f9578005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3174770330 shutdown_connections 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/3174770330 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094cfccf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3174770330 >> 172.21.15.167:0/3174770330 conn(0x55a094cf8340 msgr2=0x55a094cfa750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3174770330 shutdown_connections 2023-10-05T19:50:43.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3174770330 wait complete. 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 Processor -- start 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 -- start start 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094c72230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f9589ab7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a094bcae30 con 0x55a094cfc920 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f95875ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094c72230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f95875ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094c72230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46598/0 (socket says 172.21.15.167:46598) 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f95875ec700 1 -- 172.21.15.167:0/4156706724 learned_addr learned my addr 172.21.15.167:0/4156706724 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.768+0000 7f95875ec700 1 -- 172.21.15.167:0/4156706724 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578005cf0 con 0x55a094cfc920 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f95875ec700 1 --2- 172.21.15.167:0/4156706724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094c72230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9578000c00 tx=0x7f9578015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad8970e37e8834b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f95855e8700 1 -- 172.21.15.167:0/4156706724 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9578008970 con 0x55a094cfc920 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f95855e8700 1 -- 172.21.15.167:0/4156706724 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9578008af0 con 0x55a094cfc920 2023-10-05T19:50:43.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f95855e8700 1 -- 172.21.15.167:0/4156706724 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9578008de0 con 0x55a094cfc920 2023-10-05T19:50:43.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 -- 172.21.15.167:0/4156706724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 msgr2=0x55a094c72230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/4156706724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094c72230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9578000c00 tx=0x7f9578015000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 -- 172.21.15.167:0/4156706724 shutdown_connections 2023-10-05T19:50:43.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/4156706724 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094c72230 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 -- 172.21.15.167:0/4156706724 >> 172.21.15.167:0/4156706724 conn(0x55a094cf8340 msgr2=0x55a094d17560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 -- 172.21.15.167:0/4156706724 shutdown_connections 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 -- 172.21.15.167:0/4156706724 wait complete. 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 Processor -- start 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 -- start start 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094d247d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a094b9ded0 con 0x55a094cfc920 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f95875ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094d247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f95875ec700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094d247d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46604/0 (socket says 172.21.15.167:46604) 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 learned_addr learned my addr 172.21.15.167:0/2414203747 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a094cfe3e0 con 0x55a094cfc920 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f95875ec700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094d247d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9578008fd0 tx=0x7f9578003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f957f7fe700 1 -- 172.21.15.167:0/2414203747 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9578012b70 con 0x55a094cfc920 2023-10-05T19:50:43.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f957f7fe700 1 -- 172.21.15.167:0/2414203747 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957802a070 con 0x55a094cfc920 2023-10-05T19:50:43.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f957f7fe700 1 -- 172.21.15.167:0/2414203747 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9578031480 con 0x55a094cfc920 2023-10-05T19:50:43.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.772+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a094d24d10 con 0x55a094cfc920 2023-10-05T19:50:43.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a094d251b0 con 0x55a094cfc920 2023-10-05T19:50:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f957f7fe700 1 -- 172.21.15.167:0/2414203747 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9578019070 con 0x55a094cfc920 2023-10-05T19:50:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f957f7fe700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f956c030c50 0x7f956c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f957f7fe700 1 -- 172.21.15.167:0/2414203747 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f957802c070 con 0x55a094cfc920 2023-10-05T19:50:43.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f9586deb700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f956c030c50 0x7f956c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a094cfd230 0x55a094d30300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d309b0 con 0x55a094cfd230 2023-10-05T19:50:43.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f9587ded700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a094cfd230 0x55a094d30300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f9586deb700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f956c030c50 0x7f956c033100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f95700044f0 tx=0x7f95700067c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.776+0000 7f9587ded700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a094cfd230 0x55a094d30300 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f958000a500 con 0x55a094cfd230 2023-10-05T19:50:43.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 20 realm 2023-10-05T19:50:43.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d2d960 con 0x55a094cfd230 2023-10-05T19:50:43.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f958000a500 con 0x55a094cfd230 2023-10-05T19:50:43.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:43.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d31490 con 0x55a094cfd230 2023-10-05T19:50:43.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f958000a500 con 0x55a094cfd230 2023-10-05T19:50:43.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a094d322c0 0x55a094d346a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d34be0 con 0x55a094d322c0 2023-10-05T19:50:43.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f95875ec700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a094d322c0 0x55a094d346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f95875ec700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a094d322c0 0x55a094d346a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.780+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d35090 con 0x55a094cfd230 2023-10-05T19:50:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f958000a500 con 0x55a094cfd230 2023-10-05T19:50:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9589ab7e40 20 searching for the correct realm 2023-10-05T19:50:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a094d36fd0 0x55a094d393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d36fd0 2023-10-05T19:50:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9586deb700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a094d36fd0 0x55a094d393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9586deb700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a094d36fd0 0x55a094d393e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9570004520 con 0x55a094d36fd0 2023-10-05T19:50:43.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d322c0 2023-10-05T19:50:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f95875ec700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9578007030 0x7f95780315e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x7f9578007030 2023-10-05T19:50:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9587ded700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9578007030 0x7f95780315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9587ded700 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9578007030 0x7f95780315e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x7f9578007030 2023-10-05T19:50:43.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.784+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d36fd0 2023-10-05T19:50:43.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9570004520 con 0x55a094d36fd0 2023-10-05T19:50:43.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d322c0 2023-10-05T19:50:43.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d322c0 2023-10-05T19:50:43.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.788+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x7f9578007030 2023-10-05T19:50:43.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x7f9578007030 2023-10-05T19:50:43.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x7f9578007030 2023-10-05T19:50:43.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x7f9578007030 2023-10-05T19:50:43.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d322c0 2023-10-05T19:50:43.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d36fd0 2023-10-05T19:50:43.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9570004520 con 0x55a094d36fd0 2023-10-05T19:50:43.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.792+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d322c0 2023-10-05T19:50:43.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d36fd0 2023-10-05T19:50:43.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.796+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d36fd0 2023-10-05T19:50:43.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x7f9578007030 2023-10-05T19:50:43.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x7f9578007030 2023-10-05T19:50:43.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094cfd230 2023-10-05T19:50:43.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x7f9578007030 2023-10-05T19:50:43.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x7f9578007030 2023-10-05T19:50:43.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d36fd0 2023-10-05T19:50:43.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x7f9578007030 2023-10-05T19:50:43.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x7f9578007030 2023-10-05T19:50:43.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d322c0 2023-10-05T19:50:43.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.800+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d322c0 2023-10-05T19:50:43.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d36fd0 2023-10-05T19:50:43.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d322c0 2023-10-05T19:50:43.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d399f0 con 0x55a094d322c0 2023-10-05T19:50:43.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9589ab7e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9589ab7e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9589ab7e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9589ab7e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d35d80 con 0x55a094cfd230 2023-10-05T19:50:43.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.804+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d366d0 con 0x55a094d322c0 2023-10-05T19:50:43.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d39e60 con 0x55a094d322c0 2023-10-05T19:50:43.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a210 con 0x55a094d36fd0 2023-10-05T19:50:43.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d36240 con 0x55a094d322c0 2023-10-05T19:50:43.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.808+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3be70 con 0x55a094d36fd0 2023-10-05T19:50:43.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3be70 con 0x55a094d322c0 2023-10-05T19:50:43.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d36240 con 0x7f9578007030 2023-10-05T19:50:43.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x7f9578007030 2023-10-05T19:50:43.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d36fd0 2023-10-05T19:50:43.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.812+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d322c0 2023-10-05T19:50:43.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d322c0 2023-10-05T19:50:43.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x7f9578007030 2023-10-05T19:50:43.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x7f9578007030 2023-10-05T19:50:43.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.816+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x7f9578007030 2023-10-05T19:50:43.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x7f9578007030 2023-10-05T19:50:43.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d322c0 2023-10-05T19:50:43.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d36fd0 2023-10-05T19:50:43.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d322c0 2023-10-05T19:50:43.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.820+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d36fd0 2023-10-05T19:50:43.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580014040 con 0x55a094cfd230 2023-10-05T19:50:43.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d36fd0 2023-10-05T19:50:43.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.824+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x7f9578007030 2023-10-05T19:50:43.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094cfd230 2023-10-05T19:50:43.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x7f9578007030 2023-10-05T19:50:43.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d36fd0 2023-10-05T19:50:43.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x7f9578007030 2023-10-05T19:50:43.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d322c0 2023-10-05T19:50:43.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d322c0 2023-10-05T19:50:43.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.828+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d36fd0 2023-10-05T19:50:43.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d322c0 2023-10-05T19:50:43.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3a5c0 con 0x55a094d322c0 2023-10-05T19:50:43.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9589ab7e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:43.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9589ab7e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:43.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9589ab7e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:43.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9589ab7e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:43.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d36210 con 0x55a094d322c0 2023-10-05T19:50:43.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.832+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d36210 con 0x55a094cfd230 2023-10-05T19:50:43.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:43.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3b070 con 0x55a094d322c0 2023-10-05T19:50:43.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:43.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3b100 con 0x55a094d322c0 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3b540 con 0x7f9578007030 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 zone default found 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 4 Realm: () 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:43.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:43.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 zonegroup default 2023-10-05T19:50:43.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3b540 con 0x7f9578007030 2023-10-05T19:50:43.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3cec0 con 0x55a094d36fd0 2023-10-05T19:50:43.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.836+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3d270 con 0x55a094d36fd0 2023-10-05T19:50:43.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.840+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.840+0000 7f9589ab7e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:43.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.840+0000 7f9589ab7e40 20 started sync module instance, tier type = 2023-10-05T19:50:43.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.840+0000 7f9589ab7e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:43.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.840+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3c580 con 0x55a094d322c0 2023-10-05T19:50:43.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.840+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.840+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94148180028176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3ca70 con 0x55a094d322c0 2023-10-05T19:50:43.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.840+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3db10 con 0x55a094cfd230 2023-10-05T19:50:43.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.844+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.844+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94148180028176] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.844+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94148180035232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3db10 con 0x55a094cfd230 2023-10-05T19:50:43.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.844+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3e400 con 0x55a094d322c0 2023-10-05T19:50:43.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.844+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94148180035232] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.844+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.844+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94148180039488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3e400 con 0x55a094d322c0 2023-10-05T19:50:43.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.844+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3eca0 con 0x7f9578007030 2023-10-05T19:50:43.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.848+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.848+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94148180039488] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.848+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94148180041776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3e970 con 0x7f9578007030 2023-10-05T19:50:43.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.848+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3f3e0 con 0x55a094d322c0 2023-10-05T19:50:43.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.852+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94148180041776] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.852+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.852+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94148180046112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3e970 con 0x55a094d322c0 2023-10-05T19:50:43.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.852+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d3fe40 con 0x55a094d36fd0 2023-10-05T19:50:43.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.852+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.852+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94148180048208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d406e0 con 0x55a094d36fd0 2023-10-05T19:50:43.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.852+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d41160 con 0x55a094d36fd0 2023-10-05T19:50:43.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.852+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94148180046112] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94148180048208] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94148180042880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d41560 con 0x55a094d36fd0 2023-10-05T19:50:43.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d41e00 con 0x7f9578007030 2023-10-05T19:50:43.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94148180042880] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94148180056336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d42250 con 0x7f9578007030 2023-10-05T19:50:43.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 20 add_watcher() i=0 2023-10-05T19:50:43.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 20 add_watcher() i=1 2023-10-05T19:50:43.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 20 add_watcher() i=2 2023-10-05T19:50:43.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 20 add_watcher() i=3 2023-10-05T19:50:43.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 20 add_watcher() i=4 2023-10-05T19:50:43.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 20 add_watcher() i=5 2023-10-05T19:50:43.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 20 add_watcher() i=6 2023-10-05T19:50:43.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94148180056336] v30'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 20 add_watcher() i=7 2023-10-05T19:50:43.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:43.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.856+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d45320 con 0x55a094cfd230 2023-10-05T19:50:43.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94148180057440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d426a0 con 0x55a094cfd230 2023-10-05T19:50:43.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94148180057440] v30'170 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9557fef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9589ab7e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:43.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9589ab7e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:43.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9589ab7e40 1 Processor -- start 2023-10-05T19:50:43.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9589ab7e40 1 -- start start 2023-10-05T19:50:43.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9589ab7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d4ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9589ab7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a094d504a0 con 0x55a094d4fb90 2023-10-05T19:50:43.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9586deb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d4ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9586deb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d4ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46608/0 (socket says 172.21.15.167:46608) 2023-10-05T19:50:43.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9586deb700 1 -- 172.21.15.167:0/3880834161 learned_addr learned my addr 172.21.15.167:0/3880834161 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.860+0000 7f9586deb700 1 -- 172.21.15.167:0/3880834161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a094d505e0 con 0x55a094d4fb90 2023-10-05T19:50:43.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9586deb700 1 --2- 172.21.15.167:0/3880834161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d4ff60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9570001350 tx=0x7f9570006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550852bd56c04119 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f95577ee700 1 -- 172.21.15.167:0/3880834161 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f957001a040 con 0x55a094d4fb90 2023-10-05T19:50:43.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f95577ee700 1 -- 172.21.15.167:0/3880834161 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957001b040 con 0x55a094d4fb90 2023-10-05T19:50:43.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f95577ee700 1 -- 172.21.15.167:0/3880834161 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9570004970 con 0x55a094d4fb90 2023-10-05T19:50:43.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3880834161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 msgr2=0x55a094d4ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/3880834161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d4ff60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9570001350 tx=0x7f9570006000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3880834161 shutdown_connections 2023-10-05T19:50:43.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/3880834161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d4ff60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3880834161 >> 172.21.15.167:0/3880834161 conn(0x55a094d4af50 msgr2=0x55a094d490a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3880834161 shutdown_connections 2023-10-05T19:50:43.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3880834161 wait complete. 2023-10-05T19:50:43.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 Processor -- start 2023-10-05T19:50:43.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 -- start start 2023-10-05T19:50:43.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d55640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9589ab7e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a094d56640 con 0x55a094d4fb90 2023-10-05T19:50:43.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9586deb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d55640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9586deb700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d55640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46624/0 (socket says 172.21.15.167:46624) 2023-10-05T19:50:43.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9586deb700 1 -- 172.21.15.167:0/3308483292 learned_addr learned my addr 172.21.15.167:0/3308483292 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:43.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9586deb700 1 -- 172.21.15.167:0/3308483292 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a094c49bd0 con 0x55a094d4fb90 2023-10-05T19:50:43.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.864+0000 7f9586deb700 1 --2- 172.21.15.167:0/3308483292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d55640 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f957003a040 tx=0x7f9570036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9555feb700 1 -- 172.21.15.167:0/3308483292 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f957001a040 con 0x55a094d4fb90 2023-10-05T19:50:43.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9555feb700 1 -- 172.21.15.167:0/3308483292 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9570004330 con 0x55a094d4fb90 2023-10-05T19:50:43.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3308483292 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a094d55c40 con 0x55a094d4fb90 2023-10-05T19:50:43.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9555feb700 1 -- 172.21.15.167:0/3308483292 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f957002c790 con 0x55a094d4fb90 2023-10-05T19:50:43.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3308483292 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a094d56080 con 0x55a094d4fb90 2023-10-05T19:50:43.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9555feb700 1 -- 172.21.15.167:0/3308483292 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f957002c9b0 con 0x55a094d4fb90 2023-10-05T19:50:43.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9555feb700 1 --2- 172.21.15.167:0/3308483292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94cc030c00 0x7f94cc0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:43.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9555feb700 1 -- 172.21.15.167:0/3308483292 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f9570027040 con 0x55a094d4fb90 2023-10-05T19:50:43.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9587ded700 1 --2- 172.21.15.167:0/3308483292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94cc030c00 0x7f94cc0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:43.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9589ab7e40 5 note: GC not initialized 2023-10-05T19:50:43.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.868+0000 7f9587ded700 1 --2- 172.21.15.167:0/3308483292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94cc030c00 0x7f94cc0330b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55a094d453d0 tx=0x7f958000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:43.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f94c6ffd700 20 reqs_thread_entry: start 2023-10-05T19:50:43.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f94c4ff9700 20 reqs_thread_entry: start 2023-10-05T19:50:43.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 20 init_complete bucket index max shards: 11 2023-10-05T19:50:43.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:50:43.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f94b6ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:14 2023 2023-10-05T19:50:43.880 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:50:43.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f94b67fc700 20 reqs_thread_entry: start 2023-10-05T19:50:43.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 20 get_system_obj_state: rctx=0x7ffcb77c7ad8 obj=default.rgw.meta:users.uid:foo state=0x55a094bd60b0 s->prefetch_data=0 2023-10-05T19:50:43.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:50:43.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dbdf70 con 0x55a094cfd230 2023-10-05T19:50:43.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:50:43.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:43.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:43.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:43.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:43.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc0a00 con 0x55a094cfd230 2023-10-05T19:50:43.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:50:43.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:50:43.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:43.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.872+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc0a00 con 0x7f9578007030 2023-10-05T19:50:43.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 enabling bucket name=myfoo 2023-10-05T19:50:43.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 get_system_obj_state: rctx=0x7ffcb77c72b0 obj=default.rgw.meta:root:myfoo state=0x55a094bd60b0 s->prefetch_data=0 2023-10-05T19:50:43.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:50:43.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 8.9 8:91b71841:root::myfoo:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dbf200 con 0x7f9578007030 2023-10-05T19:50:43.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(105 myfoo [getxattrs out=75b,stat out=16b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+91 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x6 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x1, cached=0x6) 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dbf200 con 0x7f9578007030 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(106 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2023-10-05T19:50:43.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 get_system_obj_state: rctx=0x7ffcb77c72b0 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 state=0x55a094bac2b0 s->prefetch_data=0 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : miss 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc17f0 con 0x55a094cfd230 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(107 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x16 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 Read xattr: user.rgw.acl 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:50:43.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:50:43.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:43.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc4340 con 0x55a094cfd230 2023-10-05T19:50:43.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(108 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv7 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:50:43.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x13 2023-10-05T19:50:43.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:43.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:50:43.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:43.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 2023-10-05T19:50:43.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.876+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 8.3 8:c16f123c:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc96a0 con 0x55a094cfd230 2023-10-05T19:50:43.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(109 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'8 uv8 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x17 2023-10-05T19:50:43.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:43.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:43.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1, ofs0, ns] 2023-10-05T19:50:43.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [notify cookie 94148180612624 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc7200 con 0x7f9578007030 2023-10-05T19:50:43.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== watch-notify(notify (1) cookie 94148180056336 notify 128849018896 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f958003c250 con 0x7f9578007030 2023-10-05T19:50:43.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f95855e8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94148180056336 notifier 4607 bl.length()=725 2023-10-05T19:50:43.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f95855e8700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 info.flags=0x17 2023-10-05T19:50:43.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f95855e8700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1 to cache LRU end 2023-10-05T19:50:43.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f95855e8700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:50:43.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(110 notify.7 [notify cookie 94148180612624 out=8b] v0'0 uv186 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f95855e8700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9560003d90 con 0x7f9578007030 2023-10-05T19:50:43.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== watch-notify(notify_complete (2) cookie 94148180612624 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f958003cbd0 con 0x7f9578007030 2023-10-05T19:50:43.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_sources= new_sources= 2023-10-05T19:50:43.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential sources added=[] removed=[] 2023-10-05T19:50:43.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(111 notify.7 [notify-ack] v0'0 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): orig_dests= new_dests= 2023-10-05T19:50:43.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 20 handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1]): potential dests added=[] removed=[] 2023-10-05T19:50:43.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.880+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc90d0 con 0x55a094cfd230 2023-10-05T19:50:43.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(112 foo [delete,create,call,writefull 0~357] v30'13 uv13 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f9589ab7e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:43.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f9589ab7e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:43.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f9589ab7e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:50:43.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 7.d 7:b4812045:::notify.4:head [notify cookie 94148180567280 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dbe940 con 0x55a094d322c0 2023-10-05T19:50:43.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94148180046112 notify 128849018914 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55a094d251b0 con 0x55a094d322c0 2023-10-05T19:50:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(113 notify.4 [notify cookie 94148180567280 out=8b] v0'0 uv186 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f95855e8700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018914 cookie 94148180046112 notifier 4607 bl.length()=533 2023-10-05T19:50:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f95855e8700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:50:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f95855e8700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:50:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f95855e8700 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9560003d90 con 0x55a094d322c0 2023-10-05T19:50:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(114 notify.4 [notify-ack] v0'0 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94148180567280 notify 128849018914 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a094d24d10 con 0x55a094d322c0 2023-10-05T19:50:43.894 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:50:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:50:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:50:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:50:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:50:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:50:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:50:43.894 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:50:43.895 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:50:43.896 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:50:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:50:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:50:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:50:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:50:43.897 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:50:43.897 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:50:43.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.884+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:115 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94148180028176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094d12240 con 0x55a094d322c0 2023-10-05T19:50:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.888+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(115 notify.0 [watch unwatch cookie 94148180028176] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.888+0000 7f9589ab7e40 20 remove_watcher() i=0 2023-10-05T19:50:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.888+0000 7f9589ab7e40 2 removed watcher, disabling cache 2023-10-05T19:50:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.888+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:116 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94148180035232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc96f0 con 0x55a094cfd230 2023-10-05T19:50:43.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.892+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(116 notify.1 [watch unwatch cookie 94148180035232] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.892+0000 7f9589ab7e40 20 remove_watcher() i=1 2023-10-05T19:50:43.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.892+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:117 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94148180039488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc96f0 con 0x55a094d322c0 2023-10-05T19:50:43.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.892+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(117 notify.2 [watch unwatch cookie 94148180039488] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.892+0000 7f9589ab7e40 20 remove_watcher() i=2 2023-10-05T19:50:43.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.892+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:118 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94148180041776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc96f0 con 0x7f9578007030 2023-10-05T19:50:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.896+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(118 notify.3 [watch unwatch cookie 94148180041776] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.896+0000 7f9589ab7e40 20 remove_watcher() i=3 2023-10-05T19:50:43.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.896+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94148180046112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc96f0 con 0x55a094d322c0 2023-10-05T19:50:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.896+0000 7f95875ec700 1 -- 172.21.15.167:0/2414203747 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(119 notify.4 [watch unwatch cookie 94148180046112] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9578042040 con 0x55a094d322c0 2023-10-05T19:50:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.896+0000 7f9589ab7e40 20 remove_watcher() i=4 2023-10-05T19:50:43.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.896+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94148180048208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc96f0 con 0x55a094d36fd0 2023-10-05T19:50:43.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.900+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(120 notify.5 [watch unwatch cookie 94148180048208] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.900+0000 7f9589ab7e40 20 remove_watcher() i=5 2023-10-05T19:50:43.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.900+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:121 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94148180042880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc96f0 con 0x55a094d36fd0 2023-10-05T19:50:43.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.900+0000 7f9586deb700 1 -- 172.21.15.167:0/2414203747 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(121 notify.6 [watch unwatch cookie 94148180042880] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f957001d040 con 0x55a094d36fd0 2023-10-05T19:50:43.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.900+0000 7f9589ab7e40 20 remove_watcher() i=6 2023-10-05T19:50:43.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.900+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:122 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94148180056336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc96f0 con 0x7f9578007030 2023-10-05T19:50:43.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.904+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(122 notify.7 [watch unwatch cookie 94148180056336] v30'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9580033040 con 0x7f9578007030 2023-10-05T19:50:43.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.904+0000 7f9589ab7e40 20 remove_watcher() i=7 2023-10-05T19:50:43.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.904+0000 7f9557fef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:43.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.904+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:123 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94148180057440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a094dc96f0 con 0x55a094cfd230 2023-10-05T19:50:43.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(123 data_loggenerations_metadata [watch unwatch cookie 94148180057440] v30'171 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9580033040 con 0x55a094cfd230 2023-10-05T19:50:43.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a094d322c0 msgr2=0x55a094d346a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a094d322c0 0x55a094d346a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a094cfd230 msgr2=0x55a094d30300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a094cfd230 0x55a094d30300 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9578007030 msgr2=0x7f95780315e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9578007030 0x7f95780315e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a094d36fd0 msgr2=0x55a094d393e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a094d36fd0 0x55a094d393e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f956c030c50 msgr2=0x7f956c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f956c030c50 0x7f956c033100 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f95700044f0 tx=0x7f95700067c0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9587ded700 1 -- 172.21.15.167:0/2414203747 reap_dead start 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 msgr2=0x55a094d247d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094d247d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9578008fd0 tx=0x7f9578003050 comp rx=0 tx=0).stop 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 shutdown_connections 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/2414203747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094cfc920 0x55a094d247d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 >> 172.21.15.167:0/2414203747 conn(0x55a094cf8340 msgr2=0x55a094d15fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 shutdown_connections 2023-10-05T19:50:43.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/2414203747 wait complete. 2023-10-05T19:50:43.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3308483292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94cc030c00 msgr2=0x7f94cc0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/3308483292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94cc030c00 0x7f94cc0330b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55a094d453d0 tx=0x7f958000e040 comp rx=0 tx=0).stop 2023-10-05T19:50:43.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3308483292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 msgr2=0x55a094d55640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:43.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/3308483292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d55640 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f957003a040 tx=0x7f9570036000 comp rx=0 tx=0).stop 2023-10-05T19:50:43.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3308483292 shutdown_connections 2023-10-05T19:50:43.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/3308483292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f94cc030c00 0x7f94cc0330b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 --2- 172.21.15.167:0/3308483292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a094d4fb90 0x55a094d55640 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:43.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3308483292 >> 172.21.15.167:0/3308483292 conn(0x55a094d4af50 msgr2=0x55a094d48ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:43.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3308483292 shutdown_connections 2023-10-05T19:50:43.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:43.908+0000 7f9589ab7e40 1 -- 172.21.15.167:0/3308483292 wait complete. 2023-10-05T19:50:43.923 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:50:43.933 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-10-05T19:50:44.195 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2023-10-05T19:50:44.205 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:50:59.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2023-10-05T19:50:59.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2023-10-05T19:50:59.207 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2023-10-05T19:50:59.249 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:50:59.249 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:50:59.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.240+0000 7f0219662e40 1 Processor -- start 2023-10-05T19:50:59.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.240+0000 7f0219662e40 1 -- start start 2023-10-05T19:50:59.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.240+0000 7f0219662e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x558828a2af00 0x558828a2d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.240+0000 7f0219662e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558828973bd0 con 0x558828a26920 2023-10-05T19:50:59.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.240+0000 7f0219662e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x558828930ee0 con 0x558828a2af00 2023-10-05T19:50:59.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0216996700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x558828a2af00 0x558828a2d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0217197700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x558828a26920 0x558828a26cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:52632/0 (socket says 172.21.15.167:52632) 2023-10-05T19:50:59.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0217197700 1 -- 172.21.15.167:0/2406251614 learned_addr learned my addr 172.21.15.167:0/2406251614 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:50:59.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0216996700 1 -- 172.21.15.167:0/2406251614 >> v1:172.21.15.118:6789/0 conn(0x558828a26920 legacy=0x558828a26cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:59.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0216195700 1 -- 172.21.15.167:0/2406251614 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997906265 0 0) 0x558828973bd0 con 0x558828a26920 2023-10-05T19:50:59.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0216996700 1 -- 172.21.15.167:0/2406251614 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558828a27530 con 0x558828a2af00 2023-10-05T19:50:59.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0216996700 1 --2- 172.21.15.167:0/2406251614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 0x558828a2d2e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f020000a5d0 tx=0x7f0200005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f76f74478ecefd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0216195700 1 -- 172.21.15.167:0/2406251614 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02000086a0 con 0x558828a2af00 2023-10-05T19:50:59.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0216195700 1 -- 172.21.15.167:0/2406251614 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200008800 con 0x558828a2af00 2023-10-05T19:50:59.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0216195700 1 -- 172.21.15.167:0/2406251614 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0200008ad0 con 0x558828a2af00 2023-10-05T19:50:59.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 -- 172.21.15.167:0/2406251614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 msgr2=0x558828a2d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:59.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 --2- 172.21.15.167:0/2406251614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 0x558828a2d2e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f020000a5d0 tx=0x7f0200005a50 comp rx=0 tx=0).stop 2023-10-05T19:50:59.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 -- 172.21.15.167:0/2406251614 shutdown_connections 2023-10-05T19:50:59.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 --2- 172.21.15.167:0/2406251614 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 0x558828a2d2e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:59.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 -- 172.21.15.167:0/2406251614 >> 172.21.15.167:0/2406251614 conn(0x558828a22340 msgr2=0x558828a24750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:59.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 -- 172.21.15.167:0/2406251614 shutdown_connections 2023-10-05T19:50:59.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 -- 172.21.15.167:0/2406251614 wait complete. 2023-10-05T19:50:59.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 Processor -- start 2023-10-05T19:50:59.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 -- start start 2023-10-05T19:50:59.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a26920 0x558828a457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.244+0000 7f0219662e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588288f4e30 con 0x558828a26920 2023-10-05T19:50:59.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0217197700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a26920 0x558828a457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0217197700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a26920 0x558828a457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:37396/0 (socket says 172.21.15.167:37396) 2023-10-05T19:50:59.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0217197700 1 -- 172.21.15.167:0/3366348299 learned_addr learned my addr 172.21.15.167:0/3366348299 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:59.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0217197700 1 -- 172.21.15.167:0/3366348299 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200005cf0 con 0x558828a26920 2023-10-05T19:50:59.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0217197700 1 --2- 172.21.15.167:0/3366348299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a26920 0x558828a457e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0210001630 tx=0x7f02100069b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5fd21f903ae720 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0215193700 1 -- 172.21.15.167:0/3366348299 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0210006320 con 0x558828a26920 2023-10-05T19:50:59.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0215193700 1 -- 172.21.15.167:0/3366348299 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02100044c0 con 0x558828a26920 2023-10-05T19:50:59.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0215193700 1 -- 172.21.15.167:0/3366348299 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0210004650 con 0x558828a26920 2023-10-05T19:50:59.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 -- 172.21.15.167:0/3366348299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a26920 msgr2=0x558828a457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:59.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 --2- 172.21.15.167:0/3366348299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a26920 0x558828a457e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0210001630 tx=0x7f02100069b0 comp rx=0 tx=0).stop 2023-10-05T19:50:59.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 -- 172.21.15.167:0/3366348299 shutdown_connections 2023-10-05T19:50:59.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 --2- 172.21.15.167:0/3366348299 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a26920 0x558828a457e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:59.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 -- 172.21.15.167:0/3366348299 >> 172.21.15.167:0/3366348299 conn(0x558828a22340 msgr2=0x558828a413a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:59.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 -- 172.21.15.167:0/3366348299 shutdown_connections 2023-10-05T19:50:59.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 -- 172.21.15.167:0/3366348299 wait complete. 2023-10-05T19:50:59.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 Processor -- start 2023-10-05T19:50:59.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 -- start start 2023-10-05T19:50:59.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 0x55882899c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0219662e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588288c7ed0 con 0x558828a2af00 2023-10-05T19:50:59.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0217197700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 0x55882899c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0217197700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 0x55882899c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:37400/0 (socket says 172.21.15.167:37400) 2023-10-05T19:50:59.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.248+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 learned_addr learned my addr 172.21.15.167:0/2285300052 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:59.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210006c90 con 0x558828a2af00 2023-10-05T19:50:59.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f0217197700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 0x55882899c440 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f02100069f0 tx=0x7f0210014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0210013690 con 0x558828a2af00 2023-10-05T19:50:59.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0210013810 con 0x558828a2af00 2023-10-05T19:50:59.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55882899c980 con 0x558828a2af00 2023-10-05T19:50:59.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0210013b00 con 0x558828a2af00 2023-10-05T19:50:59.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55882899ad40 con 0x558828a2af00 2023-10-05T19:50:59.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f021001a070 con 0x558828a2af00 2023-10-05T19:50:59.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f020f7fe700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f01f8030c50 0x7f01f8033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f0210044e90 con 0x558828a2af00 2023-10-05T19:50:59.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f0216996700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f01f8030c50 0x7f01f8033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a583e0 0x558828a5a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.252+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a5ae30 con 0x558828a583e0 2023-10-05T19:50:59.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0217998700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a583e0 0x558828a5a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0216996700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f01f8030c50 0x7f01f8033100 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0200005a90 tx=0x7f0200015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0217998700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a583e0 0x558828a5a7c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f020800a500 con 0x558828a583e0 2023-10-05T19:50:59.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 20 realm 2023-10-05T19:50:59.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a57a50 con 0x558828a583e0 2023-10-05T19:50:59.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f020800a500 con 0x558828a583e0 2023-10-05T19:50:59.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:50:59.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a5b8e0 con 0x558828a583e0 2023-10-05T19:50:59.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f020800a500 con 0x558828a583e0 2023-10-05T19:50:59.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a5b510 0x558828a5e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a5ee80 con 0x558828a5b510 2023-10-05T19:50:59.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0217197700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a5b510 0x558828a5e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.256+0000 7f0217197700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a5b510 0x558828a5e750 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0210025020 con 0x558828a5b510 2023-10-05T19:50:59.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0219662e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:59.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a5f750 con 0x558828a583e0 2023-10-05T19:50:59.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f020800a500 con 0x558828a583e0 2023-10-05T19:50:59.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0219662e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:59.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0219662e40 20 searching for the correct realm 2023-10-05T19:50:59.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a5f2f0 0x558828a63520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5f2f0 2023-10-05T19:50:59.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0216996700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a5f2f0 0x558828a63520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0216996700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a5f2f0 0x558828a63520 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5b510 2023-10-05T19:50:59.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0210025020 con 0x558828a5b510 2023-10-05T19:50:59.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0217197700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a26920 0x7f02100113e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a26920 2023-10-05T19:50:59.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0217998700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a26920 0x7f02100113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.260+0000 7f0217998700 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a26920 0x7f02100113e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a26920 2023-10-05T19:50:59.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5f2f0 2023-10-05T19:50:59.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5b510 2023-10-05T19:50:59.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0210025020 con 0x558828a5b510 2023-10-05T19:50:59.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5b510 2023-10-05T19:50:59.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0210025020 con 0x558828a5b510 2023-10-05T19:50:59.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.264+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a26920 2023-10-05T19:50:59.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a26920 2023-10-05T19:50:59.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a26920 2023-10-05T19:50:59.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a26920 2023-10-05T19:50:59.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5b510 2023-10-05T19:50:59.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5f2f0 2023-10-05T19:50:59.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.268+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5b510 2023-10-05T19:50:59.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5f2f0 2023-10-05T19:50:59.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5f2f0 2023-10-05T19:50:59.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.272+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a26920 2023-10-05T19:50:59.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a26920 2023-10-05T19:50:59.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a583e0 2023-10-05T19:50:59.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a26920 2023-10-05T19:50:59.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a26920 2023-10-05T19:50:59.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5f2f0 2023-10-05T19:50:59.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a26920 2023-10-05T19:50:59.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a26920 2023-10-05T19:50:59.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5b510 2023-10-05T19:50:59.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5b510 2023-10-05T19:50:59.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.276+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5f2f0 2023-10-05T19:50:59.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5b510 2023-10-05T19:50:59.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a63b50 con 0x558828a5b510 2023-10-05T19:50:59.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0219662e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:59.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0219662e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:59.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0219662e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:59.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0219662e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:59.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a602c0 con 0x558828a583e0 2023-10-05T19:50:59.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a606f0 con 0x558828a5b510 2023-10-05T19:50:59.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.280+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a60b20 con 0x558828a5b510 2023-10-05T19:50:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a644b0 con 0x558828a5f2f0 2023-10-05T19:50:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64c10 con 0x558828a5b510 2023-10-05T19:50:59.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:59.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a65fd0 con 0x558828a5f2f0 2023-10-05T19:50:59.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.284+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a65fd0 con 0x558828a5b510 2023-10-05T19:50:59.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a65fd0 con 0x558828a26920 2023-10-05T19:50:59.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a26920 2023-10-05T19:50:59.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5f2f0 2023-10-05T19:50:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.288+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5b510 2023-10-05T19:50:59.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5b510 2023-10-05T19:50:59.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a26920 2023-10-05T19:50:59.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a26920 2023-10-05T19:50:59.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a26920 2023-10-05T19:50:59.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.292+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a26920 2023-10-05T19:50:59.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5b510 2023-10-05T19:50:59.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5f2f0 2023-10-05T19:50:59.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5b510 2023-10-05T19:50:59.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5f2f0 2023-10-05T19:50:59.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.296+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208014040 con 0x558828a583e0 2023-10-05T19:50:59.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:50:59.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:50:59.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5f2f0 2023-10-05T19:50:59.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a26920 2023-10-05T19:50:59.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:50:59.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a583e0 2023-10-05T19:50:59.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:50:59.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a26920 2023-10-05T19:50:59.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:50:59.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.300+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5f2f0 2023-10-05T19:50:59.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a26920 2023-10-05T19:50:59.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:50:59.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5b510 2023-10-05T19:50:59.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5b510 2023-10-05T19:50:59.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5f2f0 2023-10-05T19:50:59.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.304+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5b510 2023-10-05T19:50:59.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 30 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64860 con 0x558828a5b510 2023-10-05T19:50:59.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f021003c040 con 0x558828a5b510 2023-10-05T19:50:59.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:50:59.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:50:59.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:50:59.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:50:59.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a64fc0 con 0x558828a5b510 2023-10-05T19:50:59.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:50:59.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:59.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a65370 con 0x558828a583e0 2023-10-05T19:50:59.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:50:59.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:50:59.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a640b0 con 0x558828a5b510 2023-10-05T19:50:59.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:50:59.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:50:59.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.308+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a640c0 con 0x558828a5b510 2023-10-05T19:50:59.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:50:59.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:50:59.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a65cb0 con 0x558828a26920 2023-10-05T19:50:59.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 zone default found 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 4 Realm: () 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 zonegroup default 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a65cb0 con 0x558828a26920 2023-10-05T19:50:59.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:50:59.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a67630 con 0x558828a5f2f0 2023-10-05T19:50:59.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 20 rados->read ofs=0 len=0 2023-10-05T19:50:59.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.312+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a679e0 con 0x558828a5f2f0 2023-10-05T19:50:59.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.316+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.316+0000 7f0219662e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:50:59.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.316+0000 7f0219662e40 20 started sync module instance, tier type = 2023-10-05T19:50:59.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.316+0000 7f0219662e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:50:59.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.316+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a66cf0 con 0x558828a5b510 2023-10-05T19:50:59.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.316+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v30'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:50:59.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.316+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94043285903136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a66cf0 con 0x558828a5b510 2023-10-05T19:50:59.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.316+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a682c0 con 0x558828a583e0 2023-10-05T19:50:59.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.320+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v30'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:50:59.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.320+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94043285903136] v30'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:50:59.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.320+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94043285909744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a68280 con 0x558828a583e0 2023-10-05T19:50:59.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.320+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a68bb0 con 0x558828a5b510 2023-10-05T19:50:59.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.320+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94043285909744] v30'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:50:59.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.320+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v30'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:50:59.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.320+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94043285915616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a68280 con 0x558828a5b510 2023-10-05T19:50:59.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.320+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a694a0 con 0x558828a26920 2023-10-05T19:50:59.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.324+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v30'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:50:59.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.324+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94043285917616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a698f0 con 0x558828a26920 2023-10-05T19:50:59.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.324+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a6a300 con 0x558828a5b510 2023-10-05T19:50:59.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.324+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94043285915616] v30'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:50:59.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.324+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94043285917616] v30'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:50:59.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.324+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v30'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:50:59.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.324+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94043285918720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a69850 con 0x558828a5b510 2023-10-05T19:50:59.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.324+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a6a7f0 con 0x558828a5f2f0 2023-10-05T19:50:59.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.328+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v30'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.328+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94043285922560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a6b090 con 0x558828a5f2f0 2023-10-05T19:50:59.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.328+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a6baa0 con 0x558828a5f2f0 2023-10-05T19:50:59.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.328+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94043285918720] v30'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:50:59.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.328+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94043285922560] v30'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.328+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v30'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.328+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94043285927344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a6be50 con 0x558828a5f2f0 2023-10-05T19:50:59.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.328+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a6c6f0 con 0x558828a26920 2023-10-05T19:50:59.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94043285927344] v30'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200012450 con 0x558828a5f2f0 2023-10-05T19:50:59.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v30'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:50:59.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94043285930496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a6cb40 con 0x558828a26920 2023-10-05T19:50:59.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 20 add_watcher() i=0 2023-10-05T19:50:59.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 20 add_watcher() i=1 2023-10-05T19:50:59.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 20 add_watcher() i=2 2023-10-05T19:50:59.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 20 add_watcher() i=3 2023-10-05T19:50:59.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 20 add_watcher() i=4 2023-10-05T19:50:59.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 20 add_watcher() i=5 2023-10-05T19:50:59.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 20 add_watcher() i=6 2023-10-05T19:50:59.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94043285930496] v30'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:50:59.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 20 add_watcher() i=7 2023-10-05T19:50:59.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:50:59.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a6fbe0 con 0x558828a583e0 2023-10-05T19:50:59.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:50:59.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.332+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94043285931600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a6cf90 con 0x558828a583e0 2023-10-05T19:50:59.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94043285931600] v30'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:50:59.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f01e8fe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:50:59.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0219662e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:50:59.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0219662e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:50:59.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0219662e40 1 Processor -- start 2023-10-05T19:50:59.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0219662e40 1 -- start start 2023-10-05T19:50:59.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0219662e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0219662e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558828a7aa10 con 0x558828a7a100 2023-10-05T19:50:59.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0216996700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0216996700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:37408/0 (socket says 172.21.15.167:37408) 2023-10-05T19:50:59.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0216996700 1 -- 172.21.15.167:0/355028970 learned_addr learned my addr 172.21.15.167:0/355028970 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:59.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0216996700 1 -- 172.21.15.167:0/355028970 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558828a7ab50 con 0x558828a7a100 2023-10-05T19:50:59.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.336+0000 7f0216996700 1 --2- 172.21.15.167:0/355028970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7a4d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0200000c00 tx=0x7f0200012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9a83ce4c209969 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0163fff700 1 -- 172.21.15.167:0/355028970 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f020002d040 con 0x558828a7a100 2023-10-05T19:50:59.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0163fff700 1 -- 172.21.15.167:0/355028970 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200028890 con 0x558828a7a100 2023-10-05T19:50:59.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0163fff700 1 -- 172.21.15.167:0/355028970 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0200028a20 con 0x558828a7a100 2023-10-05T19:50:59.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 -- 172.21.15.167:0/355028970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 msgr2=0x558828a7a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:50:59.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 --2- 172.21.15.167:0/355028970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7a4d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0200000c00 tx=0x7f0200012000 comp rx=0 tx=0).stop 2023-10-05T19:50:59.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 -- 172.21.15.167:0/355028970 shutdown_connections 2023-10-05T19:50:59.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 --2- 172.21.15.167:0/355028970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7a4d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:50:59.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 -- 172.21.15.167:0/355028970 >> 172.21.15.167:0/355028970 conn(0x558828a754c0 msgr2=0x558828a73670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:50:59.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 -- 172.21.15.167:0/355028970 shutdown_connections 2023-10-05T19:50:59.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 -- 172.21.15.167:0/355028970 wait complete. 2023-10-05T19:50:59.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 Processor -- start 2023-10-05T19:50:59.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 -- start start 2023-10-05T19:50:59.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0219662e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558828a80a80 con 0x558828a7a100 2023-10-05T19:50:59.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0216996700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0216996700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:37422/0 (socket says 172.21.15.167:37422) 2023-10-05T19:50:59.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 learned_addr learned my addr 172.21.15.167:0/1475205898 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:50:59.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558828a27530 con 0x558828a7a100 2023-10-05T19:50:59.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.340+0000 7f0216996700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7fa80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0200000c00 tx=0x7f020002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.344+0000 7f01627fc700 1 -- 172.21.15.167:0/1475205898 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0200033980 con 0x558828a7a100 2023-10-05T19:50:59.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.344+0000 7f01627fc700 1 -- 172.21.15.167:0/1475205898 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020003f070 con 0x558828a7a100 2023-10-05T19:50:59.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.344+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558828a80080 con 0x558828a7a100 2023-10-05T19:50:59.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.344+0000 7f01627fc700 1 -- 172.21.15.167:0/1475205898 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0200033b60 con 0x558828a7a100 2023-10-05T19:50:59.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.344+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558828a804c0 con 0x558828a7a100 2023-10-05T19:50:59.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.344+0000 7f01627fc700 1 -- 172.21.15.167:0/1475205898 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f0200033cc0 con 0x558828a7a100 2023-10-05T19:50:59.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.344+0000 7f01627fc700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0158030c50 0x7f0158033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.344+0000 7f01627fc700 1 -- 172.21.15.167:0/1475205898 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6057+0+0 (secure 0 0 0) 0x7f0200041070 con 0x558828a7a100 2023-10-05T19:50:59.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.344+0000 7f0217998700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0158030c50 0x7f0158033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a8a670 0x558828a8ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a8d120 con 0x558828a8a670 2023-10-05T19:50:59.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0217197700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a8a670 0x558828a8ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0217998700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0158030c50 0x7f0158033100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x558828a6fd20 tx=0x7f020800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0217197700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a8a670 0x558828a8ca80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v30'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:50:59.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a8ddf0 0x558828a901d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a90900 con 0x558828a8ddf0 2023-10-05T19:50:59.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0216996700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a8ddf0 0x558828a901d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.348+0000 7f0216996700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a8ddf0 0x558828a901d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.352+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a8ddf0 2023-10-05T19:50:59.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.352+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a915d0 0x558828a939e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.352+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a94110 con 0x558828a915d0 2023-10-05T19:50:59.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.352+0000 7f0217998700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a915d0 0x558828a939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.352+0000 7f0217998700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a915d0 0x558828a939e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.356+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:50:59.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.356+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a94de0 0x558828a971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:50:59.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.356+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a97920 con 0x558828a94de0 2023-10-05T19:50:59.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.356+0000 7f0217197700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a94de0 0x558828a971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:50:59.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.356+0000 7f0217197700 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a94de0 0x558828a971f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:50:59.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.356+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v30'173 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:50:59.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.356+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a97f70 con 0x558828a8a670 2023-10-05T19:50:59.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.360+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v30'47 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:50:59.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.360+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a98590 con 0x558828a915d0 2023-10-05T19:50:59.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.360+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v30'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:50:59.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.360+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a98bb0 con 0x558828a8a670 2023-10-05T19:50:59.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.364+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(7 gc.6 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:50:59.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.364+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a990a0 con 0x558828a94de0 2023-10-05T19:50:59.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.364+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(8 gc.7 [create,call,call,call] v30'30 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:50:59.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.364+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a990a0 con 0x558828a8a670 2023-10-05T19:50:59.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.368+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(9 gc.8 [create,call,call,call] v30'19 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:50:59.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.368+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a990a0 con 0x558828a8a670 2023-10-05T19:50:59.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.368+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(10 gc.9 [create,call,call,call] v30'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:50:59.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.368+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a990a0 con 0x558828a8a670 2023-10-05T19:50:59.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.372+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(11 gc.10 [create,call,call,call] v30'48 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:50:59.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.372+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a99310 con 0x558828a915d0 2023-10-05T19:50:59.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.372+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:50:59.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.372+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a99710 con 0x558828a8a670 2023-10-05T19:50:59.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.376+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(13 gc.12 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:50:59.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.376+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a99710 con 0x558828a94de0 2023-10-05T19:50:59.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.376+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(14 gc.13 [create,call,call,call] v30'38 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:50:59.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.376+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a99710 con 0x558828a94de0 2023-10-05T19:50:59.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.380+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(15 gc.14 [create,call,call,call] v30'174 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:50:59.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.380+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a99710 con 0x558828a8a670 2023-10-05T19:50:59.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.388+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(16 gc.15 [create,call,call,call] v30'38 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:50:59.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:50:59.388+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x558828a99710 con 0x558828a8a670 2023-10-05T19:51:04.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94043285903136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f014c001100 con 0x558828a5b510 2023-10-05T19:51:04.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch ping cookie 94043285915616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f014c002ca0 con 0x558828a5b510 2023-10-05T19:51:04.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.d 7:b4812045:::notify.4:head [watch ping cookie 94043285918720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f014c003670 con 0x558828a5b510 2023-10-05T19:51:04.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94043285909744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f014c003ff0 con 0x558828a583e0 2023-10-05T19:51:04.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94043285931600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f014c004a00 con 0x558828a583e0 2023-10-05T19:51:04.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch ping cookie 94043285917616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f014c002ca0 con 0x558828a26920 2023-10-05T19:51:04.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch ping cookie 94043285930496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f014c003670 con 0x558828a26920 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch ping cookie 94043285922560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f014c005cb0 con 0x558828a5f2f0 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch ping cookie 94043285927344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f014c006550 con 0x558828a5f2f0 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=31}) v3 -- 0x7f014c004140 con 0x558828a2af00 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- ping magic: 0 v1 -- 0x7f014c004ac0 con 0x558828a5b510 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- ping magic: 0 v1 -- 0x7f014c004c50 con 0x558828a5f2f0 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- ping magic: 0 v1 -- 0x7f014c005d00 con 0x558828a583e0 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- ping magic: 0 v1 -- 0x7f014c005e40 con 0x558828a26920 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_map(31..32 src has 1..32) v4 ==== 751+0+0 (crc 0 0 0) 0x7f0210051040 con 0x558828a5b510 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(102 notify.0 [watch ping cookie 94043285903136] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== mon.0 v2:172.21.15.118:3300/0 6 ==== osd_map(31..32 src has 1..32) v4 ==== 751+0+0 (secure 0 0 0) 0x7f0210042490 con 0x558828a2af00 2023-10-05T19:51:04.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(104 notify.4 [watch ping cookie 94043285918720] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:04.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_map(31..32 src has 1..32) v4 ==== 751+0+0 (crc 0 0 0) 0x7f0210011920 con 0x558828a5b510 2023-10-05T19:51:04.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(103 notify.2 [watch ping cookie 94043285915616] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:04.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(105 notify.1 [watch ping cookie 94043285909744] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:51:04.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(109 notify.5 [watch ping cookie 94043285922560] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a5f2f0 2023-10-05T19:51:04.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_map(31..32 src has 1..32) v4 ==== 751+0+0 (crc 0 0 0) 0x7f0208011040 con 0x558828a583e0 2023-10-05T19:51:04.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_map(31..32 src has 1..32) v4 ==== 751+0+0 (crc 0 0 0) 0x7f0200052040 con 0x558828a5f2f0 2023-10-05T19:51:04.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 data_loggenerations_metadata [watch ping cookie 94043285931600] v0'0 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:51:04.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(110 notify.6 [watch ping cookie 94043285927344] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a5f2f0 2023-10-05T19:51:04.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(107 notify.3 [watch ping cookie 94043285917616] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:51:04.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f020f7fe700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_map(31..32 src has 1..32) v4 ==== 751+0+0 (crc 0 0 0) 0x7f020803c0d0 con 0x558828a26920 2023-10-05T19:51:04.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:04.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(108 notify.7 [watch ping cookie 94043285930496] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:51:09.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94043285903136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c003670 con 0x558828a5b510 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch ping cookie 94043285915616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c003a80 con 0x558828a5b510 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 7.d 7:b4812045:::notify.4:head [watch ping cookie 94043285918720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c002ca0 con 0x558828a5b510 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:114 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94043285909744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c004d90 con 0x558828a583e0 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94043285931600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c005660 con 0x558828a583e0 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:116 7.e 7:7759931f:::notify.3:head [watch ping cookie 94043285917616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c003670 con 0x558828a26920 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch ping cookie 94043285930496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c003a80 con 0x558828a26920 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:118 7.3 7:c609908c:::notify.5:head [watch ping cookie 94043285922560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c002ca0 con 0x558828a5f2f0 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:119 7.14 7:2b04a3e9:::notify.6:head [watch ping cookie 94043285927344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c004d90 con 0x558828a5f2f0 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=33}) v3 -- 0x7f014c005a40 con 0x558828a2af00 2023-10-05T19:51:09.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- ping magic: 0 v1 -- 0x7f014c005660 con 0x558828a5b510 2023-10-05T19:51:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- ping magic: 0 v1 -- 0x7f014c0057a0 con 0x558828a5f2f0 2023-10-05T19:51:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- ping magic: 0 v1 -- 0x7f014c003670 con 0x558828a583e0 2023-10-05T19:51:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- ping magic: 0 v1 -- 0x7f014c003800 con 0x558828a26920 2023-10-05T19:51:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(111 notify.0 [watch ping cookie 94043285903136] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(112 notify.2 [watch ping cookie 94043285915616] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:09.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(113 notify.4 [watch ping cookie 94043285918720] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:09.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(116 notify.3 [watch ping cookie 94043285917616] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:51:09.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(118 notify.5 [watch ping cookie 94043285922560] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a5f2f0 2023-10-05T19:51:09.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(117 notify.7 [watch ping cookie 94043285930496] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:51:09.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(119 notify.6 [watch ping cookie 94043285927344] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a5f2f0 2023-10-05T19:51:09.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(114 notify.1 [watch ping cookie 94043285909744] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:51:09.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:09.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(115 data_loggenerations_metadata [watch ping cookie 94043285931600] v0'0 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:51:14.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:120 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94043285903136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c003990 con 0x558828a5b510 2023-10-05T19:51:14.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 7.15 7:a93a5511:::notify.2:head [watch ping cookie 94043285915616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c000b60 con 0x558828a5b510 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:122 7.d 7:b4812045:::notify.4:head [watch ping cookie 94043285918720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c003190 con 0x558828a5b510 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:123 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94043285909744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c005280 con 0x558828a583e0 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:124 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94043285931600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c006470 con 0x558828a583e0 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:125 7.e 7:7759931f:::notify.3:head [watch ping cookie 94043285917616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c006d10 con 0x558828a26920 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:126 7.9 7:93e5b521:::notify.7:head [watch ping cookie 94043285930496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c0075b0 con 0x558828a26920 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:127 7.3 7:c609908c:::notify.5:head [watch ping cookie 94043285922560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c003990 con 0x558828a5f2f0 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:128 7.14 7:2b04a3e9:::notify.6:head [watch ping cookie 94043285927344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f014c000b60 con 0x558828a5f2f0 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- ping magic: 0 v1 -- 0x7f014c005a40 con 0x558828a5b510 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- ping magic: 0 v1 -- 0x7f014c005280 con 0x558828a5f2f0 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- ping magic: 0 v1 -- 0x7f014c005410 con 0x558828a583e0 2023-10-05T19:51:14.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f020ffff700 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- ping magic: 0 v1 -- 0x7f014c006470 con 0x558828a26920 2023-10-05T19:51:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(121 notify.2 [watch ping cookie 94043285915616] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(128 notify.6 [watch ping cookie 94043285927344] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a5f2f0 2023-10-05T19:51:14.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(122 notify.4 [watch ping cookie 94043285918720] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:14.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(120 notify.0 [watch ping cookie 94043285903136] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:14.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(124 data_loggenerations_metadata [watch ping cookie 94043285931600] v0'0 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:51:14.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(125 notify.3 [watch ping cookie 94043285917616] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:51:14.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(126 notify.7 [watch ping cookie 94043285930496] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:51:14.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(123 notify.1 [watch ping cookie 94043285909744] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:51:14.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.256+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(127 notify.5 [watch ping cookie 94043285922560] v0'0 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a5f2f0 2023-10-05T19:51:14.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.348+0000 7f0162ffd700 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=31}) v3 -- 0x7f0140001dc0 con 0x558828a7a100 2023-10-05T19:51:14.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.348+0000 7f0162ffd700 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- ping magic: 0 v1 -- 0x7f0140002150 con 0x558828a8a670 2023-10-05T19:51:14.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.352+0000 7f01627fc700 1 -- 172.21.15.167:0/1475205898 <== mon.0 v2:172.21.15.118:3300/0 6 ==== osd_map(31..32 src has 1..32) v4 ==== 751+0+0 (secure 0 0 0) 0x7f0200046e40 con 0x558828a7a100 2023-10-05T19:51:14.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.352+0000 7f01627fc700 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f015803cc50 con 0x558828a94de0 2023-10-05T19:51:14.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.352+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(17 gc.16 [create,call,call,call] v30'49 uv0 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.352+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a99670 con 0x558828a915d0 2023-10-05T19:51:14.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.352+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.352+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a99b00 con 0x558828a8a670 2023-10-05T19:51:14.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.356+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.356+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a99b00 con 0x558828a94de0 2023-10-05T19:51:14.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.356+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'175 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.356+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a99580 con 0x558828a8a670 2023-10-05T19:51:14.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.360+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.360+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a85fc0 con 0x558828a8a670 2023-10-05T19:51:14.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.364+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.364+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a85fc0 con 0x558828a915d0 2023-10-05T19:51:14.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.364+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.364+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a85fc0 con 0x558828a8a670 2023-10-05T19:51:14.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.368+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.368+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a891c0 con 0x558828a915d0 2023-10-05T19:51:14.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.368+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.368+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a85fc0 con 0x558828a915d0 2023-10-05T19:51:14.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.372+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'33 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.372+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a85fc0 con 0x558828a915d0 2023-10-05T19:51:14.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.372+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.372+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a891c0 con 0x558828a8a670 2023-10-05T19:51:14.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.376+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'30 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.376+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a891c0 con 0x558828a94de0 2023-10-05T19:51:14.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.376+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'31 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.376+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a85fc0 con 0x558828a8a670 2023-10-05T19:51:14.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.380+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'40 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.380+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a85fc0 con 0x558828a94de0 2023-10-05T19:51:14.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.380+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'39 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.380+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a891c0 con 0x558828a8ddf0 2023-10-05T19:51:14.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.384+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a8ddf0 2023-10-05T19:51:14.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.388+0000 7f01477fe700 20 reqs_thread_entry: start 2023-10-05T19:51:14.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.388+0000 7f0219662e40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:14.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.388+0000 7f01457fa700 20 reqs_thread_entry: start 2023-10-05T19:51:14.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.388+0000 7f0219662e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:14.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.388+0000 7f01337fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:44 2023 2023-10-05T19:51:14.396 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:14.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.388+0000 7f0132ffd700 20 reqs_thread_entry: start 2023-10-05T19:51:14.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.388+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.388+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(33 gc.0 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.388+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(34 gc.0 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:35 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(35 gc.0 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:36 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8ddf0 2023-10-05T19:51:14.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(36 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0200039020 con 0x558828a8ddf0 2023-10-05T19:51:14.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:37 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8ddf0 2023-10-05T19:51:14.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(37 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0200039020 con 0x558828a8ddf0 2023-10-05T19:51:14.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:38 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8ddf0 2023-10-05T19:51:14.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(38 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0200039020 con 0x558828a8ddf0 2023-10-05T19:51:14.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.392+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:39 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(39 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:40 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a915d0 2023-10-05T19:51:14.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(40 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(41 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(42 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:43 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(43 gc.3 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.396+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:44 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(44 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:45 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(45 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:46 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(46 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(47 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:48 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(48 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a915d0 2023-10-05T19:51:14.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(49 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.400+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:50 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.404+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(50 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.404+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.404+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(51 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.404+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.404+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(52 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.404+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:53 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.404+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(53 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.404+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:54 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(54 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(55 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:56 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(56 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(57 gc.8 [call out=15b] v0'0 uv18 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:58 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(58 gc.8 [call out=24b] v0'0 uv18 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.408+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:59 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.412+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(59 gc.8 [call out=1700b] v0'0 uv18 ondisk = 0) v8 ==== 148+0+1700 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.412+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.412+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(60 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.412+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:61 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.412+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(61 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.412+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:62 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.412+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(62 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.412+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(63 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(64 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:65 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(65 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:66 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(66 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:67 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a915d0 2023-10-05T19:51:14.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(67 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.416+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:68 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.420+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(68 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.420+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:69 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.420+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(69 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.420+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:70 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.420+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(70 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.420+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.420+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(71 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.420+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:72 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.420+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(72 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:73 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(73 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:74 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(74 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:75 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(75 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(76 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(77 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.424+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.428+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(78 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.428+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.428+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(79 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.428+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:80 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.428+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(80 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.428+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:81 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.428+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(81 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.428+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:82 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(82 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:83 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(83 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:84 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(84 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:85 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a915d0 2023-10-05T19:51:14.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(85 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:86 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(86 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.432+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:87 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.436+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(87 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.436+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.436+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(88 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.436+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.436+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(89 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.436+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:90 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.436+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(90 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.436+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:91 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.440+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(91 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.440+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:92 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.440+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(92 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.440+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.440+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(93 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.440+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.440+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(94 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.444+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.444+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.444+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.444+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(96 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.444+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.444+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(97 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.444+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.448+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.448+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.448+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(99 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.448+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a915d0 2023-10-05T19:51:14.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.448+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(100 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.448+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.448+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.448+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(102 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(103 gc.23 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(105 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a915d0 2023-10-05T19:51:14.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(106 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.452+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.456+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.456+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.456+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(108 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.456+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a915d0 2023-10-05T19:51:14.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.456+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(109 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.456+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.456+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.456+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(111 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a915d0 2023-10-05T19:51:14.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(112 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a915d0 2023-10-05T19:51:14.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0217998700 1 -- 172.21.15.167:0/1475205898 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0208033040 con 0x558828a915d0 2023-10-05T19:51:14.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(114 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 46 ==== osd_op_reply(115 gc.27 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.460+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.464+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 47 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.464+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.464+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(117 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.464+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.464+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(118 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.464+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.464+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.464+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.468+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 48 ==== osd_op_reply(120 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.468+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8a670 2023-10-05T19:51:14.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.468+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 49 ==== osd_op_reply(121 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.468+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8a670 2023-10-05T19:51:14.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.468+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.0 v2:172.21.15.118:6800/26580 50 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a8a670 2023-10-05T19:51:14.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.468+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.468+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(123 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a94de0 2023-10-05T19:51:14.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(124 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a94de0 2023-10-05T19:51:14.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f021005f040 con 0x558828a94de0 2023-10-05T19:51:14.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8ddf0 2023-10-05T19:51:14.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(126 gc.31 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0200039020 con 0x558828a8ddf0 2023-10-05T19:51:14.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af7cc0 con 0x558828a8ddf0 2023-10-05T19:51:14.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(127 gc.31 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f0200039020 con 0x558828a8ddf0 2023-10-05T19:51:14.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828af8cd0 con 0x558828a8ddf0 2023-10-05T19:51:14.481 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.472+0000 7f0216996700 1 -- 172.21.15.167:0/1475205898 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f0200039020 con 0x558828a8ddf0 2023-10-05T19:51:14.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.476+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:129 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94043285903136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a3be10 con 0x558828a5b510 2023-10-05T19:51:14.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.476+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(129 notify.0 [watch unwatch cookie 94043285903136] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:14.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.476+0000 7f0219662e40 20 remove_watcher() i=0 2023-10-05T19:51:14.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.476+0000 7f0219662e40 2 removed watcher, disabling cache 2023-10-05T19:51:14.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.476+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:130 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94043285909744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a65720 con 0x558828a583e0 2023-10-05T19:51:14.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.480+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(130 notify.1 [watch unwatch cookie 94043285909744] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:51:14.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.480+0000 7f0219662e40 20 remove_watcher() i=1 2023-10-05T19:51:14.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.480+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:131 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94043285915616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a65720 con 0x558828a5b510 2023-10-05T19:51:14.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.480+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(131 notify.2 [watch unwatch cookie 94043285915616] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:14.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.480+0000 7f0219662e40 20 remove_watcher() i=2 2023-10-05T19:51:14.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.480+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:132 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94043285917616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a687e0 con 0x558828a26920 2023-10-05T19:51:14.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.484+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(132 notify.3 [watch unwatch cookie 94043285917616] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:51:14.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.484+0000 7f0219662e40 20 remove_watcher() i=3 2023-10-05T19:51:14.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.484+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:133 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94043285918720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a687e0 con 0x558828a5b510 2023-10-05T19:51:14.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.484+0000 7f0217197700 1 -- 172.21.15.167:0/2285300052 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(133 notify.4 [watch unwatch cookie 94043285918720] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f021005f040 con 0x558828a5b510 2023-10-05T19:51:14.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.488+0000 7f0219662e40 20 remove_watcher() i=4 2023-10-05T19:51:14.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.488+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:134 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94043285922560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a687e0 con 0x558828a5f2f0 2023-10-05T19:51:14.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.488+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(134 notify.5 [watch unwatch cookie 94043285922560] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a5f2f0 2023-10-05T19:51:14.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.488+0000 7f0219662e40 20 remove_watcher() i=5 2023-10-05T19:51:14.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.488+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:135 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94043285927344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a6a300 con 0x558828a5f2f0 2023-10-05T19:51:14.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.492+0000 7f0216996700 1 -- 172.21.15.167:0/2285300052 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(135 notify.6 [watch unwatch cookie 94043285927344] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0200039020 con 0x558828a5f2f0 2023-10-05T19:51:14.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.492+0000 7f0219662e40 20 remove_watcher() i=6 2023-10-05T19:51:14.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.492+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:136 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94043285930496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a6b5b0 con 0x558828a26920 2023-10-05T19:51:14.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.492+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(136 notify.7 [watch unwatch cookie 94043285930496] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a26920 2023-10-05T19:51:14.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.492+0000 7f0219662e40 20 remove_watcher() i=7 2023-10-05T19:51:14.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f01e8fe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:14.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:137 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94043285931600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558828a6c200 con 0x558828a583e0 2023-10-05T19:51:14.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(137 data_loggenerations_metadata [watch unwatch cookie 94043285931600] v32'176 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0208033040 con 0x558828a583e0 2023-10-05T19:51:14.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a5b510 msgr2=0x558828a5e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a5b510 0x558828a5e750 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a583e0 msgr2=0x558828a5a7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a583e0 0x558828a5a7c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a26920 msgr2=0x7f02100113e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a26920 0x7f02100113e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a5f2f0 msgr2=0x558828a63520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a5f2f0 0x558828a63520 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f01f8030c50 msgr2=0x7f01f8033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f01f8030c50 0x7f01f8033100 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0200005a90 tx=0x7f0200015000 comp rx=0 tx=0).stop 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0217998700 1 -- 172.21.15.167:0/2285300052 reap_dead start 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 msgr2=0x55882899c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 0x55882899c440 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f02100069f0 tx=0x7f0210014000 comp rx=0 tx=0).stop 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 shutdown_connections 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/2285300052 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a2af00 0x55882899c440 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 >> 172.21.15.167:0/2285300052 conn(0x558828a22340 msgr2=0x558828a3fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 shutdown_connections 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/2285300052 wait complete. 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a8a670 msgr2=0x558828a8ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558828a8a670 0x558828a8ca80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a94de0 msgr2=0x558828a971f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558828a94de0 0x558828a971f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a8ddf0 msgr2=0x558828a901d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x558828a8ddf0 0x558828a901d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a915d0 msgr2=0x558828a939e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558828a915d0 0x558828a939e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0158030c50 msgr2=0x7f0158033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f0158030c50 0x7f0158033100 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x558828a6fd20 tx=0x7f020800e040 comp rx=0 tx=0).stop 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 msgr2=0x558828a7fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 --2- 172.21.15.167:0/1475205898 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558828a7a100 0x558828a7fa80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0200000c00 tx=0x7f020002c000 comp rx=0 tx=0).stop 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0217197700 1 -- 172.21.15.167:0/1475205898 reap_dead start 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 shutdown_connections 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 >> 172.21.15.167:0/1475205898 conn(0x558828a754c0 msgr2=0x558828a735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.496+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 shutdown_connections 2023-10-05T19:51:14.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.500+0000 7f0219662e40 1 -- 172.21.15.167:0/1475205898 wait complete. 2023-10-05T19:51:14.509 INFO:teuthology.orchestra.run.smithi167.stdout:[ 2023-10-05T19:51:14.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:14.509 INFO:teuthology.orchestra.run.smithi167.stdout: "tag": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.868088250697738021\u0000", 2023-10-05T19:51:14.509 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:50:59.200469+0000", 2023-10-05T19:51:14.509 INFO:teuthology.orchestra.run.smithi167.stdout: "objs": [ 2023-10-05T19:51:14.509 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:14.509 INFO:teuthology.orchestra.run.smithi167.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T19:51:14.509 INFO:teuthology.orchestra.run.smithi167.stdout: "oid": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__1", 2023-10-05T19:51:14.509 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "", 2023-10-05T19:51:14.510 INFO:teuthology.orchestra.run.smithi167.stdout: "instance": "" 2023-10-05T19:51:14.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:14.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:14.510 INFO:teuthology.orchestra.run.smithi167.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T19:51:14.510 INFO:teuthology.orchestra.run.smithi167.stdout: "oid": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__2", 2023-10-05T19:51:14.510 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "", 2023-10-05T19:51:14.510 INFO:teuthology.orchestra.run.smithi167.stdout: "instance": "" 2023-10-05T19:51:14.510 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:14.510 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: "oid": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__3", 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "", 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: "instance": "" 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: "oid": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__4", 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "", 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: "instance": "" 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:14.511 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: "oid": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__5", 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "", 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: "instance": "" 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: "oid": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__6", 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "", 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: "instance": "" 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:14.512 INFO:teuthology.orchestra.run.smithi167.stdout: "pool": "default.rgw.buckets.data", 2023-10-05T19:51:14.513 INFO:teuthology.orchestra.run.smithi167.stdout: "oid": "e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__7", 2023-10-05T19:51:14.513 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "", 2023-10-05T19:51:14.513 INFO:teuthology.orchestra.run.smithi167.stdout: "instance": "" 2023-10-05T19:51:14.513 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:51:14.513 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:51:14.513 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:51:14.513 INFO:teuthology.orchestra.run.smithi167.stdout:] 2023-10-05T19:51:14.514 DEBUG:tasks.util.rgw: json result: [{'tag': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.868088250697738021\x00', 'time': '2023-10-05T19:50:59.200469+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__7', 'key': '', 'instance': ''}]}] 2023-10-05T19:51:14.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2023-10-05T19:51:14.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2023-10-05T19:51:14.515 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2023-10-05T19:51:14.552 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:51:14.552 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:51:14.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.544+0000 7efbfdcfde40 1 Processor -- start 2023-10-05T19:51:14.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.544+0000 7efbfdcfde40 1 -- start start 2023-10-05T19:51:14.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557d08860b20 0x557d08860ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557d087abc00 con 0x557d08861430 2023-10-05T19:51:14.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x557d08768ee0 con 0x557d08860b20 2023-10-05T19:51:14.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfb832700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557d08860b20 0x557d08860ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbf3031700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x557d08861430 0x557d08861ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:42514/0 (socket says 172.21.15.167:42514) 2023-10-05T19:51:14.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbf3031700 1 -- 172.21.15.167:0/4096289353 learned_addr learned my addr 172.21.15.167:0/4096289353 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:51:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfb832700 1 -- 172.21.15.167:0/4096289353 >> v1:172.21.15.118:6789/0 conn(0x557d08861430 legacy=0x557d08861ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfb832700 1 -- 172.21.15.167:0/4096289353 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d088625d0 con 0x557d08860b20 2023-10-05T19:51:14.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfb832700 1 --2- 172.21.15.167:0/4096289353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d08860ef0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efbec00a5d0 tx=0x7efbec005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d157b03ce28b8fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfb031700 1 -- 172.21.15.167:0/4096289353 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbec0086a0 con 0x557d08860b20 2023-10-05T19:51:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfb031700 1 -- 172.21.15.167:0/4096289353 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec008800 con 0x557d08860b20 2023-10-05T19:51:14.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfb031700 1 -- 172.21.15.167:0/4096289353 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbec008ad0 con 0x557d08860b20 2023-10-05T19:51:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4096289353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 msgr2=0x557d08860ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4096289353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d08860ef0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efbec00a5d0 tx=0x7efbec005a50 comp rx=0 tx=0).stop 2023-10-05T19:51:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4096289353 shutdown_connections 2023-10-05T19:51:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4096289353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d08860ef0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4096289353 >> 172.21.15.167:0/4096289353 conn(0x557d087d4590 msgr2=0x557d087d4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4096289353 shutdown_connections 2023-10-05T19:51:14.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4096289353 wait complete. 2023-10-05T19:51:14.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.548+0000 7efbfdcfde40 1 Processor -- start 2023-10-05T19:51:14.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 -- start start 2023-10-05T19:51:14.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d0887fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d0872ce30 con 0x557d08860b20 2023-10-05T19:51:14.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfb832700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d0887fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfb832700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d0887fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:37700/0 (socket says 172.21.15.167:37700) 2023-10-05T19:51:14.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfb832700 1 -- 172.21.15.167:0/2241048149 learned_addr learned my addr 172.21.15.167:0/2241048149 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:14.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfb832700 1 -- 172.21.15.167:0/2241048149 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec005cf0 con 0x557d08860b20 2023-10-05T19:51:14.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfb832700 1 --2- 172.21.15.167:0/2241048149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d0887fb90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efbec000c00 tx=0x7efbec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffc4c0399d7dddf server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfa02f700 1 -- 172.21.15.167:0/2241048149 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbec008970 con 0x557d08860b20 2023-10-05T19:51:14.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfa02f700 1 -- 172.21.15.167:0/2241048149 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec008af0 con 0x557d08860b20 2023-10-05T19:51:14.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfa02f700 1 -- 172.21.15.167:0/2241048149 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbec008de0 con 0x557d08860b20 2023-10-05T19:51:14.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 -- 172.21.15.167:0/2241048149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 msgr2=0x557d0887fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/2241048149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d0887fb90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efbec000c00 tx=0x7efbec015000 comp rx=0 tx=0).stop 2023-10-05T19:51:14.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 -- 172.21.15.167:0/2241048149 shutdown_connections 2023-10-05T19:51:14.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/2241048149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d0887fb90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 -- 172.21.15.167:0/2241048149 >> 172.21.15.167:0/2241048149 conn(0x557d087d4590 msgr2=0x557d0887b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:14.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 -- 172.21.15.167:0/2241048149 shutdown_connections 2023-10-05T19:51:14.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 -- 172.21.15.167:0/2241048149 wait complete. 2023-10-05T19:51:14.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 Processor -- start 2023-10-05T19:51:14.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 -- start start 2023-10-05T19:51:14.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d088867f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfdcfde40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d086ffed0 con 0x557d08860b20 2023-10-05T19:51:14.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.552+0000 7efbfb832700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d088867f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbfb832700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d088867f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:37710/0 (socket says 172.21.15.167:37710) 2023-10-05T19:51:14.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 learned_addr learned my addr 172.21.15.167:0/886721481 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:14.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d088625d0 con 0x557d08860b20 2023-10-05T19:51:14.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbfb832700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d088867f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efbec008fd0 tx=0x7efbec003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbf882c700 1 -- 172.21.15.167:0/886721481 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbec012b70 con 0x557d08860b20 2023-10-05T19:51:14.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbf882c700 1 -- 172.21.15.167:0/886721481 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec02a070 con 0x557d08860b20 2023-10-05T19:51:14.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d08886d30 con 0x557d08860b20 2023-10-05T19:51:14.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbf882c700 1 -- 172.21.15.167:0/886721481 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbec031480 con 0x557d08860b20 2023-10-05T19:51:14.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d088871d0 con 0x557d08860b20 2023-10-05T19:51:14.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.556+0000 7efbf882c700 1 -- 172.21.15.167:0/886721481 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7efbec019070 con 0x557d08860b20 2023-10-05T19:51:14.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbf882c700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efbdc030c50 0x7efbdc033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbf882c700 1 -- 172.21.15.167:0/886721481 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7efbec02c070 con 0x557d08860b20 2023-10-05T19:51:14.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbf3031700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efbdc030c50 0x7efbdc033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d08861430 0x557d088923e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08892a00 con 0x557d08861430 2023-10-05T19:51:14.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfc033700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d08861430 0x557d088923e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbf3031700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efbdc030c50 0x7efbdc033100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efbe4004170 tx=0x7efbe4001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfc033700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d08861430 0x557d088923e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 20 realm 2023-10-05T19:51:14.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0888fa40 con 0x557d08861430 2023-10-05T19:51:14.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:51:14.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088934e0 con 0x557d08861430 2023-10-05T19:51:14.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d08894310 0x557d088966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08896c30 con 0x557d08894310 2023-10-05T19:51:14.570 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.560+0000 7efbfb832700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d08894310 0x557d088966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfb832700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d08894310 0x557d088966f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfdcfde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088970e0 con 0x557d08861430 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfdcfde40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfdcfde40 20 searching for the correct realm 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d08899050 0x557d0889b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889ba70 con 0x557d08899050 2023-10-05T19:51:14.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbf3031700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d08899050 0x557d0889b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbf3031700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d08899050 0x557d0889b460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4006070 con 0x557d08899050 2023-10-05T19:51:14.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.564+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889ba70 con 0x557d08894310 2023-10-05T19:51:14.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfb832700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efbec007030 0x7efbec026880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x7efbec007030 2023-10-05T19:51:14.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efbec007030 0x7efbec026880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efbec007030 0x7efbec026880 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08899050 2023-10-05T19:51:14.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4006070 con 0x557d08899050 2023-10-05T19:51:14.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.568+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08894310 2023-10-05T19:51:14.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08894310 2023-10-05T19:51:14.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x7efbec007030 2023-10-05T19:51:14.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x7efbec007030 2023-10-05T19:51:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08894310 2023-10-05T19:51:14.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08899050 2023-10-05T19:51:14.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.572+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4006070 con 0x557d08899050 2023-10-05T19:51:14.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08894310 2023-10-05T19:51:14.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08899050 2023-10-05T19:51:14.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4006070 con 0x557d08899050 2023-10-05T19:51:14.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.576+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08899050 2023-10-05T19:51:14.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4006070 con 0x557d08899050 2023-10-05T19:51:14.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x7efbec007030 2023-10-05T19:51:14.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08861430 2023-10-05T19:51:14.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x7efbec007030 2023-10-05T19:51:14.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08899050 2023-10-05T19:51:14.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4006070 con 0x557d08899050 2023-10-05T19:51:14.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x7efbec007030 2023-10-05T19:51:14.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.580+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08894310 2023-10-05T19:51:14.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08894310 2023-10-05T19:51:14.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08899050 2023-10-05T19:51:14.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4006070 con 0x557d08899050 2023-10-05T19:51:14.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08894310 2023-10-05T19:51:14.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbec046040 con 0x557d08894310 2023-10-05T19:51:14.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfdcfde40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:14.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfdcfde40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:14.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfdcfde40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:14.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfdcfde40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:14.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08897dd0 con 0x557d08861430 2023-10-05T19:51:14.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.584+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088979d0 con 0x557d08894310 2023-10-05T19:51:14.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:14.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08894310 2023-10-05T19:51:14.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:14.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889c290 con 0x557d08899050 2023-10-05T19:51:14.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7efbe4006070 con 0x557d08899050 2023-10-05T19:51:14.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889c640 con 0x557d08861430 2023-10-05T19:51:14.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088982c0 con 0x557d08894310 2023-10-05T19:51:14.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:14.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.588+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08898290 con 0x557d08899050 2023-10-05T19:51:14.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08898290 con 0x557d08894310 2023-10-05T19:51:14.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x7efbec007030 2023-10-05T19:51:14.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08861430 2023-10-05T19:51:14.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08861430 2023-10-05T19:51:14.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08899050 2023-10-05T19:51:14.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08861430 2023-10-05T19:51:14.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.592+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08894310 2023-10-05T19:51:14.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08894310 2023-10-05T19:51:14.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08861430 2023-10-05T19:51:14.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x7efbec007030 2023-10-05T19:51:14.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08861430 2023-10-05T19:51:14.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x7efbec007030 2023-10-05T19:51:14.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.596+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08894310 2023-10-05T19:51:14.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889bee0 con 0x557d08899050 2023-10-05T19:51:14.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08861430 2023-10-05T19:51:14.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08894310 2023-10-05T19:51:14.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08899050 2023-10-05T19:51:14.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.600+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08861430 2023-10-05T19:51:14.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08861430 2023-10-05T19:51:14.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08861430 2023-10-05T19:51:14.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08899050 2023-10-05T19:51:14.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x7efbec007030 2023-10-05T19:51:14.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08861430 2023-10-05T19:51:14.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x7efbec007030 2023-10-05T19:51:14.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.604+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08899050 2023-10-05T19:51:14.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x7efbec007030 2023-10-05T19:51:14.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08894310 2023-10-05T19:51:14.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08894310 2023-10-05T19:51:14.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08899050 2023-10-05T19:51:14.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.608+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08894310 2023-10-05T19:51:14.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efbe4028040 con 0x557d08894310 2023-10-05T19:51:14.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:14.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:14.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:14.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:14.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08898290 con 0x557d08894310 2023-10-05T19:51:14.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:14.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08898290 con 0x557d08861430 2023-10-05T19:51:14.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:14.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889d420 con 0x557d08894310 2023-10-05T19:51:14.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:14.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.612+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889d420 con 0x557d08894310 2023-10-05T19:51:14.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:14.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889d520 con 0x7efbec007030 2023-10-05T19:51:14.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 zone default found 2023-10-05T19:51:14.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 4 Realm: () 2023-10-05T19:51:14.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:51:14.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:51:14.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:51:14.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 zonegroup default 2023-10-05T19:51:14.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889d520 con 0x7efbec007030 2023-10-05T19:51:14.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889eea0 con 0x557d08899050 2023-10-05T19:51:14.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 rados->read ofs=0 len=0 2023-10-05T19:51:14.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889f250 con 0x557d08899050 2023-10-05T19:51:14.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:14.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 started sync module instance, tier type = 2023-10-05T19:51:14.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:51:14.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.616+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889e560 con 0x557d08894310 2023-10-05T19:51:14.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.620+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.620+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93995502526864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889ead0 con 0x557d08894310 2023-10-05T19:51:14.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.620+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889fb80 con 0x557d08861430 2023-10-05T19:51:14.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.624+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.624+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93995502526864] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.624+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93995502532240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889fae0 con 0x557d08861430 2023-10-05T19:51:14.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.624+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a05e0 con 0x557d08894310 2023-10-05T19:51:14.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.624+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93995502532240] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.624+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.624+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93995502527968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a05e0 con 0x557d08894310 2023-10-05T19:51:14.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.624+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a05e0 con 0x7efbec007030 2023-10-05T19:51:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.628+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93995502527968] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.628+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.628+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93995502534416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a0ad0 con 0x7efbec007030 2023-10-05T19:51:14.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.628+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a1550 con 0x557d08894310 2023-10-05T19:51:14.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.628+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.628+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93995502534416] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.628+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93995502538784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a1470 con 0x557d08894310 2023-10-05T19:51:14.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.628+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a05e0 con 0x557d08899050 2023-10-05T19:51:14.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.632+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.632+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93995502538784] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:14.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.632+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93995502542768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a28f0 con 0x557d08899050 2023-10-05T19:51:14.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.632+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a1950 con 0x557d08899050 2023-10-05T19:51:14.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.632+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 93995502542768] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.632+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.632+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93995502546448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a2510 con 0x557d08899050 2023-10-05T19:51:14.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.632+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a3e70 con 0x7efbec007030 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93995502546448] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93995502547552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a3e30 con 0x7efbec007030 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 20 add_watcher() i=0 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 20 add_watcher() i=1 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 20 add_watcher() i=2 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 20 add_watcher() i=3 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 20 add_watcher() i=4 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 20 add_watcher() i=5 2023-10-05T19:51:14.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 20 add_watcher() i=6 2023-10-05T19:51:14.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93995502547552] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:14.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 20 add_watcher() i=7 2023-10-05T19:51:14.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 2 all 8 watchers are set, enabling cache 2023-10-05T19:51:14.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a72a0 con 0x557d08861430 2023-10-05T19:51:14.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.636+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93995502549728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088a4710 con 0x557d08861430 2023-10-05T19:51:14.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93995502549728] v32'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:14.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbcd7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:14.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbfdcfde40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:51:14.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbfdcfde40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:51:14.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbfdcfde40 1 Processor -- start 2023-10-05T19:51:14.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbfdcfde40 1 -- start start 2023-10-05T19:51:14.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbfdcfde40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbfdcfde40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d088b2270 con 0x557d088b1960 2023-10-05T19:51:14.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbf3031700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbf3031700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:37724/0 (socket says 172.21.15.167:37724) 2023-10-05T19:51:14.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbf3031700 1 -- 172.21.15.167:0/3372054909 learned_addr learned my addr 172.21.15.167:0/3372054909 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:14.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbf3031700 1 -- 172.21.15.167:0/3372054909 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d088b23b0 con 0x557d088b1960 2023-10-05T19:51:14.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbf3031700 1 --2- 172.21.15.167:0/3372054909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b1d30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x557d088975e0 tx=0x7efbe4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b1118e6f2d5ea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbccfe1700 1 -- 172.21.15.167:0/3372054909 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbe403b070 con 0x557d088b1960 2023-10-05T19:51:14.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbccfe1700 1 -- 172.21.15.167:0/3372054909 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe4022040 con 0x557d088b1960 2023-10-05T19:51:14.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.640+0000 7efbccfe1700 1 -- 172.21.15.167:0/3372054909 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbe4021040 con 0x557d088b1960 2023-10-05T19:51:14.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 -- 172.21.15.167:0/3372054909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 msgr2=0x557d088b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:14.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/3372054909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b1d30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x557d088975e0 tx=0x7efbe4010000 comp rx=0 tx=0).stop 2023-10-05T19:51:14.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 -- 172.21.15.167:0/3372054909 shutdown_connections 2023-10-05T19:51:14.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/3372054909 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b1d30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:14.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 -- 172.21.15.167:0/3372054909 >> 172.21.15.167:0/3372054909 conn(0x557d088acd20 msgr2=0x557d088aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:14.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 -- 172.21.15.167:0/3372054909 shutdown_connections 2023-10-05T19:51:14.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 -- 172.21.15.167:0/3372054909 wait complete. 2023-10-05T19:51:14.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 Processor -- start 2023-10-05T19:51:14.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 -- start start 2023-10-05T19:51:14.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d088b8440 con 0x557d088b1960 2023-10-05T19:51:14.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbf3031700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbf3031700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:37730/0 (socket says 172.21.15.167:37730) 2023-10-05T19:51:14.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 learned_addr learned my addr 172.21.15.167:0/4047154758 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:14.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d087abc00 con 0x557d088b1960 2023-10-05T19:51:14.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbf3031700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b7440 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x557d088ab9e0 tx=0x7efbe4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efb46ffd700 1 -- 172.21.15.167:0/4047154758 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbe4021070 con 0x557d088b1960 2023-10-05T19:51:14.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efb46ffd700 1 -- 172.21.15.167:0/4047154758 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe4041630 con 0x557d088b1960 2023-10-05T19:51:14.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d088b7a40 con 0x557d088b1960 2023-10-05T19:51:14.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efb46ffd700 1 -- 172.21.15.167:0/4047154758 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efbe4046070 con 0x557d088b1960 2023-10-05T19:51:14.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.644+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d088b7ee0 con 0x557d088b1960 2023-10-05T19:51:14.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.648+0000 7efb46ffd700 1 -- 172.21.15.167:0/4047154758 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7efbe403e020 con 0x557d088b1960 2023-10-05T19:51:14.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.648+0000 7efb46ffd700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb3c030c00 0x7efb3c0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.648+0000 7efb46ffd700 1 -- 172.21.15.167:0/4047154758 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7efbe402e040 con 0x557d088b1960 2023-10-05T19:51:14.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.648+0000 7efbfc033700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb3c030c00 0x7efb3c0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.648+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d088c2030 0x557d088c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.648+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088c4a90 con 0x557d088c2030 2023-10-05T19:51:14.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.648+0000 7efbfb832700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d088c2030 0x557d088c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.648+0000 7efbfc033700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb3c030c00 0x7efb3c0330b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x557d088a40b0 tx=0x7efbf400d630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.648+0000 7efbfb832700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d088c2030 0x557d088c4440 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.652+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'26 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.652+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557d088c5760 0x557d088c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.652+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088c8270 con 0x557d088c5760 2023-10-05T19:51:14.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.652+0000 7efbf3031700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557d088c5760 0x557d088c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.652+0000 7efbf3031700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557d088c5760 0x557d088c7b40 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.652+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.652+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d088c8f40 0x557d088cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.652+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088cba80 con 0x557d088c8f40 2023-10-05T19:51:14.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.652+0000 7efbfc033700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d088c8f40 0x557d088cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.656+0000 7efbfc033700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d088c8f40 0x557d088cb350 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.656+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.656+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d088cc790 0x557d088ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:14.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.656+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088cf2a0 con 0x557d088cc790 2023-10-05T19:51:14.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.656+0000 7efbfb832700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d088cc790 0x557d088ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:14.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.656+0000 7efbfb832700 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d088cc790 0x557d088ceb70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:14.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.660+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'178 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.660+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088cf8f0 con 0x557d088cc790 2023-10-05T19:51:14.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.660+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'50 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.660+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088cff10 con 0x557d088c8f40 2023-10-05T19:51:14.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.664+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'34 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.664+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0400 con 0x557d088c2030 2023-10-05T19:51:14.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.664+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.664+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0830 con 0x557d088cc790 2023-10-05T19:51:14.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.668+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.668+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0830 con 0x557d088c2030 2023-10-05T19:51:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.668+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'20 uv18 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.668+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0aa0 con 0x557d088c2030 2023-10-05T19:51:14.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.672+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.672+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0190 con 0x557d088cc790 2023-10-05T19:51:14.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.672+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'51 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.676+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0190 con 0x557d088c8f40 2023-10-05T19:51:14.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.676+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.676+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d01d0 con 0x557d088c2030 2023-10-05T19:51:14.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.680+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.680+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0190 con 0x557d088cc790 2023-10-05T19:51:14.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.680+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'40 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.680+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d01d0 con 0x557d088cc790 2023-10-05T19:51:14.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.684+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'179 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.684+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0190 con 0x557d088c2030 2023-10-05T19:51:14.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.684+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'41 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.684+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d01d0 con 0x557d088cc790 2023-10-05T19:51:14.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.688+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'52 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.688+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0190 con 0x557d088c8f40 2023-10-05T19:51:14.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.688+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.688+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0200 con 0x557d088c2030 2023-10-05T19:51:14.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.692+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.692+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0280 con 0x557d088cc790 2023-10-05T19:51:14.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.696+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'180 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.696+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0280 con 0x557d088c2030 2023-10-05T19:51:14.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.696+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.696+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0290 con 0x557d088c2030 2023-10-05T19:51:14.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.700+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.700+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0280 con 0x557d088c8f40 2023-10-05T19:51:14.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.704+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.704+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d02f0 con 0x557d088c2030 2023-10-05T19:51:14.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.704+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.704+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0370 con 0x557d088c8f40 2023-10-05T19:51:14.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.708+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.708+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0430 con 0x557d088c8f40 2023-10-05T19:51:14.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.708+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'35 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.708+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0ea0 con 0x557d088c8f40 2023-10-05T19:51:14.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.712+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.712+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0430 con 0x557d088c2030 2023-10-05T19:51:14.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.716+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'31 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.716+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0430 con 0x557d088cc790 2023-10-05T19:51:14.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.716+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'33 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.716+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0ea0 con 0x557d088c2030 2023-10-05T19:51:14.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.720+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.720+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0430 con 0x557d088cc790 2023-10-05T19:51:14.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.720+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'41 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.720+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088d0ea0 con 0x557d088c5760 2023-10-05T19:51:14.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.724+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efb3bfff700 20 reqs_thread_entry: start 2023-10-05T19:51:14.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efb39ffb700 20 reqs_thread_entry: start 2023-10-05T19:51:14.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efbfdcfde40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:14.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efbfdcfde40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:14.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efb27fff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:44 2023 2023-10-05T19:51:14.735 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:14.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efb277fe700 20 reqs_thread_entry: start 2023-10-05T19:51:14.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2023-10-05T19:51:14.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:33 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(33 gc.30 [call] v32'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.728+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:34 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(34 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:35 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088cc790 2023-10-05T19:51:14.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(35 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:36 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(36 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:14.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:37 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(37 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.732+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(38 gc.30 [call] v32'43 uv43 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2023-10-05T19:51:14.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:39 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(39 gc.31 [call] v32'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:40 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(40 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:41 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088c5760 2023-10-05T19:51:14.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(41 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.736+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:42 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.740+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(42 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.740+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:14.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.740+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:43 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.740+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(43 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.740+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.740+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:44 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.740+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(44 gc.31 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.740+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2023-10-05T19:51:14.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.740+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:14.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(45 gc.0 [call] v32'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:46 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:14.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(46 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:47 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088c2030 2023-10-05T19:51:14.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(47 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:48 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:14.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(48 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:14.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:49 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:14.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(49 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.744+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:50 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:14.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.748+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(50 gc.0 [call] v32'28 uv28 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:14.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.748+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2023-10-05T19:51:14.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.748+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:51 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.748+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(51 gc.1 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:52 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(52 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:53 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088c5760 2023-10-05T19:51:14.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(53 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(54 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:14.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:55 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(55 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.752+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c5760 2023-10-05T19:51:14.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.756+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(56 gc.1 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:14.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.756+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2023-10-05T19:51:14.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.756+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:57 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:14.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.756+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(57 gc.2 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.756+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:14.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.756+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(58 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.756+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.756+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:59 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088c8f40 2023-10-05T19:51:14.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.760+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(59 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.760+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:60 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:14.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.760+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(60 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.760+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:14.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.760+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:14.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.760+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(61 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.760+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.760+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:62 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:14.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(62 gc.2 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:14.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2023-10-05T19:51:14.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(63 gc.3 [call] v32'181 uv181 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(64 gc.3 [call out=15b] v0'0 uv181 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088cc790 2023-10-05T19:51:14.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(65 gc.3 [call out=24b] v0'0 uv181 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:66 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(66 gc.3 [call out=15b] v0'0 uv181 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:14.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.764+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.768+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(67 gc.3 [call out=15b] v0'0 uv181 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:14.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.768+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:14.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.768+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:68 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:14.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.768+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(68 gc.3 [call] v32'182 uv182 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.768+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2023-10-05T19:51:19.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.768+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:69 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.768+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(69 gc.4 [call] v32'53 uv53 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.768+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:70 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(70 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:71 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088cc790 2023-10-05T19:51:19.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(71 gc.4 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:72 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(72 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:73 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(73 gc.4 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.772+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:74 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.578 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(74 gc.4 [call] v32'54 uv54 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2023-10-05T19:51:19.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:75 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:19.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(75 gc.5 [call] v32'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:76 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:19.579 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(76 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:77 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088c8f40 2023-10-05T19:51:19.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(77 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:78 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:19.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(78 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.776+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:79 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:19.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.780+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(79 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.780+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.780+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:80 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:19.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.780+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(80 gc.5 [call] v32'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.780+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2023-10-05T19:51:19.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.780+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:81 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(81 gc.6 [call] v32'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:82 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(82 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:83 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088c2030 2023-10-05T19:51:19.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(83 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(84 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(85 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.784+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:86 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.788+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(86 gc.6 [call] v32'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.788+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2023-10-05T19:51:19.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.788+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.788+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 gc.7 [call] v32'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.788+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:88 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.788+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(88 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.788+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.788+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:89 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088cc790 2023-10-05T19:51:19.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(89 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:90 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(90 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:91 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(91 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:92 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088cc790 2023-10-05T19:51:19.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(92 gc.7 [call] v32'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2023-10-05T19:51:19.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.792+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.796+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(93 gc.8 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.796+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:94 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.796+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(94 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.796+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.796+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:95 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0892ffb0 con 0x557d088c2030 2023-10-05T19:51:19.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.796+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(95 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:96 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(96 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:97 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(97 gc.8 [call out=1700b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+1700 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T19:51:19.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 20 garbage collection: RGWGC::process iterating over entry tag='e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.868088250697738021', time=2023-10-05T19:50:59.200469+0000, chain.objs.size()=7 2023-10-05T19:51:19.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__1 2023-10-05T19:51:19.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:98 3.3bs0 3:dc6ed4e1:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__1:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c2030 2023-10-05T19:51:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__2 2023-10-05T19:51:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:99 3.4s0 3:2393a7d6:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__2:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08933880 con 0x557d088cc790 2023-10-05T19:51:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__3 2023-10-05T19:51:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:100 3.7s0 3:e264ad4c:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__3:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08930fc0 con 0x557d088c8f40 2023-10-05T19:51:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__4 2023-10-05T19:51:19.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:101 3.es0 3:719efc47:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__4:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d08938740 con 0x557d088c2030 2023-10-05T19:51:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__5 2023-10-05T19:51:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 3.2bs0 3:d7a0d0b0:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__5:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__6 2023-10-05T19:51:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 3.21s0 3:878be693:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__6:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893de80 con 0x557d088c5760 2023-10-05T19:51:19.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__7 2023-10-05T19:51:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.800+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 3.18s0 3:1bc774d1:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__7:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.804+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(100 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__3 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.804+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(102 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__5 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.808+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(99 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__2 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.808+0000 7efbf3031700 1 -- 172.21.15.167:0/4047154758 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(103 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__6 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d088c5760 2023-10-05T19:51:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.808+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(101 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__4 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.808+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(98 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__1 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.808+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.1__shadow_.Vjg01KwWTKFOPRuYz4VnPYXTNhaq7l__7 [call] v32'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.808+0000 7efbfdcfde40 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T19:51:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.808+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.812+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 gc.8 [call] v32'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.812+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.812+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(106 gc.8 [call] v32'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.812+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2023-10-05T19:51:19.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.812+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 gc.9 [call] v32'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(108 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(109 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(110 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(111 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(112 gc.9 [call] v32'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2023-10-05T19:51:19.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.816+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(113 gc.10 [call] v32'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:114 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(114 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(115 gc.10 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:116 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(116 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:117 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(117 gc.10 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(118 gc.10 [call] v32'56 uv56 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2023-10-05T19:51:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.820+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:119 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(119 gc.11 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:120 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(120 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:121 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(121 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:122 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(122 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:123 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(123 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:124 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(124 gc.11 [call] v32'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2023-10-05T19:51:19.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.824+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:125 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(125 gc.12 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:126 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(126 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:127 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(127 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:128 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(128 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:129 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(129 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.828+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(130 gc.12 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2023-10-05T19:51:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:131 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 43 ==== osd_op_reply(131 gc.13 [call] v32'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:132 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 44 ==== osd_op_reply(132 gc.13 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 45 ==== osd_op_reply(133 gc.13 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 46 ==== osd_op_reply(134 gc.13 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 47 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.832+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:136 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 48 ==== osd_op_reply(136 gc.13 [call] v32'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2023-10-05T19:51:19.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 49 ==== osd_op_reply(137 gc.14 [call] v32'183 uv183 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 50 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv183 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:139 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 51 ==== osd_op_reply(139 gc.14 [call out=24b] v0'0 uv183 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.836+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:140 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.840+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 52 ==== osd_op_reply(140 gc.14 [call out=15b] v0'0 uv183 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.840+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.840+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:141 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.840+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 53 ==== osd_op_reply(141 gc.14 [call out=15b] v0'0 uv183 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.840+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.840+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:142 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.840+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 54 ==== osd_op_reply(142 gc.14 [call] v32'184 uv184 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.840+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2023-10-05T19:51:19.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.840+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:143 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 46 ==== osd_op_reply(143 gc.15 [call] v32'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:144 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 47 ==== osd_op_reply(144 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:145 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 48 ==== osd_op_reply(145 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:146 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 49 ==== osd_op_reply(146 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:147 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 50 ==== osd_op_reply(147 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.844+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:148 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.848+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 51 ==== osd_op_reply(148 gc.15 [call] v32'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.848+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.848+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:149 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.848+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 55 ==== osd_op_reply(149 gc.16 [call] v32'57 uv57 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.848+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:150 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.848+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 56 ==== osd_op_reply(150 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.848+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.848+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:151 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 57 ==== osd_op_reply(151 gc.16 [call out=24b] v0'0 uv57 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:152 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 58 ==== osd_op_reply(152 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:153 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 59 ==== osd_op_reply(153 gc.16 [call out=15b] v0'0 uv57 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:154 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 60 ==== osd_op_reply(154 gc.16 [call] v32'58 uv58 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.852+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:155 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(155 gc.17 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:156 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(156 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:157 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(157 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:158 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(158 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:159 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== osd_op_reply(159 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.856+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:160 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.860+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== osd_op_reply(160 gc.17 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.860+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.860+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:161 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 52 ==== osd_op_reply(161 gc.18 [call] v32'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:162 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:19.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 53 ==== osd_op_reply(162 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:19.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:19.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:163 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 54 ==== osd_op_reply(163 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:164 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 55 ==== osd_op_reply(164 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.864+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:165 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.868+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 56 ==== osd_op_reply(165 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.868+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.868+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:166 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.868+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 57 ==== osd_op_reply(166 gc.18 [call] v32'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.868+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2023-10-05T19:51:20.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.868+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:167 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 61 ==== osd_op_reply(167 gc.19 [call] v32'185 uv185 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:168 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 62 ==== osd_op_reply(168 gc.19 [call out=15b] v0'0 uv185 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:169 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 63 ==== osd_op_reply(169 gc.19 [call out=24b] v0'0 uv185 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:170 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 64 ==== osd_op_reply(170 gc.19 [call out=15b] v0'0 uv185 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:171 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 65 ==== osd_op_reply(171 gc.19 [call out=15b] v0'0 uv185 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.872+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:172 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.876+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 66 ==== osd_op_reply(172 gc.19 [call] v32'186 uv186 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.876+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2023-10-05T19:51:20.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.876+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:173 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.876+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 58 ==== osd_op_reply(173 gc.20 [call] v32'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.876+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:174 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 59 ==== osd_op_reply(174 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:175 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 60 ==== osd_op_reply(175 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:176 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 61 ==== osd_op_reply(176 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:177 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 62 ==== osd_op_reply(177 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.880+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:178 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.884+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 63 ==== osd_op_reply(178 gc.20 [call] v32'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.884+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2023-10-05T19:51:20.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.884+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:179 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.884+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 64 ==== osd_op_reply(179 gc.21 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.884+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:180 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 65 ==== osd_op_reply(180 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:181 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 66 ==== osd_op_reply(181 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:182 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 67 ==== osd_op_reply(182 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:183 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 68 ==== osd_op_reply(183 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.888+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:184 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.892+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 69 ==== osd_op_reply(184 gc.21 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.892+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2023-10-05T19:51:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.892+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:185 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.892+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 35 ==== osd_op_reply(185 gc.22 [call] v32'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.892+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:186 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.892+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 36 ==== osd_op_reply(186 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.892+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.892+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:187 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 37 ==== osd_op_reply(187 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:188 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 38 ==== osd_op_reply(188 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:189 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 39 ==== osd_op_reply(189 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:190 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 40 ==== osd_op_reply(190 gc.22 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2023-10-05T19:51:20.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.896+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:191 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.900+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 70 ==== osd_op_reply(191 gc.23 [call] v32'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.900+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:192 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.900+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 71 ==== osd_op_reply(192 gc.23 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.900+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.900+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:193 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.900+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 72 ==== osd_op_reply(193 gc.23 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.904+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:194 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.904+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 73 ==== osd_op_reply(194 gc.23 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.904+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.904+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:195 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.904+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 74 ==== osd_op_reply(195 gc.23 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.904+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.904+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:196 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 75 ==== osd_op_reply(196 gc.23 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2023-10-05T19:51:20.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:197 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 41 ==== osd_op_reply(197 gc.24 [call] v32'19 uv19 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:198 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 42 ==== osd_op_reply(198 gc.24 [call out=15b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:199 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 43 ==== osd_op_reply(199 gc.24 [call out=24b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.908+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:200 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.912+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 44 ==== osd_op_reply(200 gc.24 [call out=15b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.912+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.912+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:201 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.912+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 45 ==== osd_op_reply(201 gc.24 [call out=15b] v0'0 uv19 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.912+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.912+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:202 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.912+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 46 ==== osd_op_reply(202 gc.24 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.912+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2023-10-05T19:51:20.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.912+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:203 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 47 ==== osd_op_reply(203 gc.25 [call] v32'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:204 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 48 ==== osd_op_reply(204 gc.25 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:205 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 49 ==== osd_op_reply(205 gc.25 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:206 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 50 ==== osd_op_reply(206 gc.25 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.916+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:207 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.920+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 51 ==== osd_op_reply(207 gc.25 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.920+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.920+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:208 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.920+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 52 ==== osd_op_reply(208 gc.25 [call] v32'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.920+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2023-10-05T19:51:20.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.920+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:209 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 53 ==== osd_op_reply(209 gc.26 [call] v32'25 uv25 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:210 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 54 ==== osd_op_reply(210 gc.26 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:211 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 55 ==== osd_op_reply(211 gc.26 [call out=24b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:212 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 56 ==== osd_op_reply(212 gc.26 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:213 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 57 ==== osd_op_reply(213 gc.26 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.924+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:214 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c8f40 2023-10-05T19:51:20.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.928+0000 7efbfc033700 1 -- 172.21.15.167:0/4047154758 <== osd.3 v2:172.21.15.167:6800/26773 58 ==== osd_op_reply(214 gc.26 [call] v32'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d088c8f40 2023-10-05T19:51:20.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.928+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2023-10-05T19:51:20.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.928+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:215 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.928+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 76 ==== osd_op_reply(215 gc.27 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.928+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:216 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 77 ==== osd_op_reply(216 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:217 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 78 ==== osd_op_reply(217 gc.27 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:218 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 79 ==== osd_op_reply(218 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:219 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 80 ==== osd_op_reply(219 gc.27 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.932+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:220 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.936+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 81 ==== osd_op_reply(220 gc.27 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.936+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2023-10-05T19:51:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.936+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:221 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 67 ==== osd_op_reply(221 gc.28 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:222 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 68 ==== osd_op_reply(222 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:223 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 69 ==== osd_op_reply(223 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:224 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 70 ==== osd_op_reply(224 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:225 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 71 ==== osd_op_reply(225 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.940+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:226 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088cc790 2023-10-05T19:51:20.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.944+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.1 v2:172.21.15.167:6808/26775 72 ==== osd_op_reply(226 gc.28 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088cc790 2023-10-05T19:51:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.944+0000 7efbfdcfde40 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2023-10-05T19:51:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.944+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:227 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.944+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 82 ==== osd_op_reply(227 gc.29 [call] v32'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.944+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:228 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.944+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 83 ==== osd_op_reply(228 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.944+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.944+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:229 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.948+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 84 ==== osd_op_reply(229 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.948+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:230 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.948+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 85 ==== osd_op_reply(230 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.948+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T19:51:20.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.948+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:231 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.948+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 86 ==== osd_op_reply(231 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.948+0000 7efbfdcfde40 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T19:51:20.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.948+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:232 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d088c2030 2023-10-05T19:51:20.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.952+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 <== osd.0 v2:172.21.15.118:6800/26580 87 ==== osd_op_reply(232 gc.29 [call] v32'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d088c2030 2023-10-05T19:51:20.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.952+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93995502526864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0893b230 con 0x557d08894310 2023-10-05T19:51:20.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.956+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 93995502526864] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:20.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.956+0000 7efbfdcfde40 20 remove_watcher() i=0 2023-10-05T19:51:20.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.956+0000 7efbfdcfde40 2 removed watcher, disabling cache 2023-10-05T19:51:20.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.956+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93995502532240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889e190 con 0x557d08861430 2023-10-05T19:51:20.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.956+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 93995502532240] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:20.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.956+0000 7efbfdcfde40 20 remove_watcher() i=1 2023-10-05T19:51:20.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.956+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93995502527968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889e190 con 0x557d08894310 2023-10-05T19:51:20.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.960+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 93995502527968] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:20.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.960+0000 7efbfdcfde40 20 remove_watcher() i=2 2023-10-05T19:51:20.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.960+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93995502534416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889f690 con 0x7efbec007030 2023-10-05T19:51:20.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.960+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 93995502534416] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:20.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.960+0000 7efbfdcfde40 20 remove_watcher() i=3 2023-10-05T19:51:20.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.960+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93995502538784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889f690 con 0x557d08894310 2023-10-05T19:51:20.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.964+0000 7efbfb832700 1 -- 172.21.15.167:0/886721481 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 93995502538784] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbec022020 con 0x557d08894310 2023-10-05T19:51:20.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.964+0000 7efbfdcfde40 20 remove_watcher() i=4 2023-10-05T19:51:20.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.964+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93995502542768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889f690 con 0x557d08899050 2023-10-05T19:51:20.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.968+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 93995502542768] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:20.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.968+0000 7efbfdcfde40 20 remove_watcher() i=5 2023-10-05T19:51:20.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.968+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93995502546448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889f690 con 0x557d08899050 2023-10-05T19:51:20.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.968+0000 7efbf3031700 1 -- 172.21.15.167:0/886721481 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 93995502546448] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbe4024040 con 0x557d08899050 2023-10-05T19:51:20.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.968+0000 7efbfdcfde40 20 remove_watcher() i=6 2023-10-05T19:51:20.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.968+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93995502547552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d0889f690 con 0x7efbec007030 2023-10-05T19:51:20.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.972+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 93995502547552] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x7efbec007030 2023-10-05T19:51:20.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.972+0000 7efbfdcfde40 20 remove_watcher() i=7 2023-10-05T19:51:20.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.972+0000 7efbcd7e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:20.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.972+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93995502549728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557d088f08b0 con 0x557d08861430 2023-10-05T19:51:20.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.972+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 93995502549728] v32'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efbf400a5a0 con 0x557d08861430 2023-10-05T19:51:20.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d08894310 msgr2=0x557d088966f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d08894310 0x557d088966f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d08861430 msgr2=0x557d088923e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d08861430 0x557d088923e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efbec007030 msgr2=0x7efbec026880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efbec007030 0x7efbec026880 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d08899050 msgr2=0x557d0889b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d08899050 0x557d0889b460 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efbdc030c50 msgr2=0x7efbdc033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efbdc030c50 0x7efbdc033100 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efbe4004170 tx=0x7efbe4001380 comp rx=0 tx=0).stop 2023-10-05T19:51:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfc033700 1 -- 172.21.15.167:0/886721481 reap_dead start 2023-10-05T19:51:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 msgr2=0x557d088867f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d088867f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efbec008fd0 tx=0x7efbec003050 comp rx=0 tx=0).stop 2023-10-05T19:51:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 shutdown_connections 2023-10-05T19:51:20.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/886721481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d08860b20 0x557d088867f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 >> 172.21.15.167:0/886721481 conn(0x557d087d4590 msgr2=0x557d0887a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 shutdown_connections 2023-10-05T19:51:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/886721481 wait complete. 2023-10-05T19:51:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d088c2030 msgr2=0x557d088c4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557d088c2030 0x557d088c4440 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d088cc790 msgr2=0x557d088ceb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557d088cc790 0x557d088ceb70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557d088c5760 msgr2=0x557d088c7b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557d088c5760 0x557d088c7b40 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d088c8f40 msgr2=0x557d088cb350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557d088c8f40 0x557d088cb350 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb3c030c00 msgr2=0x7efb3c0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efb3c030c00 0x7efb3c0330b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x557d088a40b0 tx=0x7efbf400d630 comp rx=0 tx=0).stop 2023-10-05T19:51:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 msgr2=0x557d088b7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b7440 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x557d088ab9e0 tx=0x7efbe4037000 comp rx=0 tx=0).stop 2023-10-05T19:51:20.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfb832700 1 -- 172.21.15.167:0/4047154758 reap_dead start 2023-10-05T19:51:20.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 shutdown_connections 2023-10-05T19:51:20.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 --2- 172.21.15.167:0/4047154758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557d088b1960 0x557d088b7440 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 >> 172.21.15.167:0/4047154758 conn(0x557d088acd20 msgr2=0x557d088aadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:20.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 shutdown_connections 2023-10-05T19:51:20.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:14.976+0000 7efbfdcfde40 1 -- 172.21.15.167:0/4047154758 wait complete. 2023-10-05T19:51:20.094 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2023-10-05T19:51:20.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2023-10-05T19:51:20.094 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2023-10-05T19:51:20.137 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:51:20.137 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:51:20.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe5152cae40 1 Processor -- start 2023-10-05T19:51:20.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe5152cae40 1 -- start start 2023-10-05T19:51:20.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe5152cae40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x563b863ebb50 0x563b863ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:20.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe5152cae40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563b86336bd0 con 0x563b863ec460 2023-10-05T19:51:20.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe5152cae40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x563b862f3ee0 con 0x563b863ebb50 2023-10-05T19:51:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe512dff700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x563b863ebb50 0x563b863ebf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe5125fe700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x563b863ec460 0x563b863ecef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:38406/0 (socket says 172.21.15.167:38406) 2023-10-05T19:51:20.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe5125fe700 1 -- 172.21.15.167:0/3520080447 learned_addr learned my addr 172.21.15.167:0/3520080447 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:51:20.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe511dfd700 1 -- 172.21.15.167:0/3520080447 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153578426 0 0) 0x563b86336bd0 con 0x563b863ec460 2023-10-05T19:51:20.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe511dfd700 1 -- 172.21.15.167:0/3520080447 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f4001e10 con 0x563b863ec460 2023-10-05T19:51:20.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe512dff700 1 -- 172.21.15.167:0/3520080447 >> v1:172.21.15.118:6789/0 conn(0x563b863ec460 legacy=0x563b863ecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe512dff700 1 -- 172.21.15.167:0/3520080447 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b863ed600 con 0x563b863ebb50 2023-10-05T19:51:20.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe512dff700 1 --2- 172.21.15.167:0/3520080447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b863ebf20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe50400a5d0 tx=0x7fe504005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b1883a740b0d21 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:20.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe511dfd700 1 -- 172.21.15.167:0/3520080447 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe504007610 con 0x563b863ebb50 2023-10-05T19:51:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe511dfd700 1 -- 172.21.15.167:0/3520080447 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe504007770 con 0x563b863ebb50 2023-10-05T19:51:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe511dfd700 1 -- 172.21.15.167:0/3520080447 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe504007a40 con 0x563b863ebb50 2023-10-05T19:51:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe5152cae40 1 -- 172.21.15.167:0/3520080447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 msgr2=0x563b863ebf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.133+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3520080447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b863ebf20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe50400a5d0 tx=0x7fe504005a50 comp rx=0 tx=0).stop 2023-10-05T19:51:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- 172.21.15.167:0/3520080447 shutdown_connections 2023-10-05T19:51:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3520080447 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b863ebf20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- 172.21.15.167:0/3520080447 >> 172.21.15.167:0/3520080447 conn(0x563b8635f5c0 msgr2=0x563b8635f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:20.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- 172.21.15.167:0/3520080447 shutdown_connections 2023-10-05T19:51:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- 172.21.15.167:0/3520080447 wait complete. 2023-10-05T19:51:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 Processor -- start 2023-10-05T19:51:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- start start 2023-10-05T19:51:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b8640a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b862b7e30 con 0x563b863ebb50 2023-10-05T19:51:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe512dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b8640a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:20.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe512dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b8640a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45536/0 (socket says 172.21.15.167:45536) 2023-10-05T19:51:20.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe512dff700 1 -- 172.21.15.167:0/2139351225 learned_addr learned my addr 172.21.15.167:0/2139351225 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:20.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe512dff700 1 -- 172.21.15.167:0/2139351225 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe504005cf0 con 0x563b863ebb50 2023-10-05T19:51:20.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe512dff700 1 --2- 172.21.15.167:0/2139351225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b8640a9d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe504000c00 tx=0x7fe504014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4c0700d5915108 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe510dfb700 1 -- 172.21.15.167:0/2139351225 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5040078e0 con 0x563b863ebb50 2023-10-05T19:51:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe510dfb700 1 -- 172.21.15.167:0/2139351225 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe504007a40 con 0x563b863ebb50 2023-10-05T19:51:20.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe510dfb700 1 -- 172.21.15.167:0/2139351225 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe504007bd0 con 0x563b863ebb50 2023-10-05T19:51:20.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- 172.21.15.167:0/2139351225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 msgr2=0x563b8640a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:20.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2139351225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b8640a9d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe504000c00 tx=0x7fe504014000 comp rx=0 tx=0).stop 2023-10-05T19:51:20.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- 172.21.15.167:0/2139351225 shutdown_connections 2023-10-05T19:51:20.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2139351225 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b8640a9d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- 172.21.15.167:0/2139351225 >> 172.21.15.167:0/2139351225 conn(0x563b8635f5c0 msgr2=0x563b86406590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- 172.21.15.167:0/2139351225 shutdown_connections 2023-10-05T19:51:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.137+0000 7fe5152cae40 1 -- 172.21.15.167:0/2139351225 wait complete. 2023-10-05T19:51:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe5152cae40 1 Processor -- start 2023-10-05T19:51:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe5152cae40 1 -- start start 2023-10-05T19:51:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe5152cae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b86411690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:20.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe5152cae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8628aed0 con 0x563b863ebb50 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe512dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b86411690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe512dff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b86411690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45542/0 (socket says 172.21.15.167:45542) 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 learned_addr learned my addr 172.21.15.167:0/2310669886 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b863ed600 con 0x563b863ebb50 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe512dff700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b86411690 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe50401f040 tx=0x7fe50401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe50affd700 1 -- 172.21.15.167:0/2310669886 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe504007bb0 con 0x563b863ebb50 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe50affd700 1 -- 172.21.15.167:0/2310669886 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe504029070 con 0x563b863ebb50 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b86411bd0 con 0x563b863ebb50 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe50affd700 1 -- 172.21.15.167:0/2310669886 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe504012610 con 0x563b863ebb50 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.141+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b86412010 con 0x563b863ebb50 2023-10-05T19:51:20.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe50affd700 1 -- 172.21.15.167:0/2310669886 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fe504012770 con 0x563b863ebb50 2023-10-05T19:51:20.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe50affd700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe4f8030ca0 0x7fe4f8033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:20.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe50affd700 1 -- 172.21.15.167:0/2310669886 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7fe50402b070 con 0x563b863ebb50 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5125fe700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe4f8030ca0 0x7fe4f8033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b863ec460 0x563b8641d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8641d780 con 0x563b863ec460 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe513600700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b863ec460 0x563b8641d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5125fe700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe4f8030ca0 0x7fe4f8033150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0044f0 tx=0x7fe4fc006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe513600700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b863ec460 0x563b8641d080 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe50c00a500 con 0x563b863ec460 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 20 realm 2023-10-05T19:51:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8641a6e0 con 0x563b863ec460 2023-10-05T19:51:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe50c00a500 con 0x563b863ec460 2023-10-05T19:51:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:51:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8641e260 con 0x563b863ec460 2023-10-05T19:51:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe50c00a500 con 0x563b863ec460 2023-10-05T19:51:20.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.145+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8641de90 0x563b864210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86421800 con 0x563b8641de90 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe512dff700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8641de90 0x563b864210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe512dff700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8641de90 0x563b864210d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864220d0 con 0x563b863ec460 2023-10-05T19:51:20.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe50c00a500 con 0x563b863ec460 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 20 searching for the correct realm 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86421c40 0x563b86425ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b86421c40 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5125fe700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86421c40 0x563b86425ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.149+0000 7fe5125fe700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86421c40 0x563b86425ea0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc004520 con 0x563b86421c40 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b8641de90 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe512dff700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe504007030 0x7fe504045eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:20.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x7fe504007030 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe513600700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe504007030 0x7fe504045eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe513600700 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe504007030 0x7fe504045eb0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x7fe504007030 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b86421c40 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc004520 con 0x563b86421c40 2023-10-05T19:51:20.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.153+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b8641de90 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b8641de90 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x7fe504007030 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x7fe504007030 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x7fe504007030 2023-10-05T19:51:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x7fe504007030 2023-10-05T19:51:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.157+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b8641de90 2023-10-05T19:51:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b86421c40 2023-10-05T19:51:20.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc004520 con 0x563b86421c40 2023-10-05T19:51:20.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b8641de90 2023-10-05T19:51:20.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b86421c40 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.161+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b86421c40 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x7fe504007030 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x7fe504007030 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b863ec460 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x7fe504007030 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x7fe504007030 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.165+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b86421c40 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x7fe504007030 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x7fe504007030 2023-10-05T19:51:20.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b8641de90 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b8641de90 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426480 con 0x563b86421c40 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe4fc021040 con 0x563b8641de90 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.169+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe4fc021040 con 0x563b8641de90 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:20.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86422c40 con 0x563b863ec460 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864235c0 con 0x563b8641de90 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86422830 con 0x563b8641de90 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86426e30 con 0x563b86421c40 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.173+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86427590 con 0x563b8641de90 2023-10-05T19:51:20.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe5152cae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:20.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86428950 con 0x563b86421c40 2023-10-05T19:51:20.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86428950 con 0x563b8641de90 2023-10-05T19:51:20.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86428950 con 0x7fe504007030 2023-10-05T19:51:20.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x7fe504007030 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.177+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b86421c40 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b8641de90 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b8641de90 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.181+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x7fe504007030 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x7fe504007030 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x7fe504007030 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x7fe504007030 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b8641de90 2023-10-05T19:51:20.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b86421c40 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.185+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b8641de90 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b86421c40 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c014040 con 0x563b863ec460 2023-10-05T19:51:20.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b86421c40 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x7fe504007030 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.189+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b863ec460 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x7fe504007030 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:20.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b86421c40 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x7fe504007030 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b8641de90 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b8641de90 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.193+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b86421c40 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b8641de90 2023-10-05T19:51:20.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864271e0 con 0x563b8641de90 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86427940 con 0x563b8641de90 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86427cf0 con 0x563b863ec460 2023-10-05T19:51:20.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:20.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:20.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.197+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86428590 con 0x563b8641de90 2023-10-05T19:51:20.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:20.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86428590 con 0x563b8641de90 2023-10-05T19:51:20.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:20.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:20.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86428690 con 0x7fe504007030 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 zone default found 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 4 Realm: () 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 zonegroup default 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86428690 con 0x7fe504007030 2023-10-05T19:51:20.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.201+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642a010 con 0x563b86421c40 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5152cae40 20 rados->read ofs=0 len=0 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642a3c0 con 0x563b86421c40 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5152cae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5152cae40 20 started sync module instance, tier type = 2023-10-05T19:51:20.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5152cae40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:51:20.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864296d0 con 0x563b8641de90 2023-10-05T19:51:20.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:21.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94813655568864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86429c20 con 0x563b8641de90 2023-10-05T19:51:21.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.205+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642b150 con 0x563b863ec460 2023-10-05T19:51:21.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.209+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94813655568864] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.209+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.209+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94813655574384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86429c20 con 0x563b863ec460 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.209+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642b710 con 0x563b8641de90 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.209+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94813655574384] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.213+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.213+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94813655575488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642b710 con 0x563b8641de90 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.213+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642c000 con 0x7fe504007030 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.213+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.213+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94813655575488] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.213+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94813655577408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642c000 con 0x7fe504007030 2023-10-05T19:51:21.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.213+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642c8a0 con 0x563b8641de90 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.217+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94813655577408] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.217+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.217+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94813655579968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642c680 con 0x563b8641de90 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.217+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642d300 con 0x563b86421c40 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.217+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.217+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94813655584272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642dba0 con 0x563b86421c40 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.217+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642e5b0 con 0x563b86421c40 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.217+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94813655579968] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94813655584272] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94813655581072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642e9b0 con 0x563b86421c40 2023-10-05T19:51:21.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642f250 con 0x7fe504007030 2023-10-05T19:51:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94813655581072] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94813655591344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642f2f0 con 0x7fe504007030 2023-10-05T19:51:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 20 add_watcher() i=0 2023-10-05T19:51:21.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 20 add_watcher() i=1 2023-10-05T19:51:21.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 20 add_watcher() i=2 2023-10-05T19:51:21.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 20 add_watcher() i=3 2023-10-05T19:51:21.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 20 add_watcher() i=4 2023-10-05T19:51:21.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 20 add_watcher() i=5 2023-10-05T19:51:21.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 20 add_watcher() i=6 2023-10-05T19:51:21.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94813655591344] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:21.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 20 add_watcher() i=7 2023-10-05T19:51:21.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 2 all 8 watchers are set, enabling cache 2023-10-05T19:51:21.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86432490 con 0x563b863ec460 2023-10-05T19:51:21.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.221+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:21.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94813655592816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642f980 con 0x563b863ec460 2023-10-05T19:51:21.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94813655592816] v32'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:21.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe4e37ee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:21.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5152cae40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:51:21.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5152cae40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:51:21.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5152cae40 1 Processor -- start 2023-10-05T19:51:21.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5152cae40 1 -- start start 2023-10-05T19:51:21.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5152cae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b8643cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:21.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5152cae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8643d1b0 con 0x563b8643c8a0 2023-10-05T19:51:21.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5125fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b8643cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:21.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5125fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b8643cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45544/0 (socket says 172.21.15.167:45544) 2023-10-05T19:51:21.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5125fe700 1 -- 172.21.15.167:0/924652197 learned_addr learned my addr 172.21.15.167:0/924652197 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:21.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.225+0000 7fe5125fe700 1 -- 172.21.15.167:0/924652197 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b8643d2f0 con 0x563b8643c8a0 2023-10-05T19:51:21.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5125fe700 1 --2- 172.21.15.167:0/924652197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b8643cc70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x563b86422780 tx=0x7fe4fc006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c349f5f74c64b77 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:21.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe4e2fed700 1 -- 172.21.15.167:0/924652197 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4fc01a040 con 0x563b8643c8a0 2023-10-05T19:51:21.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe4e2fed700 1 -- 172.21.15.167:0/924652197 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc02da30 con 0x563b8643c8a0 2023-10-05T19:51:21.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe4e2fed700 1 -- 172.21.15.167:0/924652197 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4fc004980 con 0x563b8643c8a0 2023-10-05T19:51:21.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 -- 172.21.15.167:0/924652197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 msgr2=0x563b8643cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 --2- 172.21.15.167:0/924652197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b8643cc70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x563b86422780 tx=0x7fe4fc006000 comp rx=0 tx=0).stop 2023-10-05T19:51:21.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 -- 172.21.15.167:0/924652197 shutdown_connections 2023-10-05T19:51:21.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 --2- 172.21.15.167:0/924652197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b8643cc70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 -- 172.21.15.167:0/924652197 >> 172.21.15.167:0/924652197 conn(0x563b86437c60 msgr2=0x563b86435e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:21.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 -- 172.21.15.167:0/924652197 shutdown_connections 2023-10-05T19:51:21.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 -- 172.21.15.167:0/924652197 wait complete. 2023-10-05T19:51:21.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 Processor -- start 2023-10-05T19:51:21.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 -- start start 2023-10-05T19:51:21.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b86442330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:21.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5152cae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b86443330 con 0x563b8643c8a0 2023-10-05T19:51:21.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5125fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b86442330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:21.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5125fe700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b86442330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45560/0 (socket says 172.21.15.167:45560) 2023-10-05T19:51:21.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 learned_addr learned my addr 172.21.15.167:0/3123522966 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:21.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.229+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4001e10 con 0x563b8643c8a0 2023-10-05T19:51:21.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe5125fe700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b86442330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0067a0 tx=0x7fe4fc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:21.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe4e17ea700 1 -- 172.21.15.167:0/3123522966 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4fc01a040 con 0x563b8643c8a0 2023-10-05T19:51:21.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe4e17ea700 1 -- 172.21.15.167:0/3123522966 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc004330 con 0x563b8643c8a0 2023-10-05T19:51:21.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b86442930 con 0x563b8643c8a0 2023-10-05T19:51:21.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe4e17ea700 1 -- 172.21.15.167:0/3123522966 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4fc014950 con 0x563b8643c8a0 2023-10-05T19:51:21.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b86442dd0 con 0x563b8643c8a0 2023-10-05T19:51:21.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe4e17ea700 1 -- 172.21.15.167:0/3123522966 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fe4fc014ab0 con 0x563b8643c8a0 2023-10-05T19:51:21.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe4e17ea700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe458030ca0 0x7fe458033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:21.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe4e17ea700 1 -- 172.21.15.167:0/3123522966 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7fe4fc027040 con 0x563b8643c8a0 2023-10-05T19:51:21.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe513600700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe458030ca0 0x7fe458033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:21.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8644cf50 0x563b8644f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:21.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8644f9b0 con 0x563b8644cf50 2023-10-05T19:51:21.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe512dff700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8644cf50 0x563b8644f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:21.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.233+0000 7fe513600700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe458030ca0 0x7fe458033150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x563b8642f8e0 tx=0x7fe50c00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:21.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.237+0000 7fe512dff700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8644cf50 0x563b8644f360 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:21.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.237+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'29 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.237+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563b86450680 0x563b86452a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:21.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.237+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86453160 con 0x563b86450680 2023-10-05T19:51:21.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.237+0000 7fe5125fe700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563b86450680 0x563b86452a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:21.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.237+0000 7fe5125fe700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563b86450680 0x563b86452a60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:21.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.241+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86450680 2023-10-05T19:51:21.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.241+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86453e30 0x563b86456240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:21.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.241+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b86456970 con 0x563b86453e30 2023-10-05T19:51:21.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.241+0000 7fe513600700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86453e30 0x563b86456240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:21.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.241+0000 7fe513600700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86453e30 0x563b86456240 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:21.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.241+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.241+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b86457640 0x563b86459a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:21.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.241+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645a180 con 0x563b86457640 2023-10-05T19:51:21.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.245+0000 7fe512dff700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b86457640 0x563b86459a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:21.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.245+0000 7fe512dff700 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b86457640 0x563b86459a50 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:21.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.245+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'189 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.245+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645a7d0 con 0x563b86457640 2023-10-05T19:51:21.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.249+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'59 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.249+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645adf0 con 0x563b86453e30 2023-10-05T19:51:21.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.249+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'40 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.249+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645b410 con 0x563b8644cf50 2023-10-05T19:51:21.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.253+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.253+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645b410 con 0x563b86457640 2023-10-05T19:51:21.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.253+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'38 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.253+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645b410 con 0x563b8644cf50 2023-10-05T19:51:21.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.257+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.257+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645b4a0 con 0x563b8644cf50 2023-10-05T19:51:21.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.257+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.257+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645b4a0 con 0x563b86457640 2023-10-05T19:51:21.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.261+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'60 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.261+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645b4a0 con 0x563b86453e30 2023-10-05T19:51:21.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.261+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.261+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bac0 con 0x563b8644cf50 2023-10-05T19:51:21.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.265+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.265+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bac0 con 0x563b86457640 2023-10-05T19:51:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.265+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'46 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.269+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bac0 con 0x563b86457640 2023-10-05T19:51:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.269+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'190 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.269+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bac0 con 0x563b8644cf50 2023-10-05T19:51:21.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.273+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'50 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.273+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bac0 con 0x563b86457640 2023-10-05T19:51:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.273+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'61 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.273+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bac0 con 0x563b86453e30 2023-10-05T19:51:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.277+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.277+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bd20 con 0x563b8644cf50 2023-10-05T19:51:21.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.277+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.277+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bd20 con 0x563b86457640 2023-10-05T19:51:21.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.281+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'191 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.281+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bd20 con 0x563b8644cf50 2023-10-05T19:51:21.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.285+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'51 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.285+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bc90 con 0x563b8644cf50 2023-10-05T19:51:21.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.285+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.285+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bf00 con 0x563b86453e30 2023-10-05T19:51:21.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.289+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.289+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bf00 con 0x563b8644cf50 2023-10-05T19:51:21.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.289+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'31 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.289+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bf00 con 0x563b86453e30 2023-10-05T19:51:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.293+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'21 uv20 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.293+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645bf00 con 0x563b86453e30 2023-10-05T19:51:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.293+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'41 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.293+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645c300 con 0x563b86453e30 2023-10-05T19:51:21.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.297+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'27 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.297+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645c300 con 0x563b8644cf50 2023-10-05T19:51:21.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.301+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'34 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.301+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645c300 con 0x563b86457640 2023-10-05T19:51:21.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.301+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'39 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.301+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645c300 con 0x563b8644cf50 2023-10-05T19:51:21.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.305+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'52 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.305+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645c300 con 0x563b86457640 2023-10-05T19:51:21.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.305+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'47 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.305+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8645c300 con 0x563b86450680 2023-10-05T19:51:21.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.309+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86450680 2023-10-05T19:51:21.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.313+0000 7fe4527fc700 20 reqs_thread_entry: start 2023-10-05T19:51:21.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.313+0000 7fe443fff700 20 reqs_thread_entry: start 2023-10-05T19:51:21.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.313+0000 7fe5152cae40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:21.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.313+0000 7fe5152cae40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:21.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.313+0000 7fe4427fc700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:50 2023 2023-10-05T19:51:21.293 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.313+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.313+0000 7fe441ffb700 20 reqs_thread_entry: start 2023-10-05T19:51:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.313+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(33 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.313+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.317+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(34 gc.0 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.317+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:35 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.317+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(35 gc.0 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.317+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:36 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86450680 2023-10-05T19:51:21.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.317+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(36 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86450680 2023-10-05T19:51:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.317+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:37 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86450680 2023-10-05T19:51:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.317+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(37 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86450680 2023-10-05T19:51:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.321+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:38 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86450680 2023-10-05T19:51:21.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.321+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(38 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86450680 2023-10-05T19:51:21.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.321+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:39 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.321+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(39 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.321+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:40 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86453e30 2023-10-05T19:51:21.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.321+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(40 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.321+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.321+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(41 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.321+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(42 gc.3 [call out=15b] v0'0 uv182 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:43 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(43 gc.3 [call out=24b] v0'0 uv182 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:44 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(44 gc.3 [call out=15b] v0'0 uv182 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:45 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(45 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:46 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(46 gc.4 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(47 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.325+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:48 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(48 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86453e30 2023-10-05T19:51:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(49 gc.5 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:50 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(50 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(51 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(52 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.329+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:53 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(53 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:54 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(54 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(55 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:56 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(56 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(57 gc.8 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.333+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:58 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.337+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(58 gc.8 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.337+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:59 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.337+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(59 gc.8 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.337+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.337+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(60 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.337+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:61 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(61 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:62 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(62 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(63 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(64 gc.10 [call out=24b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:65 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(65 gc.10 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.341+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:66 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(66 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:67 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86453e30 2023-10-05T19:51:21.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(67 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:68 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(68 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:69 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(69 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:70 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(70 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.345+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(71 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:72 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(72 gc.13 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:73 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(73 gc.13 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:74 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(74 gc.13 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:75 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(75 gc.14 [call out=15b] v0'0 uv184 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.349+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.353+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(76 gc.14 [call out=24b] v0'0 uv184 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.353+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.353+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(77 gc.14 [call out=15b] v0'0 uv184 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.353+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.353+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(78 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.580 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.353+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.357+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(79 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.357+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:80 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.357+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(80 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.357+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:81 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.357+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(81 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.357+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:82 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.357+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(82 gc.16 [call out=24b] v0'0 uv58 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.357+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:83 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.357+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(83 gc.16 [call out=15b] v0'0 uv58 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.361+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:84 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.361+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(84 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.361+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:85 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86453e30 2023-10-05T19:51:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.361+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(85 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.361+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:86 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.361+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(86 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.361+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:87 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.361+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(87 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.361+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.365+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(88 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.365+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.365+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(89 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.365+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:90 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.365+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(90 gc.19 [call out=15b] v0'0 uv186 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.365+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:91 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.365+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(91 gc.19 [call out=24b] v0'0 uv186 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.365+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:92 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.369+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(92 gc.19 [call out=15b] v0'0 uv186 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.369+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.369+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(93 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.369+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.369+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(94 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.369+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.369+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.369+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.373+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(96 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.373+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.586 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.373+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(97 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.373+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.373+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.373+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:99 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.373+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(99 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86453e30 2023-10-05T19:51:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(100 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(102 gc.23 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(103 gc.23 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(104 gc.23 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.377+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(105 gc.24 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:106 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86453e30 2023-10-05T19:51:21.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(106 gc.24 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(107 gc.24 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(108 gc.25 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86453e30 2023-10-05T19:51:21.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(109 gc.25 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.381+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(111 gc.26 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86453e30 2023-10-05T19:51:21.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(112 gc.26 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86453e30 2023-10-05T19:51:21.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe513600700 1 -- 172.21.15.167:0/3123522966 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50c033040 con 0x563b86453e30 2023-10-05T19:51:21.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(114 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.385+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:115 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(115 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(116 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(117 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(118 gc.28 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:119 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(119 gc.28 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.389+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.393+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 46 ==== osd_op_reply(120 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.393+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b8644cf50 2023-10-05T19:51:21.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.393+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 47 ==== osd_op_reply(121 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.393+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b8644cf50 2023-10-05T19:51:21.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.393+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.0 v2:172.21.15.118:6800/26580 48 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8644cf50 2023-10-05T19:51:21.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.393+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:123 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(123 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86457640 2023-10-05T19:51:21.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(124 gc.30 [call out=24b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86457640 2023-10-05T19:51:21.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe50401cc00 con 0x563b86457640 2023-10-05T19:51:21.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:126 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86450680 2023-10-05T19:51:21.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(126 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86450680 2023-10-05T19:51:21.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:127 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864ba5c0 con 0x563b86450680 2023-10-05T19:51:21.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(127 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86450680 2023-10-05T19:51:21.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.397+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:128 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864bb5d0 con 0x563b86450680 2023-10-05T19:51:21.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.401+0000 7fe5125fe700 1 -- 172.21.15.167:0/3123522966 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(128 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86450680 2023-10-05T19:51:21.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.401+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94813655568864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864792b0 con 0x563b8641de90 2023-10-05T19:51:21.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.401+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 notify.0 [watch unwatch cookie 94813655568864] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:21.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.401+0000 7fe5152cae40 20 remove_watcher() i=0 2023-10-05T19:51:21.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.401+0000 7fe5152cae40 2 removed watcher, disabling cache 2023-10-05T19:51:21.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.401+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94813655574384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b864291e0 con 0x563b863ec460 2023-10-05T19:51:21.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.405+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 notify.1 [watch unwatch cookie 94813655574384] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:21.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.405+0000 7fe5152cae40 20 remove_watcher() i=1 2023-10-05T19:51:21.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.405+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94813655575488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642a770 con 0x563b8641de90 2023-10-05T19:51:21.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.409+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 notify.2 [watch unwatch cookie 94813655575488] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:21.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.409+0000 7fe5152cae40 20 remove_watcher() i=2 2023-10-05T19:51:21.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.409+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94813655577408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642ac60 con 0x7fe504007030 2023-10-05T19:51:21.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.409+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(105 notify.3 [watch unwatch cookie 94813655577408] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:21.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.409+0000 7fe5152cae40 20 remove_watcher() i=3 2023-10-05T19:51:21.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.409+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94813655579968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642ac60 con 0x563b8641de90 2023-10-05T19:51:21.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.413+0000 7fe512dff700 1 -- 172.21.15.167:0/2310669886 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [watch unwatch cookie 94813655579968] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50401cc00 con 0x563b8641de90 2023-10-05T19:51:21.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.413+0000 7fe5152cae40 20 remove_watcher() i=4 2023-10-05T19:51:21.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.413+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94813655584272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642ac60 con 0x563b86421c40 2023-10-05T19:51:21.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.413+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(107 notify.5 [watch unwatch cookie 94813655584272] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:21.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.413+0000 7fe5152cae40 20 remove_watcher() i=5 2023-10-05T19:51:21.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.413+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94813655581072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642ac60 con 0x563b86421c40 2023-10-05T19:51:21.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.417+0000 7fe5125fe700 1 -- 172.21.15.167:0/2310669886 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.6 [watch unwatch cookie 94813655581072] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4fc01d040 con 0x563b86421c40 2023-10-05T19:51:21.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.417+0000 7fe5152cae40 20 remove_watcher() i=6 2023-10-05T19:51:21.749 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.417+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94813655591344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642ac60 con 0x7fe504007030 2023-10-05T19:51:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.417+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(109 notify.7 [watch unwatch cookie 94813655591344] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x7fe504007030 2023-10-05T19:51:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.417+0000 7fe5152cae40 20 remove_watcher() i=7 2023-10-05T19:51:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.421+0000 7fe4e37ee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.421+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:110 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94813655592816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8642ac60 con 0x563b863ec460 2023-10-05T19:51:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.421+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(110 data_loggenerations_metadata [watch unwatch cookie 94813655592816] v32'192 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe50c033040 con 0x563b863ec460 2023-10-05T19:51:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.421+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8641de90 msgr2=0x563b864210d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.421+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8641de90 0x563b864210d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.421+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b863ec460 msgr2=0x563b8641d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.421+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b863ec460 0x563b8641d080 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe504007030 msgr2=0x7fe504045eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fe504007030 0x7fe504045eb0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86421c40 msgr2=0x563b86425ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86421c40 0x563b86425ea0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe4f8030ca0 msgr2=0x7fe4f8033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe4f8030ca0 0x7fe4f8033150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0044f0 tx=0x7fe4fc006690 comp rx=0 tx=0).stop 2023-10-05T19:51:21.751 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 msgr2=0x563b86411690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe513600700 1 -- 172.21.15.167:0/2310669886 reap_dead start 2023-10-05T19:51:21.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b86411690 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe50401f040 tx=0x7fe50401c000 comp rx=0 tx=0).stop 2023-10-05T19:51:21.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 shutdown_connections 2023-10-05T19:51:21.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/2310669886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b863ebb50 0x563b86411690 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 >> 172.21.15.167:0/2310669886 conn(0x563b8635f5c0 msgr2=0x563b86405010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:21.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 shutdown_connections 2023-10-05T19:51:21.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/2310669886 wait complete. 2023-10-05T19:51:21.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8644cf50 msgr2=0x563b8644f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8644cf50 0x563b8644f360 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b86457640 msgr2=0x563b86459a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b86457640 0x563b86459a50 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563b86450680 msgr2=0x563b86452a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x563b86450680 0x563b86452a60 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86453e30 msgr2=0x563b86456240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b86453e30 0x563b86456240 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:21.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe458030ca0 msgr2=0x7fe458033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fe458030ca0 0x7fe458033150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x563b8642f8e0 tx=0x7fe50c00e040 comp rx=0 tx=0).stop 2023-10-05T19:51:21.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 msgr2=0x563b86442330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:21.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 --2- 172.21.15.167:0/3123522966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8643c8a0 0x563b86442330 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc0067a0 tx=0x7fe4fc030000 comp rx=0 tx=0).stop 2023-10-05T19:51:21.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 reap_dead start 2023-10-05T19:51:21.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe512dff700 1 -- 172.21.15.167:0/3123522966 reap_dead start 2023-10-05T19:51:21.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 shutdown_connections 2023-10-05T19:51:21.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 >> 172.21.15.167:0/3123522966 conn(0x563b86437c60 msgr2=0x563b86435d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:21.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 shutdown_connections 2023-10-05T19:51:21.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:20.425+0000 7fe5152cae40 1 -- 172.21.15.167:0/3123522966 wait complete. 2023-10-05T19:51:21.902 INFO:teuthology.orchestra.run.smithi167.stdout:[] 2023-10-05T19:51:21.903 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T19:51:21.903 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2023-10-05T19:51:21.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2023-10-05T19:51:21.903 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2023-10-05T19:51:21.945 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:51:22.050 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:51:22.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 Processor -- start 2023-10-05T19:51:22.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 -- start start 2023-10-05T19:51:22.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a5cecdb260 0x55a5ced69630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a5cecb3bd0 con 0x55a5cecdc570 2023-10-05T19:51:22.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a5cec70ee0 con 0x55a5cecdb260 2023-10-05T19:51:22.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5af58700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a5cecdb260 0x55a5ced69630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5af58700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55a5cecdb260 0x55a5ced69630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45566/0 (socket says 172.21.15.167:45566) 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5af58700 1 -- 172.21.15.167:0/1109341262 learned_addr learned my addr 172.21.15.167:0/1109341262 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5b759700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55a5cecdc570 0x55a5cecdab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:38408/0 (socket says 172.21.15.167:38408) 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5af58700 1 -- 172.21.15.167:0/1109341262 >> v1:172.21.15.118:6789/0 conn(0x55a5cecdc570 legacy=0x55a5cecdab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5af58700 1 -- 172.21.15.167:0/1109341262 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5cecdca00 con 0x55a5cecdb260 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5af58700 1 --2- 172.21.15.167:0/1109341262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced69630 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00a650 tx=0x7f7a4c005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fbcae7a7a07b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5a757700 1 -- 172.21.15.167:0/1109341262 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c008760 con 0x55a5cecdb260 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5a757700 1 -- 172.21.15.167:0/1109341262 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0088c0 con 0x55a5cecdb260 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5a757700 1 -- 172.21.15.167:0/1109341262 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c008bb0 con 0x55a5cecdb260 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1109341262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 msgr2=0x55a5ced69630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/1109341262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced69630 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00a650 tx=0x7f7a4c005b10 comp rx=0 tx=0).stop 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1109341262 shutdown_connections 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/1109341262 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced69630 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1109341262 >> 172.21.15.167:0/1109341262 conn(0x55a5ced62340 msgr2=0x55a5ced64750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1109341262 shutdown_connections 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.941+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1109341262 wait complete. 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 Processor -- start 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 -- start start 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced8bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cec34e30 con 0x55a5cecdb260 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5b759700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced8bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5b759700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced8bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45568/0 (socket says 172.21.15.167:45568) 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5b759700 1 -- 172.21.15.167:0/1878802490 learned_addr learned my addr 172.21.15.167:0/1878802490 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5b759700 1 -- 172.21.15.167:0/1878802490 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c005db0 con 0x55a5cecdb260 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5b759700 1 --2- 172.21.15.167:0/1878802490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced8bf90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7a44006fa0 tx=0x7f7a44006b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416952ba4dc86175 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a59755700 1 -- 172.21.15.167:0/1878802490 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a44006110 con 0x55a5cecdb260 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a59755700 1 -- 172.21.15.167:0/1878802490 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a44006270 con 0x55a5cecdb260 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a59755700 1 -- 172.21.15.167:0/1878802490 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a440135a0 con 0x55a5cecdb260 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1878802490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 msgr2=0x55a5ced8bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/1878802490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced8bf90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7a44006fa0 tx=0x7f7a44006b50 comp rx=0 tx=0).stop 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1878802490 shutdown_connections 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/1878802490 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced8bf90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1878802490 >> 172.21.15.167:0/1878802490 conn(0x55a5ced62340 msgr2=0x55a5ced87b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1878802490 shutdown_connections 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/1878802490 wait complete. 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.945+0000 7f7a5dc24e40 1 Processor -- start 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5dc24e40 1 -- start start 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5dc24e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced92d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5dc24e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cec07ed0 con 0x55a5cecdb260 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5b759700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced92d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5b759700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced92d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45576/0 (socket says 172.21.15.167:45576) 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 learned_addr learned my addr 172.21.15.167:0/2665515707 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:22.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5cecb3bd0 con 0x55a5cecdb260 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5b759700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced92d60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7a44000f80 tx=0x7f7a44014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a537fe700 1 -- 172.21.15.167:0/2665515707 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a44006110 con 0x55a5cecdb260 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a537fe700 1 -- 172.21.15.167:0/2665515707 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a44013e10 con 0x55a5cecdb260 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a5ced932a0 con 0x55a5cecdb260 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a537fe700 1 -- 172.21.15.167:0/2665515707 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a44004af0 con 0x55a5cecdb260 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.949+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5ced936e0 con 0x55a5cecdb260 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a537fe700 1 -- 172.21.15.167:0/2665515707 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7a4401a070 con 0x55a5cecdb260 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a537fe700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a3c030c50 0x7f7a3c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a537fe700 1 -- 172.21.15.167:0/2665515707 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f7a44044d60 con 0x55a5cecdb260 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5af58700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a3c030c50 0x7f7a3c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cecdc570 0x55a5ced9e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ced9ef10 con 0x55a5cecdc570 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5bf5a700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cecdc570 0x55a5ced9e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5bf5a700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cecdc570 0x55a5ced9e7e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5af58700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a3c030c50 0x7f7a3c033100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0030a0 tx=0x7f7a4c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a5400a500 con 0x55a5cecdc570 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 20 realm 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ced9bdd0 con 0x55a5cecdc570 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a5400a500 con 0x55a5cecdc570 2023-10-05T19:51:22.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:51:22.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ced9fa40 con 0x55a5cecdc570 2023-10-05T19:51:22.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a5400a500 con 0x55a5cecdc570 2023-10-05T19:51:22.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5ced9f670 0x55a5ceda2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda2f80 con 0x55a5ced9f670 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.953+0000 7f7a5b759700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5ced9f670 0x55a5ceda2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5b759700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5ced9f670 0x55a5ceda2850 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda3820 con 0x55a5cecdc570 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7a5400a500 con 0x55a5cecdc570 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5dc24e40 20 searching for the correct realm 2023-10-05T19:51:22.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5ceda55e0 0x55a5ceda79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ceda55e0 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5af58700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5ceda55e0 0x55a5ceda79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5af58700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5ceda55e0 0x55a5ceda79c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ced9f670 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5b759700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a440106e0 0x7f7a440123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x7f7a440106e0 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.957+0000 7f7a5bf5a700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a440106e0 0x7f7a440123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5bf5a700 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a440106e0 0x7f7a440123c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x7f7a440106e0 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ceda55e0 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ced9f670 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.961+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ced9f670 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x7f7a440106e0 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x7f7a440106e0 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x7f7a440106e0 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x7f7a440106e0 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ced9f670 2023-10-05T19:51:22.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ceda55e0 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.965+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ced9f670 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ceda55e0 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ceda55e0 2023-10-05T19:51:22.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x7f7a440106e0 2023-10-05T19:51:22.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x7f7a440106e0 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.969+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5cecdc570 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x7f7a440106e0 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x7f7a440106e0 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ceda55e0 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x7f7a440106e0 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x7f7a440106e0 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ced9f670 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ced9f670 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.973+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ceda55e0 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ced9f670 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda7fd0 con 0x55a5ced9f670 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:22.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda4390 con 0x55a5cecdc570 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda4ce0 con 0x55a5ced9f670 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.977+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8440 con 0x55a5ced9f670 2023-10-05T19:51:22.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:22.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda87f0 con 0x55a5ceda55e0 2023-10-05T19:51:22.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda4880 con 0x55a5ced9f670 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaa4a0 con 0x55a5ceda55e0 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.981+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaa4a0 con 0x55a5ced9f670 2023-10-05T19:51:22.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaa4a0 con 0x7f7a440106e0 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x7f7a440106e0 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ceda55e0 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.985+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ced9f670 2023-10-05T19:51:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ced9f670 2023-10-05T19:51:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x7f7a440106e0 2023-10-05T19:51:22.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x7f7a440106e0 2023-10-05T19:51:22.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x7f7a440106e0 2023-10-05T19:51:22.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x7f7a440106e0 2023-10-05T19:51:22.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.989+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ced9f670 2023-10-05T19:51:22.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ceda55e0 2023-10-05T19:51:22.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ced9f670 2023-10-05T19:51:22.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ceda55e0 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54014040 con 0x55a5cecdc570 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.993+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ceda55e0 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x7f7a440106e0 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5cecdc570 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x7f7a440106e0 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ceda55e0 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:21.997+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x7f7a440106e0 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ced9f670 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ced9f670 2023-10-05T19:51:22.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ceda55e0 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ced9f670 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda8ba0 con 0x55a5ced9f670 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5dc24e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5dc24e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5dc24e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:22.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5dc24e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.001+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda9490 con 0x55a5ced9f670 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceda9840 con 0x55a5cecdc570 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaa0e0 con 0x55a5ced9f670 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:22.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaa0e0 con 0x55a5ced9f670 2023-10-05T19:51:22.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:22.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.005+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaa1e0 con 0x7f7a440106e0 2023-10-05T19:51:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 zone default found 2023-10-05T19:51:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 4 Realm: () 2023-10-05T19:51:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:51:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:51:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:51:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 zonegroup default 2023-10-05T19:51:22.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaa1e0 con 0x7f7a440106e0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedabb60 con 0x55a5ceda55e0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedabf10 con 0x55a5ceda55e0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 started sync module instance, tier type = 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.009+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedab220 con 0x55a5ced9f670 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.013+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.013+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94170628402480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedab740 con 0x55a5ced9f670 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.013+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedab1b0 con 0x55a5cecdc570 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.013+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94170628402480] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.017+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.017+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94170628408000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedab1b0 con 0x55a5cecdc570 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.017+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedad260 con 0x55a5ced9f670 2023-10-05T19:51:22.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.017+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94170628408000] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.017+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.017+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94170628409104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedad260 con 0x55a5ced9f670 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.017+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedadb00 con 0x7f7a440106e0 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.021+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.021+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94170628412288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedadd00 con 0x7f7a440106e0 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.021+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedae860 con 0x55a5ced9f670 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.021+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94170628409104] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.021+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94170628412288] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.021+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.021+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94170628410736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedae330 con 0x55a5ced9f670 2023-10-05T19:51:22.610 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.021+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaf150 con 0x55a5ceda55e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.025+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.025+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94170628418656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedae330 con 0x55a5ceda55e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.025+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedb0050 con 0x55a5ceda55e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.025+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94170628410736] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.025+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94170628418656] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.025+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.025+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94170628422496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedb0400 con 0x55a5ceda55e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.025+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedb0ca0 con 0x7f7a440106e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94170628422496] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a4c012450 con 0x55a5ceda55e0 2023-10-05T19:51:22.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94170628426208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedad850 con 0x7f7a440106e0 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 20 add_watcher() i=0 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 20 add_watcher() i=1 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 20 add_watcher() i=2 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 20 add_watcher() i=3 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 20 add_watcher() i=4 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 20 add_watcher() i=5 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 20 add_watcher() i=6 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94170628426208] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 20 add_watcher() i=7 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedb43e0 con 0x55a5cecdc570 2023-10-05T19:51:22.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.029+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94170628427312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedb18a0 con 0x55a5cecdc570 2023-10-05T19:51:22.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94170628427312] v32'193 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a2cfe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:22.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5dc24e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:51:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5dc24e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:51:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5dc24e40 1 Processor -- start 2023-10-05T19:51:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5dc24e40 1 -- start start 2023-10-05T19:51:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5dc24e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedbedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5dc24e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cedbf300 con 0x55a5cedbe9f0 2023-10-05T19:51:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5af58700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedbedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5af58700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedbedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45582/0 (socket says 172.21.15.167:45582) 2023-10-05T19:51:22.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5af58700 1 -- 172.21.15.167:0/2774545107 learned_addr learned my addr 172.21.15.167:0/2774545107 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:22.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5af58700 1 -- 172.21.15.167:0/2774545107 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5cedbf440 con 0x55a5cedbe9f0 2023-10-05T19:51:22.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f7a5af58700 1 --2- 172.21.15.167:0/2774545107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedbedc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55a5cecdc9d0 tx=0x7f7a4c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d8b7c198afe713 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f79a7fff700 1 -- 172.21.15.167:0/2774545107 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c02d040 con 0x55a5cedbe9f0 2023-10-05T19:51:22.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f79a7fff700 1 -- 172.21.15.167:0/2774545107 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c028890 con 0x55a5cedbe9f0 2023-10-05T19:51:22.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.033+0000 7f79a7fff700 1 -- 172.21.15.167:0/2774545107 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c012a00 con 0x55a5cedbe9f0 2023-10-05T19:51:22.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2774545107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 msgr2=0x55a5cedbedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2774545107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedbedc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55a5cecdc9d0 tx=0x7f7a4c012000 comp rx=0 tx=0).stop 2023-10-05T19:51:22.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2774545107 shutdown_connections 2023-10-05T19:51:22.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2774545107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedbedc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2774545107 >> 172.21.15.167:0/2774545107 conn(0x55a5cedb9db0 msgr2=0x55a5cedb7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:22.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2774545107 shutdown_connections 2023-10-05T19:51:22.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2774545107 wait complete. 2023-10-05T19:51:22.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 Processor -- start 2023-10-05T19:51:22.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 -- start start 2023-10-05T19:51:22.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedc44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cedc54d0 con 0x55a5cedbe9f0 2023-10-05T19:51:22.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5af58700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedc44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5af58700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedc44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45586/0 (socket says 172.21.15.167:45586) 2023-10-05T19:51:22.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5af58700 1 -- 172.21.15.167:0/4168079852 learned_addr learned my addr 172.21.15.167:0/4168079852 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:22.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5af58700 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5cecdca00 con 0x55a5cedbe9f0 2023-10-05T19:51:22.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5af58700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedc44d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x55a5cedb8a70 tx=0x7f7a4c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f79a67fc700 1 -- 172.21.15.167:0/4168079852 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c009640 con 0x55a5cedbe9f0 2023-10-05T19:51:22.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f79a67fc700 1 -- 172.21.15.167:0/4168079852 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0097a0 con 0x55a5cedbe9f0 2023-10-05T19:51:22.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f79a67fc700 1 -- 172.21.15.167:0/4168079852 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c009930 con 0x55a5cedbe9f0 2023-10-05T19:51:22.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a5cedc4ad0 con 0x55a5cedbe9f0 2023-10-05T19:51:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.037+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5cedc4f70 con 0x55a5cedbe9f0 2023-10-05T19:51:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.041+0000 7f79a67fc700 1 -- 172.21.15.167:0/4168079852 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7a4c009a90 con 0x55a5cedbe9f0 2023-10-05T19:51:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.041+0000 7f79a67fc700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f799c030c50 0x7f799c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.041+0000 7f79a67fc700 1 -- 172.21.15.167:0/4168079852 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f7a4c046cf0 con 0x55a5cedbe9f0 2023-10-05T19:51:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.041+0000 7f7a5bf5a700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f799c030c50 0x7f799c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.041+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5cedcf120 0x55a5cedd1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.041+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedd1bd0 con 0x55a5cedcf120 2023-10-05T19:51:22.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.041+0000 7f7a5b759700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5cedcf120 0x55a5cedd1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.041+0000 7f7a5bf5a700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f799c030c50 0x7f799c033100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55a5cedada50 tx=0x7f7a5400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.041+0000 7f7a5b759700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5cedcf120 0x55a5cedd1530 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'30 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55a5cedd2930 0x55a5cedd4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedd5440 con 0x55a5cedd2930 2023-10-05T19:51:22.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5af58700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55a5cedd2930 0x55a5cedd4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5af58700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55a5cedd2930 0x55a5cedd4d10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5af58700 1 -- 172.21.15.167:0/4168079852 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a4c039020 con 0x55a5cedd2930 2023-10-05T19:51:22.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5cedd6110 0x55a5cedd8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedd8c50 con 0x55a5cedd6110 2023-10-05T19:51:22.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5bf5a700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5cedd6110 0x55a5cedd8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.045+0000 7f7a5bf5a700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5cedd6110 0x55a5cedd8520 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.049+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/4168079852 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cedd6110 2023-10-05T19:51:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.049+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cedd9920 0x55a5ceddbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:22.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.049+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceddc460 con 0x55a5cedd9920 2023-10-05T19:51:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.049+0000 7f7a5b759700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cedd9920 0x55a5ceddbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.049+0000 7f7a5b759700 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cedd9920 0x55a5ceddbd30 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.053+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'194 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.053+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceddcab0 con 0x55a5cedd9920 2023-10-05T19:51:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.053+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'62 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.053+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceddd0d0 con 0x55a5cedd6110 2023-10-05T19:51:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.053+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/4168079852 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'42 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cedd6110 2023-10-05T19:51:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.053+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5ceddd6f0 con 0x55a5cedcf120 2023-10-05T19:51:22.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.057+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.057+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedddbe0 con 0x55a5cedd9920 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.057+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'40 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.061+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedddbe0 con 0x55a5cedcf120 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.061+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.061+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedcdd90 con 0x55a5cedcf120 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.065+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.065+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedcdd90 con 0x55a5cedd9920 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.065+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'63 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.065+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedcdd30 con 0x55a5cedd6110 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.065+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/4168079852 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cedd6110 2023-10-05T19:51:22.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.065+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedce350 con 0x55a5cedcf120 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.069+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.069+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedce350 con 0x55a5cedd9920 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.073+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'48 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.073+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedce350 con 0x55a5cedd9920 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.073+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'195 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.073+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedce350 con 0x55a5cedcf120 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.077+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'53 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.077+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedce350 con 0x55a5cedd9920 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.077+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'64 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.077+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedce350 con 0x55a5cedd6110 2023-10-05T19:51:22.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.081+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/4168079852 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cedd6110 2023-10-05T19:51:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.081+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde700 con 0x55a5cedcf120 2023-10-05T19:51:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.081+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.081+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde700 con 0x55a5cedd9920 2023-10-05T19:51:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.085+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'196 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.085+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde700 con 0x55a5cedcf120 2023-10-05T19:51:22.834 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-10-05T19:51:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.089+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'54 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.089+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde700 con 0x55a5cedcf120 2023-10-05T19:51:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.089+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.089+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde700 con 0x55a5cedd6110 2023-10-05T19:51:22.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.093+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/4168079852 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cedd6110 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.093+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde700 con 0x55a5cedcf120 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.093+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'32 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.097+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde700 con 0x55a5cedd6110 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.097+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/4168079852 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'22 uv20 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cedd6110 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.097+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde700 con 0x55a5cedd6110 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.101+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/4168079852 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'43 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cedd6110 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.101+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde700 con 0x55a5cedd6110 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.101+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/4168079852 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'28 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cedd6110 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.101+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde790 con 0x55a5cedcf120 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.105+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'35 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.105+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde790 con 0x55a5cedd9920 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.105+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'41 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.105+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde790 con 0x55a5cedcf120 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.109+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'55 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedcf120 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.109+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde790 con 0x55a5cedd9920 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.113+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'49 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5cedd9920 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.113+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedde790 con 0x55a5cedd2930 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.113+0000 7f7a5af58700 1 -- 172.21.15.167:0/4168079852 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7a4c039020 con 0x55a5cedd2930 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f799b7fe700 20 reqs_thread_entry: start 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f79997fa700 20 reqs_thread_entry: start 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:22.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f79877fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:52 2023 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 20 get_system_obj_state: rctx=0x7fff4758fb48 obj=default.rgw.meta:users.uid:foo state=0x55a5cec400b0 s->prefetch_data=0 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7986ffd700 20 reqs_thread_entry: start 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cee3d790 con 0x55a5cecdc570 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:22.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.117+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cee40220 con 0x55a5cecdc570 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.121+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.121+0000 7f7a5dc24e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.121+0000 7f7a5dc24e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.121+0000 7f7a5dc24e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.121+0000 7f7a5dc24e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.121+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cee40220 con 0x7f7a440106e0 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.121+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.870 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.121+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94170628402480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedfbd40 con 0x55a5ced9f670 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.125+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94170628402480] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.125+0000 7f7a5dc24e40 20 remove_watcher() i=0 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.125+0000 7f7a5dc24e40 2 removed watcher, disabling cache 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.125+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94170628408000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaad30 con 0x55a5cecdc570 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.125+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94170628408000] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.125+0000 7f7a5dc24e40 20 remove_watcher() i=1 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.125+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94170628409104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedaad30 con 0x55a5ced9f670 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.129+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94170628409104] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.129+0000 7f7a5dc24e40 20 remove_watcher() i=2 2023-10-05T19:51:22.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.129+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94170628412288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedac7b0 con 0x7f7a440106e0 2023-10-05T19:51:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.129+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94170628412288] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.129+0000 7f7a5dc24e40 20 remove_watcher() i=3 2023-10-05T19:51:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.129+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94170628410736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedac7b0 con 0x55a5ced9f670 2023-10-05T19:51:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.133+0000 7f7a5b759700 1 -- 172.21.15.167:0/2665515707 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94170628410736] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a44025020 con 0x55a5ced9f670 2023-10-05T19:51:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.133+0000 7f7a5dc24e40 20 remove_watcher() i=4 2023-10-05T19:51:22.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.133+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94170628418656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedac7b0 con 0x55a5ceda55e0 2023-10-05T19:51:22.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.133+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94170628418656] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a4c039020 con 0x55a5ceda55e0 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.133+0000 7f7a5dc24e40 20 remove_watcher() i=5 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.133+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94170628422496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedac7b0 con 0x55a5ceda55e0 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.137+0000 7f7a5af58700 1 -- 172.21.15.167:0/2665515707 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94170628422496] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a4c039020 con 0x55a5ceda55e0 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.137+0000 7f7a5dc24e40 20 remove_watcher() i=6 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.137+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94170628426208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedac7b0 con 0x7f7a440106e0 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.137+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94170628426208] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x7f7a440106e0 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.137+0000 7f7a5dc24e40 20 remove_watcher() i=7 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a2cfe1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94170628427312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a5cedac7b0 con 0x55a5cecdc570 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94170628427312] v32'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7a54033040 con 0x55a5cecdc570 2023-10-05T19:51:22.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5ced9f670 msgr2=0x55a5ceda2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5ced9f670 0x55a5ceda2850 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cecdc570 msgr2=0x55a5ced9e7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cecdc570 0x55a5ced9e7e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a440106e0 msgr2=0x7f7a440123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a440106e0 0x7f7a440123c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5ceda55e0 msgr2=0x55a5ceda79c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5ceda55e0 0x55a5ceda79c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a3c030c50 msgr2=0x7f7a3c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a3c030c50 0x7f7a3c033100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0030a0 tx=0x7f7a4c015000 comp rx=0 tx=0).stop 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 msgr2=0x55a5ced92d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/2665515707 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cecdb260 0x55a5ced92d60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7a44000f80 tx=0x7f7a44014000 comp rx=0 tx=0).stop 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5bf5a700 1 -- 172.21.15.167:0/2665515707 reap_dead start 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 shutdown_connections 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 >> 172.21.15.167:0/2665515707 conn(0x55a5ced62340 msgr2=0x55a5ced865d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 shutdown_connections 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/2665515707 wait complete. 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5cedcf120 msgr2=0x55a5cedd1530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55a5cedcf120 0x55a5cedd1530 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cedd9920 msgr2=0x55a5ceddbd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55a5cedd9920 0x55a5ceddbd30 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55a5cedd2930 msgr2=0x55a5cedd4d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55a5cedd2930 0x55a5cedd4d10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5cedd6110 msgr2=0x55a5cedd8520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.141+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55a5cedd6110 0x55a5cedd8520 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f799c030c50 msgr2=0x7f799c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f799c030c50 0x7f799c033100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55a5cedada50 tx=0x7f7a5400e040 comp rx=0 tx=0).stop 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 msgr2=0x55a5cedc44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5dc24e40 1 --2- 172.21.15.167:0/4168079852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55a5cedbe9f0 0x55a5cedc44d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x55a5cedb8a70 tx=0x7f7a4c02c000 comp rx=0 tx=0).stop 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 reap_dead start 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5b759700 1 -- 172.21.15.167:0/4168079852 reap_dead start 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 shutdown_connections 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 >> 172.21.15.167:0/4168079852 conn(0x55a5cedb9db0 msgr2=0x55a5cedb7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:22.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 shutdown_connections 2023-10-05T19:51:22.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:22.145+0000 7f7a5dc24e40 1 -- 172.21.15.167:0/4168079852 wait complete. 2023-10-05T19:51:23.004 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=217 failed=True 2023-10-05T19:51:23.084 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:51:23.213 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:51:23.294 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:51:23.302 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2023-10-05T19:51:23.311 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:51:23.432 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-10-05T19:51:23.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-10-05T19:51:23.432 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2023-10-05T19:51:23.477 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:51:23.477 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:51:23.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2e02384e40 1 Processor -- start 2023-10-05T19:51:23.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2e02384e40 1 -- start start 2023-10-05T19:51:23.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2e02384e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55b1fb5014a0 0x55b1fb58e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2e02384e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b1fb4dabd0 con 0x55b1fb58ea30 2023-10-05T19:51:23.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2e02384e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b1fb497ee0 con 0x55b1fb5014a0 2023-10-05T19:51:23.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2dffeb9700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55b1fb5014a0 0x55b1fb58e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2dff6b8700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55b1fb58ea30 0x55b1fb590e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:38416/0 (socket says 172.21.15.167:38416) 2023-10-05T19:51:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2dff6b8700 1 -- 172.21.15.167:0/3231753859 learned_addr learned my addr 172.21.15.167:0/3231753859 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:51:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2dffeb9700 1 -- 172.21.15.167:0/3231753859 >> v1:172.21.15.118:6789/0 conn(0x55b1fb58ea30 legacy=0x55b1fb590e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2dffeb9700 1 -- 172.21.15.167:0/3231753859 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1fb592560 con 0x55b1fb5014a0 2023-10-05T19:51:23.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2dffeb9700 1 --2- 172.21.15.167:0/3231753859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb58e4f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2de800a520 tx=0x7f2de8005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a6212ae502137b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2dfeeb7700 1 -- 172.21.15.167:0/3231753859 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de800f590 con 0x55b1fb5014a0 2023-10-05T19:51:23.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2dfeeb7700 1 -- 172.21.15.167:0/3231753859 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de800f6f0 con 0x55b1fb5014a0 2023-10-05T19:51:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2dfeeb7700 1 -- 172.21.15.167:0/3231753859 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de800f880 con 0x55b1fb5014a0 2023-10-05T19:51:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2e02384e40 1 -- 172.21.15.167:0/3231753859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 msgr2=0x55b1fb58e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.473+0000 7f2e02384e40 1 --2- 172.21.15.167:0/3231753859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb58e4f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2de800a520 tx=0x7f2de8005d40 comp rx=0 tx=0).stop 2023-10-05T19:51:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- 172.21.15.167:0/3231753859 shutdown_connections 2023-10-05T19:51:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 --2- 172.21.15.167:0/3231753859 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb58e4f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- 172.21.15.167:0/3231753859 >> 172.21.15.167:0/3231753859 conn(0x55b1fb588250 msgr2=0x55b1fb58a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:23.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- 172.21.15.167:0/3231753859 shutdown_connections 2023-10-05T19:51:23.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- 172.21.15.167:0/3231753859 wait complete. 2023-10-05T19:51:23.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 Processor -- start 2023-10-05T19:51:23.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- start start 2023-10-05T19:51:23.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1fb45be30 con 0x55b1fb5014a0 2023-10-05T19:51:23.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2dffeb9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2dffeb9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45608/0 (socket says 172.21.15.167:45608) 2023-10-05T19:51:23.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2dffeb9700 1 -- 172.21.15.167:0/3425467148 learned_addr learned my addr 172.21.15.167:0/3425467148 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:23.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2dffeb9700 1 -- 172.21.15.167:0/3425467148 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de800a0e0 con 0x55b1fb5014a0 2023-10-05T19:51:23.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2dffeb9700 1 --2- 172.21.15.167:0/3425467148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b3000 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2de800a470 tx=0x7f2de8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e372db6d86e39f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2dfdeb5700 1 -- 172.21.15.167:0/3425467148 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de800f860 con 0x55b1fb5014a0 2023-10-05T19:51:23.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2dfdeb5700 1 -- 172.21.15.167:0/3425467148 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de800f9e0 con 0x55b1fb5014a0 2023-10-05T19:51:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2dfdeb5700 1 -- 172.21.15.167:0/3425467148 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de800fb90 con 0x55b1fb5014a0 2023-10-05T19:51:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- 172.21.15.167:0/3425467148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 msgr2=0x55b1fb5b3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 --2- 172.21.15.167:0/3425467148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b3000 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2de800a470 tx=0x7f2de8014000 comp rx=0 tx=0).stop 2023-10-05T19:51:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- 172.21.15.167:0/3425467148 shutdown_connections 2023-10-05T19:51:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 --2- 172.21.15.167:0/3425467148 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b3000 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- 172.21.15.167:0/3425467148 >> 172.21.15.167:0/3425467148 conn(0x55b1fb588250 msgr2=0x55b1fb5aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- 172.21.15.167:0/3425467148 shutdown_connections 2023-10-05T19:51:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.477+0000 7f2e02384e40 1 -- 172.21.15.167:0/3425467148 wait complete. 2023-10-05T19:51:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2e02384e40 1 Processor -- start 2023-10-05T19:51:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2e02384e40 1 -- start start 2023-10-05T19:51:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2e02384e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2e02384e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1fb42eed0 con 0x55b1fb5014a0 2023-10-05T19:51:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2dffeb9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2dffeb9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45626/0 (socket says 172.21.15.167:45626) 2023-10-05T19:51:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 learned_addr learned my addr 172.21.15.167:0/22806891 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1fb592560 con 0x55b1fb5014a0 2023-10-05T19:51:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2dffeb9700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b9c10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2de800a470 tx=0x7f2de801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2df7fff700 1 -- 172.21.15.167:0/22806891 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de801ce00 con 0x55b1fb5014a0 2023-10-05T19:51:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b1fb5ba150 con 0x55b1fb5014a0 2023-10-05T19:51:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2df7fff700 1 -- 172.21.15.167:0/22806891 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de8010630 con 0x55b1fb5014a0 2023-10-05T19:51:23.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2df7fff700 1 -- 172.21.15.167:0/22806891 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2de8010820 con 0x55b1fb5014a0 2023-10-05T19:51:23.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1fb5ba590 con 0x55b1fb5014a0 2023-10-05T19:51:23.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.481+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2df7fff700 1 -- 172.21.15.167:0/22806891 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2de8010a90 con 0x55b1fb5014a0 2023-10-05T19:51:23.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2df7fff700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2de0030c00 0x7f2de00330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2df7fff700 1 -- 172.21.15.167:0/22806891 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f2de802b070 con 0x55b1fb5014a0 2023-10-05T19:51:23.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b1fb58ea30 0x55b1fb5c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2dff6b8700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2de0030c00 0x7f2de00330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5c5d70 con 0x55b1fb58ea30 2023-10-05T19:51:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e006ba700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b1fb58ea30 0x55b1fb5c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2dff6b8700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2de0030c00 0x7f2de00330b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2df0001e90 tx=0x7f2df00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e006ba700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b1fb58ea30 0x55b1fb5c5760 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2df800a500 con 0x55b1fb58ea30 2023-10-05T19:51:23.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 20 realm 2023-10-05T19:51:23.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5c2dc0 con 0x55b1fb58ea30 2023-10-05T19:51:23.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2df800a500 con 0x55b1fb58ea30 2023-10-05T19:51:23.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:51:23.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5c6850 con 0x55b1fb58ea30 2023-10-05T19:51:23.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2df800a500 con 0x55b1fb58ea30 2023-10-05T19:51:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b1fb5c7680 0x55b1fb5c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5c9fa0 con 0x55b1fb5c7680 2023-10-05T19:51:23.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.485+0000 7f2dffeb9700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b1fb5c7680 0x55b1fb5c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2dffeb9700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b1fb5c7680 0x55b1fb5c9a60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5ca840 con 0x55b1fb58ea30 2023-10-05T19:51:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2df800a500 con 0x55b1fb58ea30 2023-10-05T19:51:23.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2e02384e40 20 searching for the correct realm 2023-10-05T19:51:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2e02384e40 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b1fb5cc600 0x55b1fb5ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5cc600 2023-10-05T19:51:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2dff6b8700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b1fb5cc600 0x55b1fb5ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2dff6b8700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b1fb5cc600 0x55b1fb5ce9e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0006070 con 0x55b1fb5cc600 2023-10-05T19:51:23.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.489+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5c7680 2023-10-05T19:51:23.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2dffeb9700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2de8044040 0x7f2de8039540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x7f2de8044040 2023-10-05T19:51:23.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2e006ba700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2de8044040 0x7f2de8039540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2e006ba700 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2de8044040 0x7f2de8039540 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x7f2de8044040 2023-10-05T19:51:23.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5cc600 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0006070 con 0x55b1fb5cc600 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.493+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5c7680 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5c7680 2023-10-05T19:51:23.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x7f2de8044040 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x7f2de8044040 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x7f2de8044040 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x7f2de8044040 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.497+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5c7680 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5cc600 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0006070 con 0x55b1fb5cc600 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5c7680 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5cc600 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0006070 con 0x55b1fb5cc600 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.501+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5cc600 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0006070 con 0x55b1fb5cc600 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x7f2de8044040 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x7f2de8044040 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb58ea30 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x7f2de8044040 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x7f2de8044040 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5cc600 2023-10-05T19:51:23.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0006070 con 0x55b1fb5cc600 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.505+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x7f2de8044040 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x7f2de8044040 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5c7680 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5c7680 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5cc600 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0006070 con 0x55b1fb5cc600 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5c7680 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.509+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cef20 con 0x55b1fb5c7680 2023-10-05T19:51:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cb3b0 con 0x55b1fb58ea30 2023-10-05T19:51:23.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.753 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cbd00 con 0x55b1fb5c7680 2023-10-05T19:51:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cf2d0 con 0x55b1fb5c7680 2023-10-05T19:51:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:23.755 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cf680 con 0x55b1fb5cc600 2023-10-05T19:51:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2df0006070 con 0x55b1fb5cc600 2023-10-05T19:51:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.513+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb58ea30 2023-10-05T19:51:23.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cb8a0 con 0x55b1fb5c7680 2023-10-05T19:51:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d1330 con 0x55b1fb5cc600 2023-10-05T19:51:23.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d1330 con 0x55b1fb5c7680 2023-10-05T19:51:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d1330 con 0x7f2de8044040 2023-10-05T19:51:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x7f2de8044040 2023-10-05T19:51:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb58ea30 2023-10-05T19:51:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.517+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb58ea30 2023-10-05T19:51:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.521+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.521+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb5cc600 2023-10-05T19:51:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.521+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.521+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb58ea30 2023-10-05T19:51:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.521+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.521+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb5c7680 2023-10-05T19:51:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.521+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.759 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.521+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb5c7680 2023-10-05T19:51:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.521+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb58ea30 2023-10-05T19:51:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x7f2de8044040 2023-10-05T19:51:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x7f2de8044040 2023-10-05T19:51:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb58ea30 2023-10-05T19:51:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x7f2de8044040 2023-10-05T19:51:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x7f2de8044040 2023-10-05T19:51:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb5c7680 2023-10-05T19:51:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.525+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5cfa30 con 0x55b1fb5cc600 2023-10-05T19:51:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb58ea30 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb5c7680 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb5cc600 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb58ea30 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8014040 con 0x55b1fb58ea30 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb58ea30 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.529+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb58ea30 2023-10-05T19:51:23.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb5cc600 2023-10-05T19:51:23.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x7f2de8044040 2023-10-05T19:51:23.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb58ea30 2023-10-05T19:51:23.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x7f2de8044040 2023-10-05T19:51:23.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb5cc600 2023-10-05T19:51:23.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x7f2de8044040 2023-10-05T19:51:23.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.533+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb5c7680 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.537+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.537+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb5c7680 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.537+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.537+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb5cc600 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.537+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.537+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb5c7680 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.537+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.537+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2df0028040 con 0x55b1fb5c7680 2023-10-05T19:51:23.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:23.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:23.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:23.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:23.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d0320 con 0x55b1fb5c7680 2023-10-05T19:51:23.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d0320 con 0x55b1fb58ea30 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d0bc0 con 0x55b1fb5c7680 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d0bc0 con 0x55b1fb5c7680 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.541+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d0cc0 con 0x7f2de8044040 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 zone default found 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 4 Realm: () 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:51:23.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 zonegroup default 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d0cc0 con 0x7f2de8044040 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d2640 con 0x55b1fb5cc600 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d29f0 con 0x55b1fb5cc600 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 started sync module instance, tier type = 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.545+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d1d00 con 0x55b1fb5c7680 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.549+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.549+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94222914754576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d2260 con 0x55b1fb5c7680 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.549+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d3780 con 0x55b1fb58ea30 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.549+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.549+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94222914754576] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.549+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94222914761360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d2260 con 0x55b1fb58ea30 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.549+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d4120 con 0x55b1fb5c7680 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.553+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94222914761360] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.553+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.553+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94222914762464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d2220 con 0x55b1fb5c7680 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.553+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d4610 con 0x7f2de8044040 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.557+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.557+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94222914765088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d4a60 con 0x7f2de8044040 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.557+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94222914762464] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.557+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d5470 con 0x55b1fb5c7680 2023-10-05T19:51:23.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.557+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94222914765088] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.557+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.557+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94222914766192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d49c0 con 0x55b1fb5c7680 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.557+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d5960 con 0x55b1fb5cc600 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.561+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.561+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94222914770032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d6200 con 0x55b1fb5cc600 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.561+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94222914766192] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.561+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d6c10 con 0x55b1fb5cc600 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.561+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94222914770032] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.561+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.561+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94222914774816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d6fc0 con 0x55b1fb5cc600 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.561+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d7860 con 0x7f2de8044040 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94222914777584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d7bb0 con 0x7f2de8044040 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 20 add_watcher() i=0 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 20 add_watcher() i=1 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 20 add_watcher() i=2 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 20 add_watcher() i=3 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 20 add_watcher() i=4 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 20 add_watcher() i=5 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94222914774816] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 20 add_watcher() i=6 2023-10-05T19:51:23.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94222914777584] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 20 add_watcher() i=7 2023-10-05T19:51:23.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d4f80 con 0x55b1fb58ea30 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.565+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94222914778752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5d8070 con 0x55b1fb58ea30 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94222914778752] v32'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2dd17e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2e02384e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2e02384e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2e02384e40 1 Processor -- start 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2e02384e40 1 -- start start 2023-10-05T19:51:23.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2e02384e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5e5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2e02384e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1fb5e5ab0 con 0x55b1fb5e51a0 2023-10-05T19:51:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2dff6b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2dff6b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5e5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45630/0 (socket says 172.21.15.167:45630) 2023-10-05T19:51:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2dff6b8700 1 -- 172.21.15.167:0/3530135616 learned_addr learned my addr 172.21.15.167:0/3530135616 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2dff6b8700 1 -- 172.21.15.167:0/3530135616 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1fb5e5bf0 con 0x55b1fb5e51a0 2023-10-05T19:51:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2dff6b8700 1 --2- 172.21.15.167:0/3530135616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5e5570 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55b1fb5cb840 tx=0x7f2df0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a4105615cc1614 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2dd0fe1700 1 -- 172.21.15.167:0/3530135616 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df003b070 con 0x55b1fb5e51a0 2023-10-05T19:51:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2dd0fe1700 1 -- 172.21.15.167:0/3530135616 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df0022040 con 0x55b1fb5e51a0 2023-10-05T19:51:23.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.569+0000 7f2dd0fe1700 1 -- 172.21.15.167:0/3530135616 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df0021040 con 0x55b1fb5e51a0 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 -- 172.21.15.167:0/3530135616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 msgr2=0x55b1fb5e5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 --2- 172.21.15.167:0/3530135616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5e5570 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55b1fb5cb840 tx=0x7f2df0010000 comp rx=0 tx=0).stop 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 -- 172.21.15.167:0/3530135616 shutdown_connections 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 --2- 172.21.15.167:0/3530135616 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5e5570 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 -- 172.21.15.167:0/3530135616 >> 172.21.15.167:0/3530135616 conn(0x55b1fb5e0560 msgr2=0x55b1fb5de6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 -- 172.21.15.167:0/3530135616 shutdown_connections 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 -- 172.21.15.167:0/3530135616 wait complete. 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 Processor -- start 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 -- start start 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5eac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1fb5ebc30 con 0x55b1fb5e51a0 2023-10-05T19:51:23.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2dff6b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2dff6b8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5eac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45644/0 (socket says 172.21.15.167:45644) 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2dff6b8700 1 -- 172.21.15.167:0/2642703780 learned_addr learned my addr 172.21.15.167:0/2642703780 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2dff6b8700 1 -- 172.21.15.167:0/2642703780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1fb4dabd0 con 0x55b1fb5e51a0 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2dff6b8700 1 --2- 172.21.15.167:0/2642703780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5eac30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55b1fb5cb2d0 tx=0x7f2df0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2d4affd700 1 -- 172.21.15.167:0/2642703780 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df0021070 con 0x55b1fb5e51a0 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2d4affd700 1 -- 172.21.15.167:0/2642703780 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df0041630 con 0x55b1fb5e51a0 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 -- 172.21.15.167:0/2642703780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b1fb5eb230 con 0x55b1fb5e51a0 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2d4affd700 1 -- 172.21.15.167:0/2642703780 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2df0046070 con 0x55b1fb5e51a0 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.573+0000 7f2e02384e40 1 -- 172.21.15.167:0/2642703780 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1fb5eb670 con 0x55b1fb5e51a0 2023-10-05T19:51:23.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.577+0000 7f2d4affd700 1 -- 172.21.15.167:0/2642703780 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2df003e020 con 0x55b1fb5e51a0 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.577+0000 7f2d4affd700 1 --2- 172.21.15.167:0/2642703780 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2d40030c50 0x7f2d40033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.577+0000 7f2d4affd700 1 -- 172.21.15.167:0/2642703780 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f2df002e040 con 0x55b1fb5e51a0 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.577+0000 7f2e006ba700 1 --2- 172.21.15.167:0/2642703780 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2d40030c50 0x7f2d40033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.577+0000 7f2e02384e40 5 note: GC not initialized 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.577+0000 7f2e006ba700 1 --2- 172.21.15.167:0/2642703780 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2d40030c50 0x7f2d40033100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55b1fb5d7b00 tx=0x7f2df800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.577+0000 7f2d3ffff700 20 reqs_thread_entry: start 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.577+0000 7f2e02384e40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.577+0000 7f2d3dffb700 20 reqs_thread_entry: start 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:23.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2d2bfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:53 2023 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2d2b7fe700 20 reqs_thread_entry: start 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 20 get_system_obj_state: rctx=0x7ffde5794580 obj=default.rgw.meta:root:myfoo state=0x55b1fb4670b0 s->prefetch_data=0 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb653d00 con 0x7f2de8044040 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:51:23.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb653c70 con 0x7f2de8044040 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 20 get_system_obj_state: rctx=0x7ffde5794580 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 state=0x55b1fb43d2b0 s->prefetch_data=0 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 : miss 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 8.15 8:aeed635a:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb6557d0 con 0x55b1fb5cc600 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 info.flags=0x16 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 to cache LRU end 2023-10-05T19:51:23.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:23.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:51:23.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:23.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 20 Read xattr: user.rgw.acl 2023-10-05T19:51:23.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:51:23.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:51:23.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.581+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 8.15 8:aeed635a:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb658360 con 0x55b1fb5cc600 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(105 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 info.flags=0x13 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 to cache LRU end 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 20 get_obj_state: rctx=0x7ffde57947c0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b1fb658c68 s->prefetch_data=0 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 3.35s0 3:ae7153e6:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb6595d0 con 0x55b1fb5c7680 2023-10-05T19:51:23.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(106 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+865 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 10 manifest: total_size = 5 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 20 get_obj_state: setting s->obj_tag to _3vcxmyVgS_IM-eJCQ0A1d_kfVPadMGv 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.585+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94222914754576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5a98a0 con 0x55b1fb5c7680 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.589+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94222914754576] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.589+0000 7f2e02384e40 20 remove_watcher() i=0 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.589+0000 7f2e02384e40 2 removed watcher, disabling cache 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.589+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94222914761360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5a98a0 con 0x55b1fb58ea30 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.589+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94222914761360] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.589+0000 7f2e02384e40 20 remove_watcher() i=1 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.589+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94222914762464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5a98a0 con 0x55b1fb5c7680 2023-10-05T19:51:23.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.593+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94222914762464] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.593+0000 7f2e02384e40 20 remove_watcher() i=2 2023-10-05T19:51:23.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.593+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94222914765088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5a98a0 con 0x7f2de8044040 2023-10-05T19:51:23.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.593+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94222914765088] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.593+0000 7f2e02384e40 20 remove_watcher() i=3 2023-10-05T19:51:23.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.593+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94222914766192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5a98a0 con 0x55b1fb5c7680 2023-10-05T19:51:23.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.597+0000 7f2dffeb9700 1 -- 172.21.15.167:0/22806891 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94222914766192] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2de803ad70 con 0x55b1fb5c7680 2023-10-05T19:51:23.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.597+0000 7f2e02384e40 20 remove_watcher() i=4 2023-10-05T19:51:23.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.597+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94222914770032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5a98a0 con 0x55b1fb5cc600 2023-10-05T19:51:23.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.597+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94222914770032] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.597+0000 7f2e02384e40 20 remove_watcher() i=5 2023-10-05T19:51:23.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.597+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94222914774816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5a98a0 con 0x55b1fb5cc600 2023-10-05T19:51:23.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.601+0000 7f2dff6b8700 1 -- 172.21.15.167:0/22806891 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94222914774816] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df0024040 con 0x55b1fb5cc600 2023-10-05T19:51:23.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.601+0000 7f2e02384e40 20 remove_watcher() i=6 2023-10-05T19:51:23.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.601+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94222914777584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5a98a0 con 0x7f2de8044040 2023-10-05T19:51:23.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.601+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94222914777584] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x7f2de8044040 2023-10-05T19:51:23.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.601+0000 7f2e02384e40 20 remove_watcher() i=7 2023-10-05T19:51:23.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2dd17e2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:23.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94222914778752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b1fb5a98a0 con 0x55b1fb58ea30 2023-10-05T19:51:23.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94222914778752] v32'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2df8033040 con 0x55b1fb58ea30 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b1fb5c7680 msgr2=0x55b1fb5c9a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55b1fb5c7680 0x55b1fb5c9a60 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b1fb58ea30 msgr2=0x55b1fb5c5760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55b1fb58ea30 0x55b1fb5c5760 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2de8044040 msgr2=0x7f2de8039540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2de8044040 0x7f2de8039540 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b1fb5cc600 msgr2=0x55b1fb5ce9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55b1fb5cc600 0x55b1fb5ce9e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2de0030c00 msgr2=0x7f2de00330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2de0030c00 0x7f2de00330b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2df0001e90 tx=0x7f2df00013b0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 msgr2=0x55b1fb5b9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e02384e40 1 --2- 172.21.15.167:0/22806891 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5014a0 0x55b1fb5b9c10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2de800a470 tx=0x7f2de801d000 comp rx=0 tx=0).stop 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.605+0000 7f2e006ba700 1 -- 172.21.15.167:0/22806891 reap_dead start 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 shutdown_connections 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 >> 172.21.15.167:0/22806891 conn(0x55b1fb588250 msgr2=0x55b1fb5ad640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 shutdown_connections 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/22806891 wait complete. 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/2642703780 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2d40030c50 msgr2=0x7f2d40033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 --2- 172.21.15.167:0/2642703780 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2d40030c50 0x7f2d40033100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55b1fb5d7b00 tx=0x7f2df800e040 comp rx=0 tx=0).stop 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/2642703780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 msgr2=0x55b1fb5eac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 --2- 172.21.15.167:0/2642703780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5eac30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55b1fb5cb2d0 tx=0x7f2df0037000 comp rx=0 tx=0).stop 2023-10-05T19:51:23.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/2642703780 shutdown_connections 2023-10-05T19:51:23.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 --2- 172.21.15.167:0/2642703780 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2d40030c50 0x7f2d40033100 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 --2- 172.21.15.167:0/2642703780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55b1fb5e51a0 0x55b1fb5eac30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:23.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/2642703780 >> 172.21.15.167:0/2642703780 conn(0x55b1fb5e0560 msgr2=0x55b1fb5de600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:23.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/2642703780 shutdown_connections 2023-10-05T19:51:23.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:23.609+0000 7f2e02384e40 1 -- 172.21.15.167:0/2642703780 wait complete. 2023-10-05T19:51:23.930 INFO:teuthology.orchestra.run.smithi167.stdout:fooFoofooFooFULL_CONTROL 2023-10-05T19:51:23.930 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2023-10-05T19:51:23.934 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2023-10-05T19:51:23.946 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:51:24.058 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-10-05T19:51:24.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-10-05T19:51:24.058 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2023-10-05T19:51:24.101 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:51:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:51:24.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea64fbe40 1 Processor -- start 2023-10-05T19:51:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea64fbe40 1 -- start start 2023-10-05T19:51:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea64fbe40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e82e7a6120 0x55e82e7a8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea64fbe40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e82e6ecbd0 con 0x55e82e7a1ba0 2023-10-05T19:51:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea64fbe40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e82e6a9ee0 con 0x55e82e7a6120 2023-10-05T19:51:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea382f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e82e7a6120 0x55e82e7a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea4030700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55e82e7a1ba0 0x55e82e7a1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:38422/0 (socket says 172.21.15.167:38422) 2023-10-05T19:51:24.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea4030700 1 -- 172.21.15.167:0/3433142070 learned_addr learned my addr 172.21.15.167:0/3433142070 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:51:24.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea382f700 1 -- 172.21.15.167:0/3433142070 >> v1:172.21.15.118:6789/0 conn(0x55e82e7a1ba0 legacy=0x55e82e7a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea382f700 1 -- 172.21.15.167:0/3433142070 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e82e7a27b0 con 0x55e82e7a6120 2023-10-05T19:51:24.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea382f700 1 --2- 172.21.15.167:0/3433142070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a6120 0x55e82e7a8500 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00a5d0 tx=0x7f7e8c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5b54285878c5a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea302e700 1 -- 172.21.15.167:0/3433142070 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e8c0086a0 con 0x55e82e7a6120 2023-10-05T19:51:24.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea302e700 1 -- 172.21.15.167:0/3433142070 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c008800 con 0x55e82e7a6120 2023-10-05T19:51:24.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.097+0000 7f7ea302e700 1 -- 172.21.15.167:0/3433142070 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e8c008ad0 con 0x55e82e7a6120 2023-10-05T19:51:24.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3433142070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a6120 msgr2=0x55e82e7a8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/3433142070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a6120 0x55e82e7a8500 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00a5d0 tx=0x7f7e8c005a50 comp rx=0 tx=0).stop 2023-10-05T19:51:24.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3433142070 shutdown_connections 2023-10-05T19:51:24.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/3433142070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a6120 0x55e82e7a8500 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3433142070 >> 172.21.15.167:0/3433142070 conn(0x55e82e715550 msgr2=0x55e82e79fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:24.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3433142070 shutdown_connections 2023-10-05T19:51:24.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3433142070 wait complete. 2023-10-05T19:51:24.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 Processor -- start 2023-10-05T19:51:24.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 -- start start 2023-10-05T19:51:24.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e715ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea64fbe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82e66de30 con 0x55e82e7a1ba0 2023-10-05T19:51:24.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea4030700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e715ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea4030700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e715ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45668/0 (socket says 172.21.15.167:45668) 2023-10-05T19:51:24.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea4030700 1 -- 172.21.15.167:0/2761422436 learned_addr learned my addr 172.21.15.167:0/2761422436 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:24.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea4030700 1 -- 172.21.15.167:0/2761422436 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c005cf0 con 0x55e82e7a1ba0 2023-10-05T19:51:24.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea4030700 1 --2- 172.21.15.167:0/2761422436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e715ef0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0014a0 tx=0x7f7e9c006b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115249fe9da6f27c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea202c700 1 -- 172.21.15.167:0/2761422436 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e9c006110 con 0x55e82e7a1ba0 2023-10-05T19:51:24.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea202c700 1 -- 172.21.15.167:0/2761422436 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c006270 con 0x55e82e7a1ba0 2023-10-05T19:51:24.109 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.101+0000 7f7ea202c700 1 -- 172.21.15.167:0/2761422436 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e9c004520 con 0x55e82e7a1ba0 2023-10-05T19:51:24.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/2761422436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 msgr2=0x55e82e715ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/2761422436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e715ef0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0014a0 tx=0x7f7e9c006b90 comp rx=0 tx=0).stop 2023-10-05T19:51:24.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/2761422436 shutdown_connections 2023-10-05T19:51:24.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/2761422436 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e715ef0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/2761422436 >> 172.21.15.167:0/2761422436 conn(0x55e82e715550 msgr2=0x55e82e7bc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:24.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/2761422436 shutdown_connections 2023-10-05T19:51:24.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/2761422436 wait complete. 2023-10-05T19:51:24.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 Processor -- start 2023-10-05T19:51:24.111 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 -- start start 2023-10-05T19:51:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e7cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea64fbe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82e640ed0 con 0x55e82e7a1ba0 2023-10-05T19:51:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea4030700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e7cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea4030700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e7cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45674/0 (socket says 172.21.15.167:45674) 2023-10-05T19:51:24.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.105+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 learned_addr learned my addr 172.21.15.167:0/292688473 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e82e6ecbd0 con 0x55e82e7a1ba0 2023-10-05T19:51:24.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea4030700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e7cbe40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x55e82e7bd3b0 tx=0x7f7e9c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea0829700 1 -- 172.21.15.167:0/292688473 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e9c004380 con 0x55e82e7a1ba0 2023-10-05T19:51:24.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea0829700 1 -- 172.21.15.167:0/292688473 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c003450 con 0x55e82e7a1ba0 2023-10-05T19:51:24.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e82e7cc380 con 0x55e82e7a1ba0 2023-10-05T19:51:24.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea0829700 1 -- 172.21.15.167:0/292688473 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e9c003720 con 0x55e82e7a1ba0 2023-10-05T19:51:24.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e82e7cc7c0 con 0x55e82e7a1ba0 2023-10-05T19:51:24.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea0829700 1 -- 172.21.15.167:0/292688473 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7e9c003880 con 0x55e82e7a1ba0 2023-10-05T19:51:24.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea0829700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7e84030ca0 0x7f7e84033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.109+0000 7f7ea0829700 1 -- 172.21.15.167:0/292688473 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f7e9c045200 con 0x55e82e7a1ba0 2023-10-05T19:51:24.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea382f700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7e84030ca0 0x7f7e84033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e82e7a6120 0x55e82e7d7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7d7fb0 con 0x55e82e7a6120 2023-10-05T19:51:24.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea4831700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e82e7a6120 0x55e82e7d7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea382f700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7e84030ca0 0x7f7e84033150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c005a90 tx=0x7f7e8c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea4831700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e82e7a6120 0x55e82e7d7900 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e9400a500 con 0x55e82e7a6120 2023-10-05T19:51:24.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 20 realm 2023-10-05T19:51:24.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7d4f60 con 0x55e82e7a6120 2023-10-05T19:51:24.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e9400a500 con 0x55e82e7a6120 2023-10-05T19:51:24.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:51:24.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7d8a90 con 0x55e82e7a6120 2023-10-05T19:51:24.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e9400a500 con 0x55e82e7a6120 2023-10-05T19:51:24.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e82e7d98c0 0x55e82e7dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7dc1e0 con 0x55e82e7d98c0 2023-10-05T19:51:24.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.113+0000 7f7ea4030700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e82e7d98c0 0x55e82e7dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea4030700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e82e7d98c0 0x55e82e7dbca0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7e9c024020 con 0x55e82e7d98c0 2023-10-05T19:51:24.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7dca80 con 0x55e82e7a6120 2023-10-05T19:51:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7e9400a500 con 0x55e82e7a6120 2023-10-05T19:51:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:24.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea64fbe40 20 searching for the correct realm 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e82e7de840 0x55e82e7e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7de840 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea382f700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e82e7de840 0x55e82e7e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea382f700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e82e7de840 0x55e82e7e0c20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7d98c0 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c024020 con 0x55e82e7d98c0 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea4030700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7e9c012740 0x7f7e9c01e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.117+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x7f7e9c012740 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7e9c012740 0x7f7e9c01e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7e9c012740 0x7f7e9c01e3f0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x7f7e9c012740 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7de840 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7d98c0 2023-10-05T19:51:24.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c024020 con 0x55e82e7d98c0 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.121+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7d98c0 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c024020 con 0x55e82e7d98c0 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x7f7e9c012740 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x7f7e9c012740 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x7f7e9c012740 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x7f7e9c012740 2023-10-05T19:51:24.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7d98c0 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c024020 con 0x55e82e7d98c0 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7de840 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.125+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7d98c0 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c024020 con 0x55e82e7d98c0 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7de840 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7de840 2023-10-05T19:51:24.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x7f7e9c012740 2023-10-05T19:51:24.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x7f7e9c012740 2023-10-05T19:51:24.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.129+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7a6120 2023-10-05T19:51:24.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x7f7e9c012740 2023-10-05T19:51:24.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x7f7e9c012740 2023-10-05T19:51:24.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7de840 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x7f7e9c012740 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x7f7e9c012740 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7d98c0 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c024020 con 0x55e82e7d98c0 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7d98c0 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.133+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7de840 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7d98c0 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1160 con 0x55e82e7d98c0 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7dd5c0 con 0x55e82e7a6120 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7dd1c0 con 0x55e82e7d98c0 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.137+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e15a0 con 0x55e82e7d98c0 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1950 con 0x55e82e7de840 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7dda00 con 0x55e82e7d98c0 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e35b0 con 0x55e82e7de840 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.141+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e35b0 con 0x55e82e7d98c0 2023-10-05T19:51:24.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e35b0 con 0x7f7e9c012740 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x7f7e9c012740 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7de840 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7d98c0 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.145+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7d98c0 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x7f7e9c012740 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x7f7e9c012740 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x7f7e9c012740 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x7f7e9c012740 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7d98c0 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.149+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7de840 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7d98c0 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7de840 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94014040 con 0x55e82e7a6120 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.153+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7de840 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x7f7e9c012740 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7a6120 2023-10-05T19:51:24.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x7f7e9c012740 2023-10-05T19:51:24.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7de840 2023-10-05T19:51:24.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.157+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x7f7e9c012740 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7d98c0 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7d98c0 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7de840 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7d98c0 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.161+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e1d00 con 0x55e82e7d98c0 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e25a0 con 0x55e82e7d98c0 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e25a0 con 0x55e82e7a6120 2023-10-05T19:51:24.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e21d0 con 0x55e82e7d98c0 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e2f10 con 0x55e82e7d98c0 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.165+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e2f10 con 0x7f7e9c012740 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 zone default found 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 4 Realm: () 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 zonegroup default 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e2f10 con 0x7f7e9c012740 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e2f10 con 0x55e82e7de840 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e4cd0 con 0x55e82e7de840 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 started sync module instance, tier type = 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:51:24.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.169+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e4390 con 0x55e82e7d98c0 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.173+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.173+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94455700801424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e5080 con 0x55e82e7d98c0 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.173+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e5920 con 0x55e82e7a6120 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.173+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.173+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94455700803712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e59c0 con 0x55e82e7a6120 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.177+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94455700801424] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.177+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e59c0 con 0x55e82e7d98c0 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.177+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94455700803712] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.177+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.177+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94455700804816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e2ac0 con 0x55e82e7d98c0 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.177+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e68c0 con 0x7f7e9c012740 2023-10-05T19:51:24.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.181+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.181+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94455700804816] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.181+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94455700807392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e2ac0 con 0x7f7e9c012740 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.181+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e6fb0 con 0x55e82e7d98c0 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.181+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94455700807392] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.181+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.181+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94455700808496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e6f70 con 0x55e82e7d98c0 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.181+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e7980 con 0x55e82e7de840 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.185+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.185+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94455700812944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e8220 con 0x55e82e7de840 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.185+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94455700808496] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.185+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e8740 con 0x55e82e7de840 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.185+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94455700812944] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.185+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.185+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94455700815152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e8fe0 con 0x55e82e7de840 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.185+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e9880 con 0x7f7e9c012740 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94455700815152] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e8c008a80 con 0x55e82e7de840 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94455700820880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7e97e0 con 0x7f7e9c012740 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 20 add_watcher() i=0 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 20 add_watcher() i=1 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 20 add_watcher() i=2 2023-10-05T19:51:24.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 20 add_watcher() i=3 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 20 add_watcher() i=4 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 20 add_watcher() i=5 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 20 add_watcher() i=6 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94455700820880] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 20 add_watcher() i=7 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 2 all 8 watchers are set, enabling cache 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7ed1a0 con 0x55e82e7a6120 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.189+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94455700823056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7ea550 con 0x55e82e7a6120 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94455700823056] v32'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7e75fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:24.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea64fbe40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea64fbe40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea64fbe40 1 Processor -- start 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea64fbe40 1 -- start start 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea64fbe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea64fbe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82e7f7fe0 con 0x55e82e7f76d0 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea382f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea382f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7f7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45686/0 (socket says 172.21.15.167:45686) 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea382f700 1 -- 172.21.15.167:0/3028607684 learned_addr learned my addr 172.21.15.167:0/3028607684 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea382f700 1 -- 172.21.15.167:0/3028607684 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e82e7f8120 con 0x55e82e7f76d0 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7ea382f700 1 --2- 172.21.15.167:0/3028607684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7f7aa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55e82e7a2bc0 tx=0x7f7e8c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd47101f93cdd898 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7e757e2700 1 -- 172.21.15.167:0/3028607684 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e8c02d040 con 0x55e82e7f76d0 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7e757e2700 1 -- 172.21.15.167:0/3028607684 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c028890 con 0x55e82e7f76d0 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.193+0000 7f7e757e2700 1 -- 172.21.15.167:0/3028607684 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e8c012900 con 0x55e82e7f76d0 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3028607684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 msgr2=0x55e82e7f7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/3028607684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7f7aa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55e82e7a2bc0 tx=0x7f7e8c012000 comp rx=0 tx=0).stop 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3028607684 shutdown_connections 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/3028607684 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7f7aa0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3028607684 >> 172.21.15.167:0/3028607684 conn(0x55e82e7f2a90 msgr2=0x55e82e7f0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3028607684 shutdown_connections 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3028607684 wait complete. 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 Processor -- start 2023-10-05T19:51:24.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 -- start start 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82e7fe140 con 0x55e82e7f76d0 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea382f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea382f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45694/0 (socket says 172.21.15.167:45694) 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea382f700 1 -- 172.21.15.167:0/3397181957 learned_addr learned my addr 172.21.15.167:0/3397181957 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea382f700 1 -- 172.21.15.167:0/3397181957 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e82e7a27b0 con 0x55e82e7f76d0 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea382f700 1 --2- 172.21.15.167:0/3397181957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7fd140 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55e82e7f1750 tx=0x7f7e8c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7def7fe700 1 -- 172.21.15.167:0/3397181957 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e8c033890 con 0x55e82e7f76d0 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7def7fe700 1 -- 172.21.15.167:0/3397181957 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c03f070 con 0x55e82e7f76d0 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3397181957 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e82e7fd740 con 0x55e82e7f76d0 2023-10-05T19:51:24.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7def7fe700 1 -- 172.21.15.167:0/3397181957 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7e8c033a50 con 0x55e82e7f76d0 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.197+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3397181957 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e82e7fdb20 con 0x55e82e7f76d0 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7def7fe700 1 -- 172.21.15.167:0/3397181957 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7e8c033bb0 con 0x55e82e7f76d0 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7def7fe700 1 --2- 172.21.15.167:0/3397181957 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7de4030c50 0x7f7de4033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7def7fe700 1 -- 172.21.15.167:0/3397181957 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f7e8c041070 con 0x55e82e7f76d0 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7ea64fbe40 5 note: GC not initialized 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7ea4831700 1 --2- 172.21.15.167:0/3397181957 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7de4030c50 0x7f7de4033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7ea4831700 1 --2- 172.21.15.167:0/3397181957 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7de4030c50 0x7f7de4033100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55e82e7e99e0 tx=0x7f7e9400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7decff9700 20 reqs_thread_entry: start 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7de27fc700 20 reqs_thread_entry: start 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7ea64fbe40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7ea64fbe40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:24.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.201+0000 7f7de0ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:54 2023 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7dc7fff700 20 reqs_thread_entry: start 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 get_system_obj_state: rctx=0x7ffcf49093c0 obj=default.rgw.meta:root:myfoo state=0x55e82e6790b0 s->prefetch_data=0 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e866270 con 0x7f7e9c012740 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:51:24.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e8661c0 con 0x7f7e9c012740 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 get_system_obj_state: rctx=0x7ffcf49093c0 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 state=0x55e82e64f2b0 s->prefetch_data=0 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 : miss 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 8.15 8:aeed635a:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e867cf0 con 0x55e82e7de840 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f7e8c039020 con 0x55e82e7de840 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 info.flags=0x16 2023-10-05T19:51:24.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 to cache LRU end 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 Read xattr: user.rgw.acl 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 8.15 8:aeed635a:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e86a880 con 0x55e82e7de840 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(105 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f7e8c039020 con 0x55e82e7de840 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 info.flags=0x13 2023-10-05T19:51:24.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 to cache LRU end 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 20 get_obj_state: rctx=0x7ffcf4909600 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55e82e86b1a8 s->prefetch_data=0 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.205+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 3.35s0 3:ae7153e6:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e86bb10 con 0x55e82e7d98c0 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.209+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(106 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.209+0000 7f7ea64fbe40 10 manifest: total_size = 5 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.209+0000 7f7ea64fbe40 20 get_obj_state: setting s->obj_tag to _xu1_CGXwiSugDXRyI8LdkkieTFclP8k 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.209+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94455700801424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f7e9c046000 con 0x55e82e7d98c0 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.209+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94455700801424] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.209+0000 7f7ea64fbe40 20 remove_watcher() i=0 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.209+0000 7f7ea64fbe40 2 removed watcher, disabling cache 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.209+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94455700803712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e7b7570 con 0x55e82e7a6120 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.213+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94455700803712] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.213+0000 7f7ea64fbe40 20 remove_watcher() i=1 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.213+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94455700804816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e864530 con 0x55e82e7d98c0 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.213+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94455700804816] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.213+0000 7f7ea64fbe40 20 remove_watcher() i=2 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.213+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94455700807392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e864530 con 0x7f7e9c012740 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.217+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94455700807392] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.217+0000 7f7ea64fbe40 20 remove_watcher() i=3 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.217+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94455700808496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e864530 con 0x55e82e7d98c0 2023-10-05T19:51:24.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.217+0000 7f7ea4030700 1 -- 172.21.15.167:0/292688473 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94455700808496] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e9c03d040 con 0x55e82e7d98c0 2023-10-05T19:51:24.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.217+0000 7f7ea64fbe40 20 remove_watcher() i=4 2023-10-05T19:51:24.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.217+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94455700812944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e864530 con 0x55e82e7de840 2023-10-05T19:51:24.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.221+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94455700812944] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e8c039020 con 0x55e82e7de840 2023-10-05T19:51:24.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.221+0000 7f7ea64fbe40 20 remove_watcher() i=5 2023-10-05T19:51:24.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.221+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94455700815152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e864530 con 0x55e82e7de840 2023-10-05T19:51:24.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.221+0000 7f7ea382f700 1 -- 172.21.15.167:0/292688473 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94455700815152] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e8c039020 con 0x55e82e7de840 2023-10-05T19:51:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.221+0000 7f7ea64fbe40 20 remove_watcher() i=6 2023-10-05T19:51:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.221+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94455700820880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e864530 con 0x7f7e9c012740 2023-10-05T19:51:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.225+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94455700820880] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x7f7e9c012740 2023-10-05T19:51:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.225+0000 7f7ea64fbe40 20 remove_watcher() i=7 2023-10-05T19:51:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.225+0000 7f7e75fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.225+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94455700823056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e82e864530 con 0x55e82e7a6120 2023-10-05T19:51:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94455700823056] v32'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7e94033040 con 0x55e82e7a6120 2023-10-05T19:51:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e82e7d98c0 msgr2=0x55e82e7dbca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e82e7d98c0 0x55e82e7dbca0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e82e7a6120 msgr2=0x55e82e7d7900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e82e7a6120 0x55e82e7d7900 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7e9c012740 msgr2=0x7f7e9c01e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7e9c012740 0x7f7e9c01e3f0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e82e7de840 msgr2=0x55e82e7e0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e82e7de840 0x55e82e7e0c20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7e84030ca0 msgr2=0x7f7e84033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7e84030ca0 0x7f7e84033150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c005a90 tx=0x7f7e8c015000 comp rx=0 tx=0).stop 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 msgr2=0x55e82e7cbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea4831700 1 -- 172.21.15.167:0/292688473 reap_dead start 2023-10-05T19:51:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e7cbe40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x55e82e7bd3b0 tx=0x7f7e9c014000 comp rx=0 tx=0).stop 2023-10-05T19:51:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 shutdown_connections 2023-10-05T19:51:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/292688473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7a1ba0 0x55e82e7cbe40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 >> 172.21.15.167:0/292688473 conn(0x55e82e715550 msgr2=0x55e82e7bb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 shutdown_connections 2023-10-05T19:51:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/292688473 wait complete. 2023-10-05T19:51:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3397181957 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7de4030c50 msgr2=0x7f7de4033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/3397181957 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7de4030c50 0x7f7de4033100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55e82e7e99e0 tx=0x7f7e9400e040 comp rx=0 tx=0).stop 2023-10-05T19:51:24.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3397181957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 msgr2=0x55e82e7fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/3397181957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7fd140 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55e82e7f1750 tx=0x7f7e8c02c000 comp rx=0 tx=0).stop 2023-10-05T19:51:24.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3397181957 shutdown_connections 2023-10-05T19:51:24.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/3397181957 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7de4030c50 0x7f7de4033100 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 --2- 172.21.15.167:0/3397181957 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e82e7f76d0 0x55e82e7fd140 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3397181957 >> 172.21.15.167:0/3397181957 conn(0x55e82e7f2a90 msgr2=0x55e82e7f0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:24.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3397181957 shutdown_connections 2023-10-05T19:51:24.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.229+0000 7f7ea64fbe40 1 -- 172.21.15.167:0/3397181957 wait complete. 2023-10-05T19:51:24.526 INFO:teuthology.orchestra.run.smithi167.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2023-10-05T19:51:24.526 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2023-10-05T19:51:24.530 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2023-10-05T19:51:24.537 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:51:24.612 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2023-10-05T19:51:24.612 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2023-10-05T19:51:24.612 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-10-05T19:51:24.612 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2023-10-05T19:51:24.612 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2023-10-05T19:51:24.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2023-10-05T19:51:24.613 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2023-10-05T19:51:24.648 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:51:24.648 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:51:24.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 Processor -- start 2023-10-05T19:51:24.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- start start 2023-10-05T19:51:24.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f2fe74ff30 0x55f2fe752310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f2fe698bd0 con 0x55f2fe74b950 2023-10-05T19:51:24.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f2fe655ee0 con 0x55f2fe74ff30 2023-10-05T19:51:24.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd6ec3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f2fe74ff30 0x55f2fe752310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd6ec3700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f2fe74ff30 0x55f2fe752310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45706/0 (socket says 172.21.15.167:45706) 2023-10-05T19:51:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/3487794888 learned_addr learned my addr 172.21.15.167:0/3487794888 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd76c4700 1 --1- 172.21.15.167:0/3487794888 >> v1:172.21.15.118:6789/0 conn(0x55f2fe74b950 0x55f2fe74bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:38432/0 (socket says 172.21.15.167:38432) 2023-10-05T19:51:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/3487794888 >> v1:172.21.15.118:6789/0 conn(0x55f2fe74b950 legacy=0x55f2fe74bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/3487794888 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2fe74c560 con 0x55f2fe74ff30 2023-10-05T19:51:24.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd6ec3700 1 --2- 172.21.15.167:0/3487794888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74ff30 0x55f2fe752310 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00a650 tx=0x7f9fcc005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47928573aaa5fde6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd66c2700 1 -- 172.21.15.167:0/3487794888 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fcc008760 con 0x55f2fe74ff30 2023-10-05T19:51:24.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd66c2700 1 -- 172.21.15.167:0/3487794888 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0088c0 con 0x55f2fe74ff30 2023-10-05T19:51:24.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd66c2700 1 -- 172.21.15.167:0/3487794888 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fcc008bb0 con 0x55f2fe74ff30 2023-10-05T19:51:24.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/3487794888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74ff30 msgr2=0x55f2fe752310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/3487794888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74ff30 0x55f2fe752310 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00a650 tx=0x7f9fcc005b10 comp rx=0 tx=0).stop 2023-10-05T19:51:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/3487794888 shutdown_connections 2023-10-05T19:51:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/3487794888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74ff30 0x55f2fe752310 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/3487794888 >> 172.21.15.167:0/3487794888 conn(0x55f2fe747370 msgr2=0x55f2fe749780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/3487794888 shutdown_connections 2023-10-05T19:51:24.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/3487794888 wait complete. 2023-10-05T19:51:24.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 Processor -- start 2023-10-05T19:51:24.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- start start 2023-10-05T19:51:24.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe6c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.645+0000 7f9fd9b8fe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2fe619e30 con 0x55f2fe74b950 2023-10-05T19:51:24.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd76c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe6c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd76c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe6c1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45714/0 (socket says 172.21.15.167:45714) 2023-10-05T19:51:24.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd76c4700 1 -- 172.21.15.167:0/112930275 learned_addr learned my addr 172.21.15.167:0/112930275 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:24.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd76c4700 1 -- 172.21.15.167:0/112930275 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc005db0 con 0x55f2fe74b950 2023-10-05T19:51:24.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd76c4700 1 --2- 172.21.15.167:0/112930275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe6c1ab0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8001cf0 tx=0x7f9fc80018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3d4d285c34ca59 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd56c0700 1 -- 172.21.15.167:0/112930275 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fc8014070 con 0x55f2fe74b950 2023-10-05T19:51:24.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd56c0700 1 -- 172.21.15.167:0/112930275 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc800be10 con 0x55f2fe74b950 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd56c0700 1 -- 172.21.15.167:0/112930275 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fc800f590 con 0x55f2fe74b950 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/112930275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 msgr2=0x55f2fe6c1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/112930275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe6c1ab0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8001cf0 tx=0x7f9fc80018a0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/112930275 shutdown_connections 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/112930275 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe6c1ab0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/112930275 >> 172.21.15.167:0/112930275 conn(0x55f2fe747370 msgr2=0x55f2fe766610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/112930275 shutdown_connections 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/112930275 wait complete. 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 Processor -- start 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 -- start start 2023-10-05T19:51:24.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe773a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd9b8fe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2fe5eced0 con 0x55f2fe74b950 2023-10-05T19:51:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd76c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe773a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd76c4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe773a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45728/0 (socket says 172.21.15.167:45728) 2023-10-05T19:51:24.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.649+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 learned_addr learned my addr 172.21.15.167:0/2156244351 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2fe698bd0 con 0x55f2fe74b950 2023-10-05T19:51:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fd76c4700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe773a20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80018e0 tx=0x7f9fc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fc77fe700 1 -- 172.21.15.167:0/2156244351 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fc801c740 con 0x55f2fe74b950 2023-10-05T19:51:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fc77fe700 1 -- 172.21.15.167:0/2156244351 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc801c8a0 con 0x55f2fe74b950 2023-10-05T19:51:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2fe773f60 con 0x55f2fe74b950 2023-10-05T19:51:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fc77fe700 1 -- 172.21.15.167:0/2156244351 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fc801cb90 con 0x55f2fe74b950 2023-10-05T19:51:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2fe7743a0 con 0x55f2fe74b950 2023-10-05T19:51:24.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fc77fe700 1 -- 172.21.15.167:0/2156244351 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9fc8023020 con 0x55f2fe74b950 2023-10-05T19:51:24.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fc77fe700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9fbc030c50 0x7f9fbc033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fc77fe700 1 -- 172.21.15.167:0/2156244351 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f9fc8008030 con 0x55f2fe74b950 2023-10-05T19:51:24.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fd6ec3700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9fbc030c50 0x7f9fbc033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe74ff30 0x55f2fe77f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe77fc10 con 0x55f2fe74ff30 2023-10-05T19:51:24.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.653+0000 7f9fd7ec5700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe74ff30 0x55f2fe77f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd7ec5700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe74ff30 0x55f2fe77f510 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd6ec3700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9fbc030c50 0x7f9fbc033100 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0030a0 tx=0x7f9fcc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 20 realm 2023-10-05T19:51:24.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe77cb30 con 0x55f2fe74ff30 2023-10-05T19:51:24.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:51:24.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7806f0 con 0x55f2fe74ff30 2023-10-05T19:51:24.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe780320 0x55f2fe783500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe783c30 con 0x55f2fe780320 2023-10-05T19:51:24.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd76c4700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe780320 0x55f2fe783500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd76c4700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe780320 0x55f2fe783500 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.657+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7844d0 con 0x55f2fe74ff30 2023-10-05T19:51:24.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:24.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd9b8fe40 20 searching for the correct realm 2023-10-05T19:51:24.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe786290 0x55f2fe788670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe786290 2023-10-05T19:51:24.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd6ec3700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe786290 0x55f2fe788670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd6ec3700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe786290 0x55f2fe788670 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe780320 2023-10-05T19:51:24.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd76c4700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9fc801a070 0x7f9fc8043740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x7f9fc801a070 2023-10-05T19:51:24.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd7ec5700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9fc801a070 0x7f9fc8043740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd7ec5700 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9fc801a070 0x7f9fc8043740 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.661+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe786290 2023-10-05T19:51:24.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe780320 2023-10-05T19:51:24.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe780320 2023-10-05T19:51:24.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.665+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x7f9fc801a070 2023-10-05T19:51:24.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x7f9fc801a070 2023-10-05T19:51:24.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe780320 2023-10-05T19:51:24.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe786290 2023-10-05T19:51:24.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.669+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe780320 2023-10-05T19:51:24.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe786290 2023-10-05T19:51:24.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe786290 2023-10-05T19:51:24.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x7f9fc801a070 2023-10-05T19:51:24.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.673+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe74ff30 2023-10-05T19:51:24.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x7f9fc801a070 2023-10-05T19:51:24.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe786290 2023-10-05T19:51:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x7f9fc801a070 2023-10-05T19:51:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe780320 2023-10-05T19:51:24.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe780320 2023-10-05T19:51:24.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.677+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe786290 2023-10-05T19:51:24.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe780320 2023-10-05T19:51:24.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.686 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe788c80 con 0x55f2fe780320 2023-10-05T19:51:24.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd9b8fe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:24.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd9b8fe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd9b8fe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd9b8fe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe785010 con 0x55f2fe74ff30 2023-10-05T19:51:24.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe784c10 con 0x55f2fe780320 2023-10-05T19:51:24.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.681+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7890f0 con 0x55f2fe780320 2023-10-05T19:51:24.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:24.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7894a0 con 0x55f2fe786290 2023-10-05T19:51:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe789850 con 0x55f2fe74ff30 2023-10-05T19:51:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7854d0 con 0x55f2fe780320 2023-10-05T19:51:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.685+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe786290 2023-10-05T19:51:24.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe780320 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x7f9fc801a070 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe786290 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.689+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe780320 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe780320 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x7f9fc801a070 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.693+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x7f9fc801a070 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe780320 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe786290 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe780320 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe786290 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.697+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe786290 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x7f9fc801a070 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe74ff30 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.701+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x7f9fc801a070 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe786290 2023-10-05T19:51:24.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x7f9fc801a070 2023-10-05T19:51:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe780320 2023-10-05T19:51:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe780320 2023-10-05T19:51:24.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe786290 2023-10-05T19:51:24.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.705+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe780320 2023-10-05T19:51:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b100 con 0x55f2fe780320 2023-10-05T19:51:24.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd9b8fe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:24.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd9b8fe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:24.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd9b8fe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:24.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd9b8fe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78a0f0 con 0x55f2fe780320 2023-10-05T19:51:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.709+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78a4a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:24.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b500 con 0x55f2fe780320 2023-10-05T19:51:24.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:24.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe789d20 con 0x55f2fe780320 2023-10-05T19:51:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:24.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b500 con 0x7f9fc801a070 2023-10-05T19:51:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 zone default found 2023-10-05T19:51:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 4 Realm: () 2023-10-05T19:51:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:51:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:51:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:51:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 zonegroup default 2023-10-05T19:51:24.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78b500 con 0x7f9fc801a070 2023-10-05T19:51:24.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.713+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78ce80 con 0x55f2fe786290 2023-10-05T19:51:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.717+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.717+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.717+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.717+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78d230 con 0x55f2fe786290 2023-10-05T19:51:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.717+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.717+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.717+0000 7f9fd9b8fe40 20 started sync module instance, tier type = 2023-10-05T19:51:24.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.717+0000 7f9fd9b8fe40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:51:24.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.717+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78c540 con 0x55f2fe780320 2023-10-05T19:51:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.721+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.721+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94502139775296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78c540 con 0x55f2fe780320 2023-10-05T19:51:24.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.721+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78dad0 con 0x55f2fe74ff30 2023-10-05T19:51:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.721+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.721+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94502139778528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78c540 con 0x55f2fe74ff30 2023-10-05T19:51:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.721+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78e6d0 con 0x55f2fe780320 2023-10-05T19:51:24.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.721+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94502139775296] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.725+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94502139778528] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.725+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.725+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94502139779632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78e1a0 con 0x55f2fe780320 2023-10-05T19:51:24.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.725+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78ea40 con 0x7f9fc801a070 2023-10-05T19:51:24.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.725+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.725+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94502139781824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78ecc0 con 0x7f9fc801a070 2023-10-05T19:51:24.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.725+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78f850 con 0x55f2fe780320 2023-10-05T19:51:24.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.725+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94502139779632] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.729+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94502139781824] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.729+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.729+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94502139766944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78f320 con 0x55f2fe780320 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.729+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe790140 con 0x55f2fe786290 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.729+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.729+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94502139788368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78f320 con 0x55f2fe786290 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe791040 con 0x55f2fe786290 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94502139766944] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94502139788368] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94502139792208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7913f0 con 0x55f2fe786290 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe791c90 con 0x7f9fc801a070 2023-10-05T19:51:24.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94502139792208] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fcc008ad0 con 0x55f2fe786290 2023-10-05T19:51:24.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94502139795360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7920e0 con 0x7f9fc801a070 2023-10-05T19:51:24.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 20 add_watcher() i=0 2023-10-05T19:51:24.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 20 add_watcher() i=1 2023-10-05T19:51:24.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 20 add_watcher() i=2 2023-10-05T19:51:24.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 20 add_watcher() i=3 2023-10-05T19:51:24.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 20 add_watcher() i=4 2023-10-05T19:51:24.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 20 add_watcher() i=5 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.733+0000 7f9fd9b8fe40 20 add_watcher() i=6 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94502139795360] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd9b8fe40 20 add_watcher() i=7 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd9b8fe40 2 all 8 watchers are set, enabling cache 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7951b0 con 0x55f2fe74ff30 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94502139796464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe792530 con 0x55f2fe74ff30 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94502139796464] v32'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9f23fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd9b8fe40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd9b8fe40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:51:24.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd9b8fe40 1 Processor -- start 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.737+0000 7f9fd9b8fe40 1 -- start start 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe79fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2fe7a0330 con 0x55f2fe79fa20 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd6ec3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe79fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd6ec3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe79fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45740/0 (socket says 172.21.15.167:45740) 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2747357568 learned_addr learned my addr 172.21.15.167:0/2747357568 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2747357568 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2fe7a0470 con 0x55f2fe79fa20 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd6ec3700 1 --2- 172.21.15.167:0/2747357568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe79fdf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x55f2fe74c9d0 tx=0x7f9fcc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c38f781cf29b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9f237fe700 1 -- 172.21.15.167:0/2747357568 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fcc02d040 con 0x55f2fe79fa20 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9f237fe700 1 -- 172.21.15.167:0/2747357568 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc028890 con 0x55f2fe79fa20 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9f237fe700 1 -- 172.21.15.167:0/2747357568 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fcc012960 con 0x55f2fe79fa20 2023-10-05T19:51:24.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2747357568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 msgr2=0x55f2fe79fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2747357568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe79fdf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x55f2fe74c9d0 tx=0x7f9fcc012000 comp rx=0 tx=0).stop 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2747357568 shutdown_connections 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2747357568 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe79fdf0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2747357568 >> 172.21.15.167:0/2747357568 conn(0x55f2fe79ade0 msgr2=0x55f2fe798f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2747357568 shutdown_connections 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2747357568 wait complete. 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 Processor -- start 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 -- start start 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe7a5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.741+0000 7f9fd9b8fe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2fe7a6520 con 0x55f2fe79fa20 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd6ec3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe7a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd6ec3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe7a5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45750/0 (socket says 172.21.15.167:45750) 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2333857201 learned_addr learned my addr 172.21.15.167:0/2333857201 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2fe74c560 con 0x55f2fe79fa20 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd6ec3700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe7a5520 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc035040 tx=0x7f9fcc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9f21ffb700 1 -- 172.21.15.167:0/2333857201 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fcc009640 con 0x55f2fe79fa20 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9f21ffb700 1 -- 172.21.15.167:0/2333857201 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0097c0 con 0x55f2fe79fa20 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f2fe7a5b20 con 0x55f2fe79fa20 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9f21ffb700 1 -- 172.21.15.167:0/2333857201 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fcc009970 con 0x55f2fe79fa20 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2fe7a5fc0 con 0x55f2fe79fa20 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9f21ffb700 1 -- 172.21.15.167:0/2333857201 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9fcc009ad0 con 0x55f2fe79fa20 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9f21ffb700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9f14030cf0 0x7f9f140331a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9f21ffb700 1 -- 172.21.15.167:0/2333857201 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f9fcc046cf0 con 0x55f2fe79fa20 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd7ec5700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9f14030cf0 0x7f9f140331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe7b0110 0x55f2fe7b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.745+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7b2b70 con 0x55f2fe7b0110 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.749+0000 7f9fd76c4700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe7b0110 0x55f2fe7b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.749+0000 7f9fd7ec5700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9f14030cf0 0x7f9f140331a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55f2fe795280 tx=0x7f9fd000ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.749+0000 7f9fd76c4700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe7b0110 0x55f2fe7b2520 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.749+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'31 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.749+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55f2fe7b3840 0x55f2fe7b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.749+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7b6320 con 0x55f2fe7b3840 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.749+0000 7f9fd6ec3700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55f2fe7b3840 0x55f2fe7b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.749+0000 7f9fd6ec3700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55f2fe7b3840 0x55f2fe7b5c20 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.753+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2333857201 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe7b3840 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.753+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe7b6ff0 0x55f2fe7b9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.753+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7b9b30 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.753+0000 7f9fd7ec5700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe7b6ff0 0x55f2fe7b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.753+0000 7f9fd7ec5700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe7b6ff0 0x55f2fe7b9400 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.757+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2333857201 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.757+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe7ba840 0x55f2fe7bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.757+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7bd350 con 0x55f2fe7ba840 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.757+0000 7f9fd76c4700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe7ba840 0x55f2fe7bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.757+0000 7f9fd76c4700 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe7ba840 0x55f2fe7bcc20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.757+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'203 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.757+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7bd9a0 con 0x55f2fe7ba840 2023-10-05T19:51:24.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.761+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'65 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.761+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7bdfc0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.761+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2333857201 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'44 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.761+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be4b0 con 0x55f2fe7b0110 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.765+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.765+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be8e0 con 0x55f2fe7ba840 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.765+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'42 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.765+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be8e0 con 0x55f2fe7b0110 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.769+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.769+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7beb50 con 0x55f2fe7b0110 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.769+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.769+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be240 con 0x55f2fe7ba840 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.773+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'66 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.773+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be240 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.773+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2333857201 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.773+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be280 con 0x55f2fe7b0110 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.777+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.777+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be240 con 0x55f2fe7ba840 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.777+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'61 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.777+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be280 con 0x55f2fe7ba840 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.781+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'204 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.781+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be240 con 0x55f2fe7b0110 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.785+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'59 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.785+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be280 con 0x55f2fe7ba840 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.785+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'67 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.785+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be240 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.789+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2333857201 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.789+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be2b0 con 0x55f2fe7b0110 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.789+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.789+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be330 con 0x55f2fe7ba840 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.793+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'205 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.793+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be330 con 0x55f2fe7b0110 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.793+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'60 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.793+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be340 con 0x55f2fe7b0110 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.797+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.797+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be330 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.801+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2333857201 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.801+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be3a0 con 0x55f2fe7b0110 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.801+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'33 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.801+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be420 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.805+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2333857201 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'23 uv20 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.805+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be4e0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.805+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2333857201 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'45 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.805+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7bef50 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.809+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2333857201 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'29 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe7b6ff0 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.809+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be4e0 con 0x55f2fe7b0110 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.813+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'39 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.813+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be4e0 con 0x55f2fe7ba840 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.813+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'43 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.813+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7bef50 con 0x55f2fe7b0110 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.817+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'61 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.817+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7be4e0 con 0x55f2fe7ba840 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.817+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'62 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7ba840 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.817+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7bef50 con 0x55f2fe7b3840 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.821+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2333857201 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe7b3840 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9f1affd700 20 reqs_thread_entry: start 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9f18ff9700 20 reqs_thread_entry: start 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:24.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9f06ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:55 2023 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 20 get_system_obj_state: rctx=0x7ffc61d551c0 obj=default.rgw.meta:root:myfoo state=0x55f2fe6250b0 s->prefetch_data=0 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9f067fc700 20 reqs_thread_entry: start 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe81e3d0 con 0x7f9fc801a070 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:24.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x11, cached=0x16) 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.825+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe81e2c0 con 0x7f9fc801a070 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 myfoo [call,call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+213 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=165 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 20 get_system_obj_state: rctx=0x7ffc61d551c0 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 state=0x55f2fe5fb2b0 s->prefetch_data=0 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 : miss 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 8.15 8:aeed635a:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe81fe50 con 0x55f2fe786290 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 info.flags=0x16 2023-10-05T19:51:24.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 to cache LRU end 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 20 Read xattr: user.rgw.acl 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 8.15 8:aeed635a:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820a50 con 0x55f2fe786290 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(105 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 info.flags=0x13 2023-10-05T19:51:24.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 to cache LRU end 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 4.3c 4:3f13b44b:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e020 con 0x55f2fe74ff30 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(106 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.829+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 4.31 4:8fe673e1:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e020 con 0x55f2fe780320 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.833+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(107 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.833+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 4.7 4:e262a283:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e020 con 0x55f2fe74ff30 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.833+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(108 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2 [call out=426b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.833+0000 7f9fd9b8fe40 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2023-10-05T19:51:24.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.833+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 4.c 4:329382a1:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e020 con 0x55f2fe74ff30 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.833+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(109 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.833+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 4.2d 4:b4e0940c:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e060 con 0x7f9fc801a070 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.837+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(110 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.837+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 4.11 4:88e0a008:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e060 con 0x55f2fe786290 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.837+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(111 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.837+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:112 4.12 4:482b0117:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e060 con 0x55f2fe74ff30 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.837+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(112 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.837+0000 7f9fd9b8fe40 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.837+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 4.25 4:a6a952c7:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e060 con 0x55f2fe780320 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.841+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(113 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.841+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:114 4.8 4:11b15712:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e060 con 0x55f2fe786290 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.841+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(114 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.841+0000 7f9fd9b8fe40 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.841+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 4.21 4:86cc95ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e060 con 0x55f2fe786290 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.841+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(115 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.9 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.841+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:116 4.1 4:829dc2ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe89e740 con 0x7f9fc801a070 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.841+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(116 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 [call out=697b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+697 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 3.23s0 3:c599d4ad:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8225b0 con 0x7f9fc801a070 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(117 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 10 manifest: total_size = 6 2023-10-05T19:51:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 20 get_obj_state: setting s->obj_tag to e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.13028352422074120011 2023-10-05T19:51:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 20 prepare_atomic_modification: state is not atomic. state=0x55f2fe8234a8 2023-10-05T19:51:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2 2023-10-05T19:51:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 4.7 4:e262a283:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe827e50 con 0x55f2fe74ff30 2023-10-05T19:51:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(118 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2 [stat,call,call] v32'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.845+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:119 3.23s0 3:c599d4ad:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe821350 con 0x7f9fc801a070 2023-10-05T19:51:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.849+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(119 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.849+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:120 4.7 4:e262a283:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe821350 con 0x55f2fe74ff30 2023-10-05T19:51:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.849+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : miss 2023-10-05T19:51:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.849+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.849+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:121 6.18 6:1df25bda:::bucket.sync-source-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe821350 con 0x7f9fc801a070 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.849+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(121 bucket.sync-source-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo info.flags=0x0 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 10 adding default.rgw.log++bucket.sync-source-hints.myfoo to cache LRU end 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : miss 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 rados->read ofs=0 len=0 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:122 6.4 6:26e4c4bc:::bucket.sync-target-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82ac10 con 0x55f2fe74ff30 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(122 bucket.sync-target-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo info.flags=0x0 2023-10-05T19:51:24.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 10 adding default.rgw.log++bucket.sync-target-hints.myfoo to cache LRU end 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 10 chain_cache_entry: cache_locator= 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:123 3.2es0 3:77db144d:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8289e0 con 0x7f9fc801a070 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(123 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 10 manifest: total_size = 3 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 get_obj_state: setting s->obj_tag to e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.9716685185051039658 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 prepare_atomic_modification: state is not atomic. state=0x55f2fe8234a8 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6 2023-10-05T19:51:24.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.853+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:124 4.12 4:482b0117:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8289e0 con 0x55f2fe74ff30 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.857+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(120 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.857+0000 7f9fd56c0700 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.857+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(124 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6 [stat,call,call] v32'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.857+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:125 3.2es0 3:77db144d:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820e60 con 0x7f9fc801a070 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(125 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:126 4.12 4:482b0117:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8289e0 con 0x55f2fe74ff30 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : hit (negative entry) 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : hit (negative entry) 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 10 chain_cache_entry: cache_locator= 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:51:24.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:127 3.19s0 3:980b046e:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe828e70 con 0x55f2fe74ff30 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(127 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 10 manifest: total_size = 4 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 20 get_obj_state: setting s->obj_tag to e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.14835204234984871243 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 20 prepare_atomic_modification: state is not atomic. state=0x55f2fe8234a8 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:128 4.8 4:11b15712:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe828e70 con 0x55f2fe786290 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(126 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6 [stat,call,call] v32'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.861+0000 7f9fd4ebf700 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2023-10-05T19:51:24.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.865+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(128 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8 [stat,call,call] v32'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.865+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:129 3.19s0 3:980b046e:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe828980 con 0x55f2fe74ff30 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.865+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(129 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.865+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:130 4.8 4:11b15712:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe826e40 con 0x55f2fe786290 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.865+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : hit (negative entry) 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.865+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : hit (negative entry) 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.865+0000 7f9fd9b8fe40 10 chain_cache_entry: cache_locator= 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.865+0000 7f9fd9b8fe40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.865+0000 7f9fd9b8fe40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:131 3.26s0 3:66feae26:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe826e40 con 0x7f9fc801a070 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 28 ==== osd_op_reply(131 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd9b8fe40 10 manifest: total_size = 5 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd9b8fe40 20 get_obj_state: setting s->obj_tag to e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.6737943302586605696 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd9b8fe40 20 prepare_atomic_modification: state is not atomic. state=0x55f2fe8234a8 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd9b8fe40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:132 4.1 4:829dc2ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe826e40 con 0x7f9fc801a070 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(130 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd56c0700 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 29 ==== osd_op_reply(132 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 [stat,call,call] v32'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.869+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:133 3.26s0 3:66feae26:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe827780 con 0x7f9fc801a070 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 30 ==== osd_op_reply(133 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:134 4.1 4:829dc2ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe826e40 con 0x7f9fc801a070 2023-10-05T19:51:24.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : hit (negative entry) 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : hit (negative entry) 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 10 chain_cache_entry: cache_locator= 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:135 3.35s0 3:ae7153e6:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe826e40 con 0x55f2fe780320 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(135 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 10 manifest: total_size = 5 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 20 get_obj_state: setting s->obj_tag to _xu1_CGXwiSugDXRyI8LdkkieTFclP8k 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 20 get_obj_state: rctx=0x7ffc61d54df0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55f2fe8234a8 s->prefetch_data=0 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 20 prepare_atomic_modification: state is not atomic. state=0x55f2fe8234a8 2023-10-05T19:51:24.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:136 4.1 4:829dc2ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82f800 con 0x7f9fc801a070 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 31 ==== osd_op_reply(134 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 [stat,call,call] v32'11 uv11 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.873+0000 7f9fd4ebf700 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 32 ==== osd_op_reply(136 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:137 3.35s0 3:ae7153e6:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe825310 con 0x55f2fe780320 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(137 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:138 4.1 4:829dc2ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82b7b0 con 0x7f9fc801a070 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : hit (negative entry) 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : hit (negative entry) 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 10 chain_cache_entry: cache_locator= 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:51:24.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:51:24.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 20 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): starting attempt 1 2023-10-05T19:51:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): :myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5]) start_after="_multipart_", prefix="_multipart_, delimiter="", shard_id=-1", num_entries=1001, list_versions=0, expansion_factor=1, force_check_filter is unset 2023-10-05T19:51:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T19:51:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:139 4.3c 4:3f13b44b:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f9fc8071000 con 0x55f2fe74ff30 2023-10-05T19:51:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:140 4.31 4:8fe673e1:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8237b0 con 0x55f2fe780320 2023-10-05T19:51:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:141 4.7 4:e262a283:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8237b0 con 0x55f2fe74ff30 2023-10-05T19:51:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:142 4.c 4:329382a1:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8237b0 con 0x55f2fe74ff30 2023-10-05T19:51:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:143 4.2d 4:b4e0940c:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8373d0 con 0x7f9fc801a070 2023-10-05T19:51:24.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:144 4.11 4:88e0a008:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe839d30 con 0x55f2fe786290 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:145 4.12 4:482b0117:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe839d30 con 0x55f2fe74ff30 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.877+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:146 4.25 4:a6a952c7:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe83ef80 con 0x55f2fe780320 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:147 4.8 4:11b15712:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8418e0 con 0x55f2fe786290 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(140 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(144 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 43 ==== osd_op_reply(139 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 44 ==== osd_op_reply(142 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 45 ==== osd_op_reply(145 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 33 ==== osd_op_reply(143 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 34 ==== osd_op_reply(138 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:148 4.21 4:86cc95ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8418e0 con 0x55f2fe786290 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:149 4.1 4:829dc2ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8232c0 con 0x7f9fc801a070 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(146 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd56c0700 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(147 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 46 ==== osd_op_reply(141 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f9fd000a5a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(148 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.9 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 35 ==== osd_op_reply(149 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f9fd000a5a0 con 0x7f9fc801a070 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, count=0, is_truncated=0 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, last_entry NOT SET 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T19:51:24.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5])"; uploads.size()=0; is_truncated=0 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5]) 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 20 lifecycle: get_system_obj_state: rctx=0x7ffc61d54888 obj=default.rgw.meta:root:myfoo state=0x55f2fe5fb2b0 s->prefetch_data=0 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x16, cached=0x13) 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8232c0 con 0x7f9fc801a070 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 36 ==== osd_op_reply(150 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv33 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7f9fd00660a0 con 0x7f9fc801a070 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 20 lifecycle: get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:24.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 20 lifecycle: Read xattr: user.rgw.idtag 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x13, cached=0x17) 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:151 8.15 8:aeed635a:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe83e950 con 0x55f2fe786290 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(151 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [delete,create,call,call,writefull 0~352,setxattr (123)] v32'4 uv4 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 info.flags=0x17 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 to cache LRU end 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 10 lifecycle: distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5, ofs0, ns] 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.881+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:152 7.9 7:93e5b521:::notify.7:head [notify cookie 94502140380736 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82b720 con 0x7f9fc801a070 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 37 ==== watch-notify(notify (1) cookie 94502139795360 notify 137438953492 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7f9fd0055040 con 0x7f9fc801a070 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd4ebf700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94502139795360 notifier 4649 bl.length()=725 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd4ebf700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 info.flags=0x17 2023-10-05T19:51:24.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd4ebf700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 to cache LRU end 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd4ebf700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd4ebf700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:153 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f9f280034e0 con 0x7f9fc801a070 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 38 ==== osd_op_reply(152 notify.7 [notify cookie 94502140380736 out=8b] v0'0 uv207 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9fd00660a0 con 0x7f9fc801a070 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 39 ==== osd_op_reply(153 notify.7 [notify-ack] v0'0 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd00660a0 con 0x7f9fc801a070 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 40 ==== watch-notify(notify_complete (2) cookie 94502140380736 notify 137438953492 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f9fd005a700 con 0x7f9fc801a070 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd9b8fe40 20 lifecycle: handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5]): orig_sources= new_sources= 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd9b8fe40 20 lifecycle: handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5]): potential sources added=[] removed=[] 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd9b8fe40 20 lifecycle: handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5]): orig_dests= new_dests= 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd9b8fe40 20 lifecycle: handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5]): potential dests added=[] removed=[] 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe7b0110 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(33 lc.28 [call] v32'62 uv62 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.885+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 6.7 6:e31d3d5f:lc::lc.28:head [call rgw.lc_rm_entry in=92b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe7b0110 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(34 lc.28 [call] v32'63 uv63 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:35 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe7b0110 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(35 lc.28 [call] v32'64 uv64 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe7b0110 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:154 4.3c 4:3f13b44b:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe74ff30 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:155 4.31 4:8fe673e1:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82bb50 con 0x55f2fe780320 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:156 4.7 4:e262a283:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe837720 con 0x55f2fe74ff30 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:157 4.c 4:329382a1:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe74ff30 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:158 4.2d 4:b4e0940c:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82bb50 con 0x7f9fc801a070 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:159 4.11 4:88e0a008:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe786290 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:160 4.12 4:482b0117:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82bb50 con 0x55f2fe74ff30 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:161 4.25 4:a6a952c7:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe780320 2023-10-05T19:51:24.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 41 ==== osd_op_reply(158 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fd00660a0 con 0x7f9fc801a070 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:162 4.8 4:11b15712:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82bb50 con 0x55f2fe786290 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:163 4.21 4:86cc95ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe786290 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 47 ==== osd_op_reply(154 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fd00660a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(155 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 48 ==== osd_op_reply(157 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fd00660a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:164 4.1 4:829dc2ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82bb50 con 0x7f9fc801a070 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== osd_op_reply(159 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fcc039020 con 0x55f2fe786290 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 49 ==== osd_op_reply(160 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f9fd00660a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 50 ==== osd_op_reply(156 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f9fd00660a0 con 0x55f2fe74ff30 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== osd_op_reply(163 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.9 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 35 ==== osd_op_reply(162 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.889+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(161 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 42 ==== osd_op_reply(164 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f9fd00660a0 con 0x7f9fc801a070 2023-10-05T19:51:24.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:165 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x7f9fc801a070 2023-10-05T19:51:24.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 43 ==== osd_op_reply(165 foo.buckets [call] v32'36 uv36 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f9fd00660a0 con 0x7f9fc801a070 2023-10-05T19:51:24.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd9b8fe40 20 get_system_obj_state: rctx=0x7ffc61d54308 obj=default.rgw.meta:root:myfoo state=0x55f2fe5fb2b0 s->prefetch_data=0 2023-10-05T19:51:24.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x16, cached=0x17) 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd9b8fe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd9b8fe40 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x17) 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd9b8fe40 10 removing default.rgw.meta+root+myfoo from cache 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd9b8fe40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:166 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94502140504400 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe786290 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 36 ==== watch-notify(notify (1) cookie 94502139792208 notify 137438953487 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x55f2fe7a5fc0 con 0x55f2fe786290 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd56c0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94502139792208 notifier 4649 bl.length()=149 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd56c0700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:167 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f9fb4003c50 con 0x55f2fe786290 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 37 ==== osd_op_reply(166 notify.6 [notify cookie 94502140504400 out=8b] v0'0 uv207 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 38 ==== osd_op_reply(167 notify.6 [notify-ack] v0'0 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:24.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 39 ==== watch-notify(notify_complete (2) cookie 94502140504400 notify 137438953487 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f2fe7a5b20 con 0x55f2fe786290 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.893+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:168 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x7f9fc801a070 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 44 ==== osd_op_reply(168 myfoo [call,call,delete] v32'37 uv37 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f9fd00660a0 con 0x7f9fc801a070 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 10 removing default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 from cache 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5, ofs0, ns] 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:169 7.9 7:93e5b521:::notify.7:head [notify cookie 94502140504400 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x7f9fc801a070 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 45 ==== watch-notify(notify (1) cookie 94502139795360 notify 137438953493 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7f9fd005a700 con 0x7f9fc801a070 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd4ebf700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94502139795360 notifier 4649 bl.length()=206 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd4ebf700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:170 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f9f280034c0 con 0x7f9fc801a070 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 46 ==== osd_op_reply(169 notify.7 [notify cookie 94502140504400 out=8b] v0'0 uv207 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9fd00660a0 con 0x7f9fc801a070 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 47 ==== osd_op_reply(170 notify.7 [notify-ack] v0'0 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd00660a0 con 0x7f9fc801a070 2023-10-05T19:51:24.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 48 ==== watch-notify(notify_complete (2) cookie 94502140504400 notify 137438953493 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f9fd005aa10 con 0x7f9fc801a070 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:171 8.15 8:aeed635a:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe786290 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 40 ==== osd_op_reply(171 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [call,call,delete] v32'5 uv5 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:172 4.3c 4:3f13b44b:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe74ff30 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:173 4.31 4:8fe673e1:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82bb50 con 0x55f2fe780320 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:174 4.7 4:e262a283:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe81d1f0 con 0x55f2fe74ff30 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:175 4.c 4:329382a1:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe81e950 con 0x55f2fe74ff30 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:176 4.2d 4:b4e0940c:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x7f9fc801a070 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:177 4.11 4:88e0a008:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82bb50 con 0x55f2fe786290 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:178 4.12 4:482b0117:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe81e950 con 0x55f2fe74ff30 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:179 4.25 4:a6a952c7:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe780320 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:180 4.8 4:11b15712:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe81e950 con 0x55f2fe786290 2023-10-05T19:51:24.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.897+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:181 4.21 4:86cc95ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe82bb50 con 0x55f2fe786290 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.901+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:182 4.1 4:829dc2ed:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x7f9fc801a070 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.901+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 51 ==== osd_op_reply(178 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.6 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x55f2fe74ff30 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.901+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(173 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.1 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.901+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 41 ==== osd_op_reply(177 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.5 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.901+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 49 ==== osd_op_reply(182 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.10 [delete] v32'14 uv14 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x7f9fc801a070 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.901+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 42 ==== osd_op_reply(180 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.8 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(179 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.7 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 43 ==== osd_op_reply(181 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.9 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 52 ==== osd_op_reply(175 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.3 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x55f2fe74ff30 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 53 ==== osd_op_reply(174 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.2 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x55f2fe74ff30 2023-10-05T19:51:24.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 50 ==== osd_op_reply(176 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.4 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x7f9fc801a070 2023-10-05T19:51:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 54 ==== osd_op_reply(172 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5.0 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x55f2fe74ff30 2023-10-05T19:51:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:183 6.12 6:4d158028:::pubsub..bucket.myfoo%2fe814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe81e950 con 0x55f2fe780320 2023-10-05T19:51:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(183 pubsub..bucket.myfoo/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 250+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd9b8fe40 10 removing default.rgw.log++pubsub..bucket.myfoo/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 from cache 2023-10-05T19:51:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd9b8fe40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5, ofs0, ns] 2023-10-05T19:51:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:184 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94502140380736 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe823670 con 0x55f2fe786290 2023-10-05T19:51:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 44 ==== watch-notify(notify (1) cookie 94502139792208 notify 137438953488 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x55f2fe7a5b20 con 0x55f2fe786290 2023-10-05T19:51:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd56c0700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94502139792208 notifier 4649 bl.length()=203 2023-10-05T19:51:24.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 45 ==== osd_op_reply(184 notify.6 [notify cookie 94502140380736 out=8b] v0'0 uv207 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:25.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd56c0700 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:185 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f9fb4003c50 con 0x55f2fe786290 2023-10-05T19:51:25.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 46 ==== osd_op_reply(185 notify.6 [notify-ack] v0'0 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 47 ==== watch-notify(notify_complete (2) cookie 94502140380736 notify 137438953488 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f2fe74c560 con 0x55f2fe786290 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.905+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:186 6.12 6:4d158028:::pubsub..bucket.myfoo%2fe814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x55f2fe780320 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.909+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(186 pubsub..bucket.myfoo/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.5 [delete] v32'27 uv23 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.909+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:187 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe820640 con 0x7f9fc801a070 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.909+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 51 ==== osd_op_reply(187 foo.buckets [call] v32'38 uv38 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x7f9fc801a070 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.909+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:188 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94502139775296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe8205c0 con 0x55f2fe780320 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(188 notify.0 [watch unwatch cookie 94502139775296] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd9b8fe40 20 remove_watcher() i=0 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd9b8fe40 2 removed watcher, disabling cache 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:189 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94502139778528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78c940 con 0x55f2fe74ff30 2023-10-05T19:51:25.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 55 ==== osd_op_reply(189 notify.1 [watch unwatch cookie 94502139778528] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x55f2fe74ff30 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd9b8fe40 20 remove_watcher() i=1 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:190 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94502139779632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78c940 con 0x55f2fe780320 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(190 notify.2 [watch unwatch cookie 94502139779632] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd9b8fe40 20 remove_watcher() i=2 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.913+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:191 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94502139781824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78c940 con 0x7f9fc801a070 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.917+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 52 ==== osd_op_reply(191 notify.3 [watch unwatch cookie 94502139781824] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x7f9fc801a070 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.917+0000 7f9fd9b8fe40 20 remove_watcher() i=3 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.917+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:192 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94502139766944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78c940 con 0x55f2fe780320 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.917+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2156244351 <== osd.0 v2:172.21.15.118:6800/26580 46 ==== osd_op_reply(192 notify.4 [watch unwatch cookie 94502139766944] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fc8016070 con 0x55f2fe780320 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.917+0000 7f9fd9b8fe40 20 remove_watcher() i=4 2023-10-05T19:51:25.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.917+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:193 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94502139788368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78c940 con 0x55f2fe786290 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.921+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 48 ==== osd_op_reply(193 notify.5 [watch unwatch cookie 94502139788368] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.921+0000 7f9fd9b8fe40 20 remove_watcher() i=5 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.921+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:194 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94502139792208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe78c940 con 0x55f2fe786290 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.921+0000 7f9fd6ec3700 1 -- 172.21.15.167:0/2156244351 <== osd.3 v2:172.21.15.167:6800/26773 49 ==== osd_op_reply(194 notify.6 [watch unwatch cookie 94502139792208] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fcc05d060 con 0x55f2fe786290 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.921+0000 7f9fd9b8fe40 20 remove_watcher() i=6 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.921+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:195 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94502139795360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe790b50 con 0x7f9fc801a070 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.921+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.2 v2:172.21.15.167:6816/26774 53 ==== osd_op_reply(195 notify.7 [watch unwatch cookie 94502139795360] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x7f9fc801a070 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.921+0000 7f9fd9b8fe40 20 remove_watcher() i=7 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9f23fff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:25.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:196 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94502139796464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f2fe7dde20 con 0x55f2fe74ff30 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 <== osd.1 v2:172.21.15.167:6808/26775 56 ==== osd_op_reply(196 data_loggenerations_metadata [watch unwatch cookie 94502139796464] v32'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9fd0074040 con 0x55f2fe74ff30 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe780320 msgr2=0x55f2fe783500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe780320 0x55f2fe783500 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe74ff30 msgr2=0x55f2fe77f510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe74ff30 0x55f2fe77f510 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9fc801a070 msgr2=0x7f9fc8043740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9fc801a070 0x7f9fc8043740 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe786290 msgr2=0x55f2fe788670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe786290 0x55f2fe788670 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9fbc030c50 msgr2=0x7f9fbc033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9fbc030c50 0x7f9fbc033100 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0030a0 tx=0x7f9fcc015000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 msgr2=0x55f2fe773a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd7ec5700 1 -- 172.21.15.167:0/2156244351 reap_dead start 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe773a20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80018e0 tx=0x7f9fc8016000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 shutdown_connections 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2156244351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe74b950 0x55f2fe773a20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 >> 172.21.15.167:0/2156244351 conn(0x55f2fe747370 msgr2=0x55f2fe765090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 shutdown_connections 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.925+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2156244351 wait complete. 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe7b0110 msgr2=0x55f2fe7b2520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f2fe7b0110 0x55f2fe7b2520 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe7ba840 msgr2=0x55f2fe7bcc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f2fe7ba840 0x55f2fe7bcc20 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55f2fe7b3840 msgr2=0x55f2fe7b5c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x55f2fe7b3840 0x55f2fe7b5c20 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe7b6ff0 msgr2=0x55f2fe7b9400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f2fe7b6ff0 0x55f2fe7b9400 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9f14030cf0 msgr2=0x7f9f140331a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9f14030cf0 0x7f9f140331a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55f2fe795280 tx=0x7f9fd000ae50 comp rx=0 tx=0).stop 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd76c4700 1 -- 172.21.15.167:0/2333857201 reap_dead start 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 msgr2=0x55f2fe7a5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe7a5520 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc035040 tx=0x7f9fcc02c000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 shutdown_connections 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 --2- 172.21.15.167:0/2333857201 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f2fe79fa20 0x55f2fe7a5520 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 >> 172.21.15.167:0/2333857201 conn(0x55f2fe79ade0 msgr2=0x55f2fe798e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 shutdown_connections 2023-10-05T19:51:25.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:24.929+0000 7f9fd9b8fe40 1 -- 172.21.15.167:0/2333857201 wait complete. 2023-10-05T19:51:25.031 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2023-10-05T19:51:25.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2023-10-05T19:51:25.031 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2023-10-05T19:51:25.074 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:51:25.074 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:51:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f4dfee40 1 Processor -- start 2023-10-05T19:51:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f4dfee40 1 -- start start 2023-10-05T19:51:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f4dfee40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56350a542930 0x56350a542d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f4dfee40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56350a48fbd0 con 0x56350a543240 2023-10-05T19:51:25.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f4dfee40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x56350a44cee0 con 0x56350a542930 2023-10-05T19:51:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f2933700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56350a542930 0x56350a542d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f2132700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x56350a543240 0x56350a543ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:38438/0 (socket says 172.21.15.167:38438) 2023-10-05T19:51:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f2132700 1 -- 172.21.15.167:0/4174752313 learned_addr learned my addr 172.21.15.167:0/4174752313 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:51:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f1931700 1 -- 172.21.15.167:0/4174752313 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146338950 0 0) 0x56350a48fbd0 con 0x56350a543240 2023-10-05T19:51:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f1931700 1 -- 172.21.15.167:0/4174752313 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e0001e10 con 0x56350a543240 2023-10-05T19:51:25.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f2933700 1 -- 172.21.15.167:0/4174752313 >> v1:172.21.15.118:6789/0 conn(0x56350a543240 legacy=0x56350a543ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f2933700 1 -- 172.21.15.167:0/4174752313 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56350a5443f0 con 0x56350a542930 2023-10-05T19:51:25.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f2933700 1 --2- 172.21.15.167:0/4174752313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a542d00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400a5d0 tx=0x7ff1e4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c70a6393da19313 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f1931700 1 -- 172.21.15.167:0/4174752313 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4007610 con 0x56350a542930 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.069+0000 7ff1f1931700 1 -- 172.21.15.167:0/4174752313 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4007770 con 0x56350a542930 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f1931700 1 -- 172.21.15.167:0/4174752313 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4007a20 con 0x56350a542930 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/4174752313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 msgr2=0x56350a542d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/4174752313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a542d00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400a5d0 tx=0x7ff1e4005a50 comp rx=0 tx=0).stop 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/4174752313 shutdown_connections 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/4174752313 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a542d00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/4174752313 >> 172.21.15.167:0/4174752313 conn(0x56350a53e350 msgr2=0x56350a540760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/4174752313 shutdown_connections 2023-10-05T19:51:25.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/4174752313 wait complete. 2023-10-05T19:51:25.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 Processor -- start 2023-10-05T19:51:25.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 -- start start 2023-10-05T19:51:25.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a5617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56350a410e30 con 0x56350a542930 2023-10-05T19:51:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f2933700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a5617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f2933700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a5617d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45770/0 (socket says 172.21.15.167:45770) 2023-10-05T19:51:25.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f2933700 1 -- 172.21.15.167:0/3133479398 learned_addr learned my addr 172.21.15.167:0/3133479398 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f2933700 1 -- 172.21.15.167:0/3133479398 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4005cf0 con 0x56350a542930 2023-10-05T19:51:25.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f2933700 1 --2- 172.21.15.167:0/3133479398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a5617d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4002000 tx=0x7ff1e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc8df439252e1e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f092f700 1 -- 172.21.15.167:0/3133479398 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4007960 con 0x56350a542930 2023-10-05T19:51:25.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f092f700 1 -- 172.21.15.167:0/3133479398 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4007b00 con 0x56350a542930 2023-10-05T19:51:25.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f092f700 1 -- 172.21.15.167:0/3133479398 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e4007df0 con 0x56350a542930 2023-10-05T19:51:25.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/3133479398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 msgr2=0x56350a5617d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.073+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/3133479398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a5617d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4002000 tx=0x7ff1e4014000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/3133479398 shutdown_connections 2023-10-05T19:51:25.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/3133479398 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a5617d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/3133479398 >> 172.21.15.167:0/3133479398 conn(0x56350a53e350 msgr2=0x56350a55d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/3133479398 shutdown_connections 2023-10-05T19:51:25.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/3133479398 wait complete. 2023-10-05T19:51:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 Processor -- start 2023-10-05T19:51:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 -- start start 2023-10-05T19:51:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a568430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56350a3e3ed0 con 0x56350a542930 2023-10-05T19:51:25.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f2933700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a568430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f2933700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a568430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45776/0 (socket says 172.21.15.167:45776) 2023-10-05T19:51:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 learned_addr learned my addr 172.21.15.167:0/684085418 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56350a5443f0 con 0x56350a542930 2023-10-05T19:51:25.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f2933700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a568430 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4000c00 tx=0x7ff1e4003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1eaffd700 1 -- 172.21.15.167:0/684085418 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e401d9d0 con 0x56350a542930 2023-10-05T19:51:25.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1eaffd700 1 -- 172.21.15.167:0/684085418 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e402b070 con 0x56350a542930 2023-10-05T19:51:25.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56350a568970 con 0x56350a542930 2023-10-05T19:51:25.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.077+0000 7ff1eaffd700 1 -- 172.21.15.167:0/684085418 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1e401dcd0 con 0x56350a542930 2023-10-05T19:51:25.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56350a568db0 con 0x56350a542930 2023-10-05T19:51:25.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1eaffd700 1 -- 172.21.15.167:0/684085418 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff1e402d030 con 0x56350a542930 2023-10-05T19:51:25.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1eaffd700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1d4030c40 0x7ff1d40330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1eaffd700 1 -- 172.21.15.167:0/684085418 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7ff1e403ac80 con 0x56350a542930 2023-10-05T19:51:25.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f2132700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1d4030c40 0x7ff1d40330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56350a543240 0x56350a573e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a5745b0 con 0x56350a543240 2023-10-05T19:51:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f3134700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56350a543240 0x56350a573e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f2132700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1d4030c40 0x7ff1d40330f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc004170 tx=0x7ff1dc001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f3134700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56350a543240 0x56350a573e80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f4dfee40 20 realm 2023-10-05T19:51:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.081+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a5714b0 con 0x56350a543240 2023-10-05T19:51:25.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:51:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a5750e0 con 0x56350a543240 2023-10-05T19:51:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56350a575f10 0x56350a5782f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a578830 con 0x56350a575f10 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f2933700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56350a575f10 0x56350a5782f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f2933700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56350a575f10 0x56350a5782f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a5790d0 con 0x56350a543240 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 20 searching for the correct realm 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56350a57ae90 0x56350a57d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a57ae90 2023-10-05T19:51:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.085+0000 7ff1f2132700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56350a57ae90 0x56350a57d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f2132700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56350a57ae90 0x56350a57d270 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc006070 con 0x56350a57ae90 2023-10-05T19:51:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a575f10 2023-10-05T19:51:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f2933700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff1e4007030 0x7ff1e4030430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x7ff1e4007030 2023-10-05T19:51:25.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f3134700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff1e4007030 0x7ff1e4030430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f3134700 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff1e4007030 0x7ff1e4030430 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.089+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a57ae90 2023-10-05T19:51:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc006070 con 0x56350a57ae90 2023-10-05T19:51:25.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a575f10 2023-10-05T19:51:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a575f10 2023-10-05T19:51:25.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x7ff1e4007030 2023-10-05T19:51:25.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.093+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x7ff1e4007030 2023-10-05T19:51:25.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a575f10 2023-10-05T19:51:25.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a57ae90 2023-10-05T19:51:25.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc006070 con 0x56350a57ae90 2023-10-05T19:51:25.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a575f10 2023-10-05T19:51:25.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a57ae90 2023-10-05T19:51:25.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc006070 con 0x56350a57ae90 2023-10-05T19:51:25.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.097+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a57ae90 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc006070 con 0x56350a57ae90 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x7ff1e4007030 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a543240 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x7ff1e4007030 2023-10-05T19:51:25.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a57ae90 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc006070 con 0x56350a57ae90 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.101+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x7ff1e4007030 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a575f10 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a575f10 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a57ae90 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc006070 con 0x56350a57ae90 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a575f10 2023-10-05T19:51:25.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57d7b0 con 0x56350a575f10 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f4dfee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f4dfee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f4dfee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f4dfee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.105+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a579c40 con 0x56350a543240 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a590 con 0x56350a575f10 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57db60 con 0x56350a575f10 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57df10 con 0x56350a57ae90 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff1dc006070 con 0x56350a57ae90 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57e2c0 con 0x56350a543240 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.109+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a575f10 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57fbc0 con 0x56350a57ae90 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57fbc0 con 0x56350a575f10 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x7ff1e4007030 2023-10-05T19:51:25.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a543240 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a543240 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a57ae90 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.113+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a543240 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a575f10 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a575f10 2023-10-05T19:51:25.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a543240 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x7ff1e4007030 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a543240 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.117+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x7ff1e4007030 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a575f10 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57a130 con 0x56350a57ae90 2023-10-05T19:51:25.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a543240 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a575f10 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a57ae90 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.121+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a543240 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a543240 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a543240 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a57ae90 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x7ff1e4007030 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a543240 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x7ff1e4007030 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.125+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a57ae90 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x7ff1e4007030 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a575f10 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a575f10 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a57ae90 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a575f10 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.129+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1dc028040 con 0x56350a575f10 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57ebb0 con 0x56350a575f10 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57ebb0 con 0x56350a543240 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:25.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57f450 con 0x56350a575f10 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.133+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57f450 con 0x56350a575f10 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57f550 con 0x7ff1e4007030 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 zone default found 2023-10-05T19:51:25.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 4 Realm: () 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 zonegroup default 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a57f550 con 0x7ff1e4007030 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a580ed0 con 0x56350a57ae90 2023-10-05T19:51:25.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a581280 con 0x56350a57ae90 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 started sync module instance, tier type = 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.137+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a580590 con 0x56350a575f10 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.141+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.141+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94785806795200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a580b00 con 0x56350a575f10 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.141+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a581ca0 con 0x56350a543240 2023-10-05T19:51:25.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.145+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.145+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94785806795200] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.145+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94785806800752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a580b00 con 0x56350a543240 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.145+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a580610 con 0x56350a575f10 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.145+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94785806800752] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.145+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.145+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94785806803104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a580b00 con 0x56350a575f10 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.145+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a582df0 con 0x7ff1e4007030 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.149+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.149+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94785806805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a582d50 con 0x7ff1e4007030 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.149+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a583d40 con 0x56350a575f10 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.149+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94785806803104] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.149+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94785806805248] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.149+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.149+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94785806807536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a583850 con 0x56350a575f10 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.149+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a5840f0 con 0x56350a57ae90 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94785806809728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a5849e0 con 0x56350a57ae90 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a585430 con 0x56350a57ae90 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94785806807536] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94785806796304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a585d20 con 0x56350a57ae90 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a586600 con 0x7ff1e4007030 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94785806809728] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94785806796304] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc024040 con 0x56350a57ae90 2023-10-05T19:51:25.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.153+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94785806812400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a585d20 con 0x7ff1e4007030 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 20 add_watcher() i=0 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 20 add_watcher() i=1 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 20 add_watcher() i=2 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 20 add_watcher() i=3 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 20 add_watcher() i=4 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 20 add_watcher() i=5 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 20 add_watcher() i=6 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94785806812400] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 20 add_watcher() i=7 2023-10-05T19:51:25.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 2 all 8 watchers are set, enabling cache 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a585d20 con 0x56350a543240 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.157+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94785806817328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a585c80 con 0x56350a543240 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94785806817328] v32'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff13ffff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 Processor -- start 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 -- start start 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a593e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56350a594380 con 0x56350a593a70 2023-10-05T19:51:25.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f2132700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a593e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f2132700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a593e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45790/0 (socket says 172.21.15.167:45790) 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f2132700 1 -- 172.21.15.167:0/880464042 learned_addr learned my addr 172.21.15.167:0/880464042 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f2132700 1 -- 172.21.15.167:0/880464042 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56350a5944c0 con 0x56350a593a70 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f2132700 1 --2- 172.21.15.167:0/880464042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a593e40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x56350a5757e0 tx=0x7ff1dc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86dc13311971f50a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff13f7fe700 1 -- 172.21.15.167:0/880464042 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc03b070 con 0x56350a593a70 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff13f7fe700 1 -- 172.21.15.167:0/880464042 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc022040 con 0x56350a593a70 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff13f7fe700 1 -- 172.21.15.167:0/880464042 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc021040 con 0x56350a593a70 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/880464042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 msgr2=0x56350a593e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/880464042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a593e40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x56350a5757e0 tx=0x7ff1dc010000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/880464042 shutdown_connections 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/880464042 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a593e40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/880464042 >> 172.21.15.167:0/880464042 conn(0x56350a58ee30 msgr2=0x56350a58cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/880464042 shutdown_connections 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.161+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/880464042 wait complete. 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f4dfee40 1 Processor -- start 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f4dfee40 1 -- start start 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f4dfee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a599570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f4dfee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56350a59a570 con 0x56350a593a70 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f2132700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a599570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f2132700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a599570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45794/0 (socket says 172.21.15.167:45794) 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f2132700 1 -- 172.21.15.167:0/1819592986 learned_addr learned my addr 172.21.15.167:0/1819592986 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f2132700 1 -- 172.21.15.167:0/1819592986 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e0001e10 con 0x56350a593a70 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f2132700 1 --2- 172.21.15.167:0/1819592986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a599570 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x56350a58daf0 tx=0x7ff1dc036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff13dffb700 1 -- 172.21.15.167:0/1819592986 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc021050 con 0x56350a593a70 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff13dffb700 1 -- 172.21.15.167:0/1819592986 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc034650 con 0x56350a593a70 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/1819592986 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56350a599b70 con 0x56350a593a70 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff13dffb700 1 -- 172.21.15.167:0/1819592986 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1dc045070 con 0x56350a593a70 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/1819592986 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56350a59a010 con 0x56350a593a70 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff13dffb700 1 -- 172.21.15.167:0/1819592986 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff1dc03e070 con 0x56350a593a70 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.165+0000 7ff13dffb700 1 --2- 172.21.15.167:0/1819592986 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff130030bb0 0x7ff130033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff13dffb700 1 -- 172.21.15.167:0/1819592986 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7ff1dc02e040 con 0x56350a593a70 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff1f3134700 1 --2- 172.21.15.167:0/1819592986 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff130030bb0 0x7ff130033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff1f4dfee40 5 note: GC not initialized 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff1f3134700 1 --2- 172.21.15.167:0/1819592986 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff130030bb0 0x7ff130033060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x56350a586380 tx=0x7ff1ec00ade0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff136ffd700 20 reqs_thread_entry: start 2023-10-05T19:51:25.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff134ff9700 20 reqs_thread_entry: start 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff1f4dfee40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff1f4dfee40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff122ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:55 2023 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff1227fc700 20 reqs_thread_entry: start 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff1f4dfee40 20 get_system_obj_state: rctx=0x7ffd08ab8668 obj=default.rgw.meta:users.uid:foo state=0x56350a41c0b0 s->prefetch_data=0 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff1f4dfee40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.169+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a601e00 con 0x56350a543240 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:25.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:25.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:25.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 20 Read xattr: user.rgw.idtag 2023-10-05T19:51:25.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:51:25.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a604890 con 0x56350a543240 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~369 in=369b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a605b10 con 0x56350a543240 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~369] v32'14 uv14 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:25.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:51:25.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94785807332240 in=557b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a604ea0 con 0x56350a575f10 2023-10-05T19:51:25.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94785806807536 notify 137438953507 ret 0) v3 ==== 587+0+0 (crc 0 0 0) 0x56350a568db0 con 0x56350a575f10 2023-10-05T19:51:25.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f092f700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94785806807536 notifier 4655 bl.length()=545 2023-10-05T19:51:25.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f092f700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:51:25.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.4 [notify cookie 94785807332240 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.173+0000 7ff1f092f700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:25.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.177+0000 7ff1f092f700 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7ff1d8003d90 con 0x56350a575f10 2023-10-05T19:51:25.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.177+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.177+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94785807332240 notify 137438953507 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56350a568970 con 0x56350a575f10 2023-10-05T19:51:25.312 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:51:25.312 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:51:25.312 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:51:25.312 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:51:25.312 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:51:25.312 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:51:25.312 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:51:25.312 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:51:25.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [ 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "user", 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: "perm": "read" 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:51:25.313 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:51:25.314 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:51:25.315 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:51:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.177+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94785806795200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a558070 con 0x56350a575f10 2023-10-05T19:51:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.181+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94785806795200] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.181+0000 7ff1f4dfee40 20 remove_watcher() i=0 2023-10-05T19:51:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.181+0000 7ff1f4dfee40 2 removed watcher, disabling cache 2023-10-05T19:51:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.181+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94785806800752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a558070 con 0x56350a543240 2023-10-05T19:51:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.181+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94785806800752] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.181+0000 7ff1f4dfee40 20 remove_watcher() i=1 2023-10-05T19:51:25.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.181+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94785806803104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a558070 con 0x56350a575f10 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.185+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94785806803104] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.185+0000 7ff1f4dfee40 20 remove_watcher() i=2 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.185+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94785806805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a558070 con 0x7ff1e4007030 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.185+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94785806805248] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.185+0000 7ff1f4dfee40 20 remove_watcher() i=3 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.185+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94785806807536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a558070 con 0x56350a575f10 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.189+0000 7ff1f2933700 1 -- 172.21.15.167:0/684085418 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94785806807536] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1e4023020 con 0x56350a575f10 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.189+0000 7ff1f4dfee40 20 remove_watcher() i=4 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.189+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94785806809728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a558070 con 0x56350a57ae90 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.189+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94785806809728] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc03d030 con 0x56350a57ae90 2023-10-05T19:51:25.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.189+0000 7ff1f4dfee40 20 remove_watcher() i=5 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.189+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94785806796304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a558070 con 0x56350a57ae90 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.193+0000 7ff1f2132700 1 -- 172.21.15.167:0/684085418 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94785806796304] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1dc03d030 con 0x56350a57ae90 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.193+0000 7ff1f4dfee40 20 remove_watcher() i=6 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.193+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94785806812400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a558070 con 0x7ff1e4007030 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.193+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94785806812400] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x7ff1e4007030 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.193+0000 7ff1f4dfee40 20 remove_watcher() i=7 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff13ffff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94785806817328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56350a558070 con 0x56350a543240 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94785806817328] v32'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff1ec00a5a0 con 0x56350a543240 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56350a575f10 msgr2=0x56350a5782f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56350a575f10 0x56350a5782f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56350a543240 msgr2=0x56350a573e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56350a543240 0x56350a573e80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff1e4007030 msgr2=0x7ff1e4030430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff1e4007030 0x7ff1e4030430 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56350a57ae90 msgr2=0x56350a57d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56350a57ae90 0x56350a57d270 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1d4030c40 msgr2=0x7ff1d40330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff1d4030c40 0x7ff1d40330f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc004170 tx=0x7ff1dc001400 comp rx=0 tx=0).stop 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f3134700 1 -- 172.21.15.167:0/684085418 reap_dead start 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 msgr2=0x56350a568430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.197+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a568430 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4000c00 tx=0x7ff1e4003050 comp rx=0 tx=0).stop 2023-10-05T19:51:25.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 shutdown_connections 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/684085418 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a542930 0x56350a568430 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 >> 172.21.15.167:0/684085418 conn(0x56350a53e350 msgr2=0x56350a55be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 shutdown_connections 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/684085418 wait complete. 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/1819592986 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff130030bb0 msgr2=0x7ff130033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/1819592986 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff130030bb0 0x7ff130033060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x56350a586380 tx=0x7ff1ec00ade0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/1819592986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 msgr2=0x56350a599570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/1819592986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a599570 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x56350a58daf0 tx=0x7ff1dc036000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/1819592986 shutdown_connections 2023-10-05T19:51:25.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/1819592986 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff130030bb0 0x7ff130033060 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 --2- 172.21.15.167:0/1819592986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56350a593a70 0x56350a599570 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/1819592986 >> 172.21.15.167:0/1819592986 conn(0x56350a58ee30 msgr2=0x56350a58ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/1819592986 shutdown_connections 2023-10-05T19:51:25.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.201+0000 7ff1f4dfee40 1 -- 172.21.15.167:0/1819592986 wait complete. 2023-10-05T19:51:25.343 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:51:25.344 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2023-10-05T19:51:25.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2023-10-05T19:51:25.344 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2023-10-05T19:51:25.385 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:51:25.412 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:51:25.446 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e9a80e40 1 Processor -- start 2023-10-05T19:51:25.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e9a80e40 1 -- start start 2023-10-05T19:51:25.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e9a80e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5581f639b580 0x5581f6399b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e9a80e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5581f6372bd0 con 0x5581f639a0a0 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e9a80e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5581f632fee0 con 0x5581f639b580 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e75b5700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5581f639b580 0x5581f6399b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e6db4700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x5581f639a0a0 0x5581f642da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:38452/0 (socket says 172.21.15.167:38452) 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e6db4700 1 -- 172.21.15.167:0/3468041200 learned_addr learned my addr 172.21.15.167:0/3468041200 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e75b5700 1 -- 172.21.15.167:0/3468041200 >> v1:172.21.15.118:6789/0 conn(0x5581f639a0a0 legacy=0x5581f642da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e75b5700 1 -- 172.21.15.167:0/3468041200 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581f639ba10 con 0x5581f639b580 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e75b5700 1 --2- 172.21.15.167:0/3468041200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639b580 0x5581f6399b60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f63e000a5d0 tx=0x7f63e0005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f5336e70342dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e65b3700 1 -- 172.21.15.167:0/3468041200 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63e00086a0 con 0x5581f639b580 2023-10-05T19:51:25.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e65b3700 1 -- 172.21.15.167:0/3468041200 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0008800 con 0x5581f639b580 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.381+0000 7f63e65b3700 1 -- 172.21.15.167:0/3468041200 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63e0008ad0 con 0x5581f639b580 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3468041200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639b580 msgr2=0x5581f6399b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/3468041200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639b580 0x5581f6399b60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f63e000a5d0 tx=0x7f63e0005a50 comp rx=0 tx=0).stop 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3468041200 shutdown_connections 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/3468041200 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639b580 0x5581f6399b60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3468041200 >> 172.21.15.167:0/3468041200 conn(0x5581f6421350 msgr2=0x5581f6423760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3468041200 shutdown_connections 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3468041200 wait complete. 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 Processor -- start 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- start start 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f6446bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581f62f3e30 con 0x5581f639a0a0 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e75b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f6446bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e75b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f6446bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45818/0 (socket says 172.21.15.167:45818) 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e75b5700 1 -- 172.21.15.167:0/2066689721 learned_addr learned my addr 172.21.15.167:0/2066689721 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e75b5700 1 -- 172.21.15.167:0/2066689721 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0005cf0 con 0x5581f639a0a0 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e75b5700 1 --2- 172.21.15.167:0/2066689721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f6446bf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f63e0000c00 tx=0x7f63e0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788087c29aa18992 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e55b1700 1 -- 172.21.15.167:0/2066689721 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63e0008970 con 0x5581f639a0a0 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e55b1700 1 -- 172.21.15.167:0/2066689721 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0008af0 con 0x5581f639a0a0 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e55b1700 1 -- 172.21.15.167:0/2066689721 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63e0008de0 con 0x5581f639a0a0 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2066689721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 msgr2=0x5581f6446bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2066689721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f6446bf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f63e0000c00 tx=0x7f63e0015000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2066689721 shutdown_connections 2023-10-05T19:51:25.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2066689721 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f6446bf0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2066689721 >> 172.21.15.167:0/2066689721 conn(0x5581f6421350 msgr2=0x5581f64427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2066689721 shutdown_connections 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.385+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2066689721 wait complete. 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e9a80e40 1 Processor -- start 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e9a80e40 1 -- start start 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e9a80e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f644d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e9a80e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581f62c6ed0 con 0x5581f639a0a0 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e75b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f644d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e75b5700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f644d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45828/0 (socket says 172.21.15.167:45828) 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 learned_addr learned my addr 172.21.15.167:0/2532502772 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581f639ba10 con 0x5581f639a0a0 2023-10-05T19:51:25.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e75b5700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f644d850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f63e0000c00 tx=0x7f63e0003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63df7fe700 1 -- 172.21.15.167:0/2532502772 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63e0012b70 con 0x5581f639a0a0 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63df7fe700 1 -- 172.21.15.167:0/2532502772 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e002a070 con 0x5581f639a0a0 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5581f644dd90 con 0x5581f639a0a0 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63df7fe700 1 -- 172.21.15.167:0/2532502772 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63e0012e50 con 0x5581f639a0a0 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581f644e230 con 0x5581f639a0a0 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.389+0000 7f63df7fe700 1 -- 172.21.15.167:0/2532502772 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f63e0019070 con 0x5581f639a0a0 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63df7fe700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f63cc030bf0 0x7f63cc0330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63df7fe700 1 -- 172.21.15.167:0/2532502772 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f63e002c070 con 0x5581f639a0a0 2023-10-05T19:51:25.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e6db4700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f63cc030bf0 0x7f63cc0330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5581f639b580 0x5581f6459370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64599e0 con 0x5581f639b580 2023-10-05T19:51:25.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e7db6700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5581f639b580 0x5581f6459370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e6db4700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f63cc030bf0 0x7f63cc0330a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f63d00044f0 tx=0x7f63d00067c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e7db6700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5581f639b580 0x5581f6459370 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63d800a500 con 0x5581f639b580 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 20 realm 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64569d0 con 0x5581f639b580 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63d800a500 con 0x5581f639b580 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f645a4c0 con 0x5581f639b580 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63d800a500 con 0x5581f639b580 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5581f645b2f0 0x5581f645d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.393+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f645dc10 con 0x5581f645b2f0 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e75b5700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5581f645b2f0 0x5581f645d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e75b5700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5581f645b2f0 0x5581f645d6d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f645e4b0 con 0x5581f639b580 2023-10-05T19:51:25.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f63d800a500 con 0x5581f639b580 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e9a80e40 20 searching for the correct realm 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5581f6460270 0x5581f6462650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f6460270 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e6db4700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5581f6460270 0x5581f6462650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e6db4700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5581f6460270 0x5581f6462650 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d0004520 con 0x5581f6460270 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.397+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f645b2f0 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e75b5700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f63e0007030 0x7f63e0028a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x7f63e0007030 2023-10-05T19:51:25.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f63e0007030 0x7f63e0028a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f63e0007030 0x7f63e0028a20 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x7f63e0007030 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f6460270 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d0004520 con 0x5581f6460270 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.401+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f645b2f0 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f645b2f0 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x7f63e0007030 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x7f63e0007030 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x7f63e0007030 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x7f63e0007030 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.405+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f645b2f0 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f6460270 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d0004520 con 0x5581f6460270 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f645b2f0 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f6460270 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.409+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f6460270 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x7f63e0007030 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x7f63e0007030 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f639b580 2023-10-05T19:51:25.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x7f63e0007030 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x7f63e0007030 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f6460270 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.413+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x7f63e0007030 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x7f63e0007030 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f645b2f0 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f645b2f0 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f6460270 2023-10-05T19:51:25.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f645b2f0 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462b90 con 0x5581f645b2f0 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e9a80e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e9a80e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e9a80e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.417+0000 7f63e9a80e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f645f020 con 0x5581f639b580 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f645f970 con 0x5581f645b2f0 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462f40 con 0x5581f645b2f0 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64632f0 con 0x5581f6460270 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.421+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f645f4e0 con 0x5581f645b2f0 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f645f4b0 con 0x5581f6460270 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f645f4b0 con 0x5581f645b2f0 2023-10-05T19:51:25.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462f40 con 0x7f63e0007030 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x7f63e0007030 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.425+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f6460270 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f645b2f0 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f645b2f0 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.429+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x7f63e0007030 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x7f63e0007030 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x7f63e0007030 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x7f63e0007030 2023-10-05T19:51:25.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f645b2f0 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f6460270 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.433+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f645b2f0 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f6460270 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8014040 con 0x5581f639b580 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.437+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f6460270 2023-10-05T19:51:25.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x7f63e0007030 2023-10-05T19:51:25.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f639b580 2023-10-05T19:51:25.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x7f63e0007030 2023-10-05T19:51:25.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f6460270 2023-10-05T19:51:25.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x7f63e0007030 2023-10-05T19:51:25.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.441+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f645b2f0 2023-10-05T19:51:25.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f645b2f0 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f6460270 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f645b2f0 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64636a0 con 0x5581f645b2f0 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e9a80e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e9a80e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e9a80e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:25.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e9a80e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.445+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f645f4b0 con 0x5581f645b2f0 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6462f40 con 0x5581f639b580 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6463f40 con 0x5581f645b2f0 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.584 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6463f40 con 0x5581f645b2f0 2023-10-05T19:51:25.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:25.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6464380 con 0x7f63e0007030 2023-10-05T19:51:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 zone default found 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 4 Realm: () 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 zonegroup default 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.449+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6464380 con 0x7f63e0007030 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6464380 con 0x5581f6460270 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6464780 con 0x5581f6460270 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 20 started sync module instance, tier type = 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.453+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6464b80 con 0x5581f645b2f0 2023-10-05T19:51:25.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.457+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.457+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94016670940272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64664d0 con 0x5581f645b2f0 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.457+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6466d70 con 0x5581f639b580 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.457+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.457+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94016670940272] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.457+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94016670950608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6466e10 con 0x5581f639b580 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.457+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64676b0 con 0x5581f645b2f0 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.461+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94016670950608] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.461+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.461+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94016670951712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6467260 con 0x5581f645b2f0 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.461+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6467b00 con 0x7f63e0007030 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.461+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.461+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94016670954368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6467f00 con 0x7f63e0007030 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.461+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94016670951712] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.461+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6468420 con 0x5581f645b2f0 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.465+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94016670954368] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.465+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.465+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94016670952816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6468420 con 0x5581f645b2f0 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.465+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6468e30 con 0x5581f6460270 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.465+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.465+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94016670959936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64696d0 con 0x5581f6460270 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.465+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f646a0e0 con 0x5581f6460270 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.465+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94016670952816] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.676 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94016670959936] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94016670955472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f646a9d0 con 0x5581f6460270 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f646ad80 con 0x7f63e0007030 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94016670969216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f646b6c0 con 0x7f63e0007030 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 20 add_watcher() i=0 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 20 add_watcher() i=1 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 20 add_watcher() i=2 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 20 add_watcher() i=3 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 20 add_watcher() i=4 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 20 add_watcher() i=5 2023-10-05T19:51:25.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94016670955472] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 20 add_watcher() i=6 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94016670969216] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 20 add_watcher() i=7 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.469+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f646e6f0 con 0x5581f639b580 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94016670970320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f646bb10 con 0x5581f639b580 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94016670970320] v32'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63b7fef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e9a80e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e9a80e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:51:25.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e9a80e40 1 Processor -- start 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e9a80e40 1 -- start start 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e9a80e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f6478ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e9a80e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581f6479420 con 0x5581f6478b10 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e6db4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f6478ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e6db4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f6478ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45834/0 (socket says 172.21.15.167:45834) 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.473+0000 7f63e6db4700 1 -- 172.21.15.167:0/3045991370 learned_addr learned my addr 172.21.15.167:0/3045991370 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e6db4700 1 -- 172.21.15.167:0/3045991370 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581f6479560 con 0x5581f6478b10 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e6db4700 1 --2- 172.21.15.167:0/3045991370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f6478ee0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f63d00020f0 tx=0x7f63d0006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bba234623dc5882 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63b77ee700 1 -- 172.21.15.167:0/3045991370 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63d001a040 con 0x5581f6478b10 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63b77ee700 1 -- 172.21.15.167:0/3045991370 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d001b040 con 0x5581f6478b10 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63b77ee700 1 -- 172.21.15.167:0/3045991370 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63d0004950 con 0x5581f6478b10 2023-10-05T19:51:25.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3045991370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 msgr2=0x5581f6478ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/3045991370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f6478ee0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f63d00020f0 tx=0x7f63d0006000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3045991370 shutdown_connections 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/3045991370 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f6478ee0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3045991370 >> 172.21.15.167:0/3045991370 conn(0x5581f6473ed0 msgr2=0x5581f6472020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3045991370 shutdown_connections 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 -- 172.21.15.167:0/3045991370 wait complete. 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 Processor -- start 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 -- start start 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f647e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e9a80e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581f647f600 con 0x5581f6478b10 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e6db4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f647e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e6db4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f647e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45836/0 (socket says 172.21.15.167:45836) 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.477+0000 7f63e6db4700 1 -- 172.21.15.167:0/569780457 learned_addr learned my addr 172.21.15.167:0/569780457 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63e6db4700 1 -- 172.21.15.167:0/569780457 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581f6372bd0 con 0x5581f6478b10 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63e6db4700 1 --2- 172.21.15.167:0/569780457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f647e600 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f63d00060a0 tx=0x7f63d0036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63b5feb700 1 -- 172.21.15.167:0/569780457 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63d001a070 con 0x5581f6478b10 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63b5feb700 1 -- 172.21.15.167:0/569780457 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0004330 con 0x5581f6478b10 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63e9a80e40 1 -- 172.21.15.167:0/569780457 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5581f647ec00 con 0x5581f6478b10 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63b5feb700 1 -- 172.21.15.167:0/569780457 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63d002c790 con 0x5581f6478b10 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63e9a80e40 1 -- 172.21.15.167:0/569780457 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581f647f0a0 con 0x5581f6478b10 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63b5feb700 1 -- 172.21.15.167:0/569780457 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f63d002c8f0 con 0x5581f6478b10 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63b5feb700 1 --2- 172.21.15.167:0/569780457 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f632c030c00 0x7f632c0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63b5feb700 1 -- 172.21.15.167:0/569780457 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f63d0027040 con 0x5581f6478b10 2023-10-05T19:51:25.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63e9a80e40 5 note: GC not initialized 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63e7db6700 1 --2- 172.21.15.167:0/569780457 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f632c030c00 0x7f632c0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.481+0000 7f63e7db6700 1 --2- 172.21.15.167:0/569780457 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f632c030c00 0x7f632c0330b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5581f646a6b0 tx=0x7f63d800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f6326ffd700 20 reqs_thread_entry: start 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f6324ff9700 20 reqs_thread_entry: start 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f631effd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:55 2023 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f631e7fc700 20 reqs_thread_entry: start 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 20 get_system_obj_state: rctx=0x7fff72aed488 obj=default.rgw.meta:users.uid:foo state=0x5581f62ff0b0 s->prefetch_data=0 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:51:25.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64e6cb0 con 0x5581f639b580 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64e9740 con 0x5581f639b580 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~369 out=369b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 273+0+492 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:51:25.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.485+0000 7f63e9a80e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64ea9c0 con 0x5581f639b580 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 foo [delete,create,call,writefull 0~357] v32'15 uv15 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e9a80e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e9a80e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e9a80e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94016671491280 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64e9740 con 0x5581f645b2f0 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94016670952816 notify 137438953508 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x5581f644e230 con 0x5581f645b2f0 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e55b1700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94016670952816 notifier 4661 bl.length()=533 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e55b1700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e55b1700 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:25.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.4 [notify cookie 94016671491280 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e55b1700 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f63c0003d90 con 0x5581f645b2f0 2023-10-05T19:51:25.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.489+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94016671491280 notify 137438953508 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5581f644dd90 con 0x5581f645b2f0 2023-10-05T19:51:25.685 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:51:25.685 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "foo", 2023-10-05T19:51:25.685 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Foo", 2023-10-05T19:51:25.685 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "foo@foo.com", 2023-10-05T19:51:25.685 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "9te6NH5mcdcq0Tc5i8i1", 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu" 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:51:25.686 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:51:25.687 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:51:25.688 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:51:25.688 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:51:25.688 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:51:25.688 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:51:25.688 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:51:25.688 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:51:25.688 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:51:25.688 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:51:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.493+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94016670940272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f643d490 con 0x5581f645b2f0 2023-10-05T19:51:25.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.493+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(107 notify.0 [watch unwatch cookie 94016670940272] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.493+0000 7f63e9a80e40 20 remove_watcher() i=0 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.493+0000 7f63e9a80e40 2 removed watcher, disabling cache 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.493+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94016670950608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f643d490 con 0x5581f639b580 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.497+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(108 notify.1 [watch unwatch cookie 94016670950608] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.497+0000 7f63e9a80e40 20 remove_watcher() i=1 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.497+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94016670951712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f643d490 con 0x5581f645b2f0 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.497+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(109 notify.2 [watch unwatch cookie 94016670951712] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.497+0000 7f63e9a80e40 20 remove_watcher() i=2 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.497+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94016670954368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64669c0 con 0x7f63e0007030 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.501+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(110 notify.3 [watch unwatch cookie 94016670954368] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.501+0000 7f63e9a80e40 20 remove_watcher() i=3 2023-10-05T19:51:25.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.501+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94016670952816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f64669c0 con 0x5581f645b2f0 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.501+0000 7f63e75b5700 1 -- 172.21.15.167:0/2532502772 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(111 notify.4 [watch unwatch cookie 94016670952816] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63e0022020 con 0x5581f645b2f0 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.501+0000 7f63e9a80e40 20 remove_watcher() i=4 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.501+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94016670959936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f643d490 con 0x5581f6460270 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.505+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(112 notify.5 [watch unwatch cookie 94016670959936] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.505+0000 7f63e9a80e40 20 remove_watcher() i=5 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.505+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:113 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94016670955472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f643d490 con 0x5581f6460270 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.505+0000 7f63e6db4700 1 -- 172.21.15.167:0/2532502772 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(113 notify.6 [watch unwatch cookie 94016670955472] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d001d040 con 0x5581f6460270 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.505+0000 7f63e9a80e40 20 remove_watcher() i=6 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.505+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94016670969216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6467870 con 0x7f63e0007030 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.509+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(114 notify.7 [watch unwatch cookie 94016670969216] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x7f63e0007030 2023-10-05T19:51:25.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.509+0000 7f63e9a80e40 20 remove_watcher() i=7 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.509+0000 7f63b7fef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.509+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94016670970320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5581f6467870 con 0x5581f639b580 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(115 data_loggenerations_metadata [watch unwatch cookie 94016670970320] v32'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f63d8033040 con 0x5581f639b580 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5581f645b2f0 msgr2=0x5581f645d6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5581f645b2f0 0x5581f645d6d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5581f639b580 msgr2=0x5581f6459370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5581f639b580 0x5581f6459370 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f63e0007030 msgr2=0x7f63e0028a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f63e0007030 0x7f63e0028a20 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5581f6460270 msgr2=0x5581f6462650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5581f6460270 0x5581f6462650 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f63cc030bf0 msgr2=0x7f63cc0330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f63cc030bf0 0x7f63cc0330a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f63d00044f0 tx=0x7f63d00067c0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 msgr2=0x5581f644d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/2532502772 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f639a0a0 0x5581f644d850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f63e0000c00 tx=0x7f63e0003050 comp rx=0 tx=0).stop 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e7db6700 1 -- 172.21.15.167:0/2532502772 reap_dead start 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 shutdown_connections 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 >> 172.21.15.167:0/2532502772 conn(0x5581f6421350 msgr2=0x5581f6441230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 shutdown_connections 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/2532502772 wait complete. 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/569780457 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f632c030c00 msgr2=0x7f632c0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/569780457 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f632c030c00 0x7f632c0330b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5581f646a6b0 tx=0x7f63d800e040 comp rx=0 tx=0).stop 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/569780457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 msgr2=0x5581f647e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/569780457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f647e600 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f63d00060a0 tx=0x7f63d0036000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/569780457 shutdown_connections 2023-10-05T19:51:25.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/569780457 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f632c030c00 0x7f632c0330b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 --2- 172.21.15.167:0/569780457 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5581f6478b10 0x5581f647e600 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/569780457 >> 172.21.15.167:0/569780457 conn(0x5581f6473ed0 msgr2=0x5581f6471f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/569780457 shutdown_connections 2023-10-05T19:51:25.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.513+0000 7f63e9a80e40 1 -- 172.21.15.167:0/569780457 wait complete. 2023-10-05T19:51:25.697 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:51:25.715 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:51:25.719 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2023-10-05T19:51:25.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2023-10-05T19:51:25.720 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2023-10-05T19:51:25.778 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:51:25.828 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:51:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f91245e5e40 1 Processor -- start 2023-10-05T19:51:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f91245e5e40 1 -- start start 2023-10-05T19:51:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f91245e5e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5561aa2f1920 0x5561aa2f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f91245e5e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5561aa23ebd0 con 0x5561aa2f2230 2023-10-05T19:51:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f91245e5e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x5561aa1fbee0 con 0x5561aa2f1920 2023-10-05T19:51:25.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f912211a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5561aa2f1920 0x5561aa2f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f912211a700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5561aa2f1920 0x5561aa2f1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45844/0 (socket says 172.21.15.167:45844) 2023-10-05T19:51:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f912211a700 1 -- 172.21.15.167:0/1903311642 learned_addr learned my addr 172.21.15.167:0/1903311642 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f911bfff700 1 --1- 172.21.15.167:0/1903311642 >> v1:172.21.15.118:6789/0 conn(0x5561aa2f2230 0x5561aa2f2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:38454/0 (socket says 172.21.15.167:38454) 2023-10-05T19:51:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f912211a700 1 -- 172.21.15.167:0/1903311642 >> v1:172.21.15.118:6789/0 conn(0x5561aa2f2230 legacy=0x5561aa2f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f912211a700 1 -- 172.21.15.167:0/1903311642 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561aa2f33e0 con 0x5561aa2f1920 2023-10-05T19:51:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f912211a700 1 --2- 172.21.15.167:0/1903311642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa2f1cf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f911400a650 tx=0x7f9114005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94574a258c64dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f9121919700 1 -- 172.21.15.167:0/1903311642 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114008760 con 0x5561aa2f1920 2023-10-05T19:51:25.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f9121919700 1 -- 172.21.15.167:0/1903311642 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140088c0 con 0x5561aa2f1920 2023-10-05T19:51:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.773+0000 7f9121919700 1 -- 172.21.15.167:0/1903311642 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114008bb0 con 0x5561aa2f1920 2023-10-05T19:51:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 -- 172.21.15.167:0/1903311642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 msgr2=0x5561aa2f1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 --2- 172.21.15.167:0/1903311642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa2f1cf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f911400a650 tx=0x7f9114005b10 comp rx=0 tx=0).stop 2023-10-05T19:51:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 -- 172.21.15.167:0/1903311642 shutdown_connections 2023-10-05T19:51:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 --2- 172.21.15.167:0/1903311642 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa2f1cf0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 -- 172.21.15.167:0/1903311642 >> 172.21.15.167:0/1903311642 conn(0x5561aa2ed340 msgr2=0x5561aa2ef750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 -- 172.21.15.167:0/1903311642 shutdown_connections 2023-10-05T19:51:25.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 -- 172.21.15.167:0/1903311642 wait complete. 2023-10-05T19:51:25.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 Processor -- start 2023-10-05T19:51:25.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 -- start start 2023-10-05T19:51:25.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa3109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f91245e5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561aa1bfe30 con 0x5561aa2f1920 2023-10-05T19:51:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f912211a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa3109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f912211a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa3109a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45860/0 (socket says 172.21.15.167:45860) 2023-10-05T19:51:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f912211a700 1 -- 172.21.15.167:0/433212921 learned_addr learned my addr 172.21.15.167:0/433212921 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f912211a700 1 -- 172.21.15.167:0/433212921 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114005db0 con 0x5561aa2f1920 2023-10-05T19:51:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f912211a700 1 --2- 172.21.15.167:0/433212921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa3109a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f911400a5a0 tx=0x7f9114015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211999ff2b34a5f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f9120917700 1 -- 172.21.15.167:0/433212921 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91140055f0 con 0x5561aa2f1920 2023-10-05T19:51:25.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f9120917700 1 -- 172.21.15.167:0/433212921 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114008a30 con 0x5561aa2f1920 2023-10-05T19:51:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.777+0000 7f9120917700 1 -- 172.21.15.167:0/433212921 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114008d00 con 0x5561aa2f1920 2023-10-05T19:51:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 -- 172.21.15.167:0/433212921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 msgr2=0x5561aa3109a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 --2- 172.21.15.167:0/433212921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa3109a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f911400a5a0 tx=0x7f9114015000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 -- 172.21.15.167:0/433212921 shutdown_connections 2023-10-05T19:51:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 --2- 172.21.15.167:0/433212921 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa3109a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 -- 172.21.15.167:0/433212921 >> 172.21.15.167:0/433212921 conn(0x5561aa2ed340 msgr2=0x5561aa30c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 -- 172.21.15.167:0/433212921 shutdown_connections 2023-10-05T19:51:25.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 -- 172.21.15.167:0/433212921 wait complete. 2023-10-05T19:51:25.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 Processor -- start 2023-10-05T19:51:25.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 -- start start 2023-10-05T19:51:25.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa317600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561aa192ed0 con 0x5561aa2f1920 2023-10-05T19:51:25.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f912211a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa317600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f912211a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa317600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45864/0 (socket says 172.21.15.167:45864) 2023-10-05T19:51:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 learned_addr learned my addr 172.21.15.167:0/4141180180 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561aa2f33e0 con 0x5561aa2f1920 2023-10-05T19:51:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f912211a700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa317600 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f911400a5a0 tx=0x7f911401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f911a7fc700 1 -- 172.21.15.167:0/4141180180 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114026b80 con 0x5561aa2f1920 2023-10-05T19:51:25.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f911a7fc700 1 -- 172.21.15.167:0/4141180180 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114026ce0 con 0x5561aa2f1920 2023-10-05T19:51:25.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f911a7fc700 1 -- 172.21.15.167:0/4141180180 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9114012450 con 0x5561aa2f1920 2023-10-05T19:51:25.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561aa317b40 con 0x5561aa2f1920 2023-10-05T19:51:25.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.781+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561aa317fe0 con 0x5561aa2f1920 2023-10-05T19:51:25.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f911a7fc700 1 -- 172.21.15.167:0/4141180180 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9114019070 con 0x5561aa2f1920 2023-10-05T19:51:25.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.861 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f911a7fc700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9104030c00 0x7f91040330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f911a7fc700 1 -- 172.21.15.167:0/4141180180 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f9114046660 con 0x5561aa2f1920 2023-10-05T19:51:25.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f911bfff700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9104030c00 0x7f91040330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa2f2230 0x5561aa3230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa323760 con 0x5561aa2f2230 2023-10-05T19:51:25.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f912291b700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa2f2230 0x5561aa3230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f911bfff700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9104030c00 0x7f91040330b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f910c00b300 tx=0x7f910c001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f912291b700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa2f2230 0x5561aa3230f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 20 realm 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa320750 con 0x5561aa2f2230 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:51:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.785+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa324240 con 0x5561aa2f2230 2023-10-05T19:51:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa325070 0x5561aa327450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa327990 con 0x5561aa325070 2023-10-05T19:51:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f912211a700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa325070 0x5561aa327450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f912211a700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa325070 0x5561aa327450 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa328230 con 0x5561aa2f2230 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 20 searching for the correct realm 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa329ff0 0x5561aa32c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa329ff0 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f911bfff700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa329ff0 0x5561aa32c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f911bfff700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa329ff0 0x5561aa32c3d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.789+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa325070 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912211a700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9114038070 0x7f911401c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x7f9114038070 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912291b700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9114038070 0x7f911401c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912291b700 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9114038070 0x7f911401c630 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa329ff0 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.793+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa325070 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa325070 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x7f9114038070 2023-10-05T19:51:25.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.797+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x7f9114038070 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa325070 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa329ff0 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa325070 2023-10-05T19:51:25.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa329ff0 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.801+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa329ff0 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x7f9114038070 2023-10-05T19:51:25.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa2f2230 2023-10-05T19:51:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x7f9114038070 2023-10-05T19:51:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.805+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa329ff0 2023-10-05T19:51:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x7f9114038070 2023-10-05T19:51:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa325070 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa325070 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa329ff0 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa325070 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.809+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32c910 con 0x5561aa325070 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa328da0 con 0x5561aa2f2230 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3296f0 con 0x5561aa325070 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32cd50 con 0x5561aa325070 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32d100 con 0x5561aa329ff0 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.813+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32d4b0 con 0x5561aa2f2230 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa329230 con 0x5561aa325070 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa329ff0 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa325070 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x7f9114038070 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.817+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa329ff0 2023-10-05T19:51:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa325070 2023-10-05T19:51:25.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa325070 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.821+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x7f9114038070 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x7f9114038070 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa325070 2023-10-05T19:51:25.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa329ff0 2023-10-05T19:51:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.825+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa325070 2023-10-05T19:51:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa329ff0 2023-10-05T19:51:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa329ff0 2023-10-05T19:51:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.829+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x7f9114038070 2023-10-05T19:51:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa2f2230 2023-10-05T19:51:25.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x7f9114038070 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa329ff0 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x7f9114038070 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa325070 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa325070 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.833+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa329ff0 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa325070 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ed60 con 0x5561aa325070 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f91245e5e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f91245e5e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f91245e5e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f91245e5e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32dd50 con 0x5561aa325070 2023-10-05T19:51:25.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.837+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32e100 con 0x5561aa2f2230 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32f160 con 0x5561aa325070 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32f160 con 0x5561aa325070 2023-10-05T19:51:25.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32f160 con 0x7f9114038070 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 zone default found 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 4 Realm: () 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 zonegroup default 2023-10-05T19:51:25.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32f160 con 0x7f9114038070 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa330ae0 con 0x5561aa329ff0 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.841+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa330e90 con 0x5561aa329ff0 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f91245e5e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:51:25.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f91245e5e40 20 started sync module instance, tier type = 2023-10-05T19:51:25.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f91245e5e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:51:25.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ffc0 con 0x5561aa325070 2023-10-05T19:51:25.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93877955658976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32ffc0 con 0x5561aa325070 2023-10-05T19:51:25.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.845+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa331730 con 0x5561aa2f2230 2023-10-05T19:51:25.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.849+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.849+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93877955662400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa331b80 con 0x5561aa2f2230 2023-10-05T19:51:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.849+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa332420 con 0x5561aa325070 2023-10-05T19:51:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.849+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93877955658976] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.849+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93877955662400] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.849+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.849+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93877955656688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa331b80 con 0x5561aa325070 2023-10-05T19:51:25.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.849+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa332680 con 0x7f9114038070 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.853+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93877955656688] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.853+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.853+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93877955663792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa332680 con 0x7f9114038070 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.853+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa332f20 con 0x5561aa325070 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.853+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93877955663792] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.853+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.853+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93877955667664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa333010 con 0x5561aa325070 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.853+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3338f0 con 0x5561aa329ff0 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.857+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.857+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93877955667664] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:25.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.857+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93877955670592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3341e0 con 0x5561aa329ff0 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.857+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa334a80 con 0x5561aa329ff0 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.857+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 93877955670592] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.857+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.857+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93877955675536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa334e30 con 0x5561aa329ff0 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.857+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3358e0 con 0x7f9114038070 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93877955675536] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c00f560 con 0x5561aa329ff0 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93877955673328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3358a0 con 0x7f9114038070 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 20 add_watcher() i=0 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 20 add_watcher() i=1 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 20 add_watcher() i=2 2023-10-05T19:51:25.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 20 add_watcher() i=3 2023-10-05T19:51:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 20 add_watcher() i=4 2023-10-05T19:51:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 20 add_watcher() i=5 2023-10-05T19:51:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 20 add_watcher() i=6 2023-10-05T19:51:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93877955673328] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 20 add_watcher() i=7 2023-10-05T19:51:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:51:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa338d10 con 0x5561aa2f2230 2023-10-05T19:51:25.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.861+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93877955679616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa336180 con 0x5561aa2f2230 2023-10-05T19:51:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93877955679616] v32'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f90f3fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f91245e5e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:51:25.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f91245e5e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:51:25.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f91245e5e40 1 Processor -- start 2023-10-05T19:51:25.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f91245e5e40 1 -- start start 2023-10-05T19:51:25.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f91245e5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa3436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f91245e5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561aa343c00 con 0x5561aa3432f0 2023-10-05T19:51:25.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f911bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa3436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f911bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa3436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45872/0 (socket says 172.21.15.167:45872) 2023-10-05T19:51:25.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f911bfff700 1 -- 172.21.15.167:0/2433359059 learned_addr learned my addr 172.21.15.167:0/2433359059 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f911bfff700 1 -- 172.21.15.167:0/2433359059 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561aa343d40 con 0x5561aa3432f0 2023-10-05T19:51:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f911bfff700 1 --2- 172.21.15.167:0/2433359059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa3436c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x5561aa3291d0 tx=0x7f910c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8698abe28818ec94 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f90f37de700 1 -- 172.21.15.167:0/2433359059 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f910c00f9d0 con 0x5561aa3432f0 2023-10-05T19:51:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f90f37de700 1 -- 172.21.15.167:0/2433359059 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c024040 con 0x5561aa3432f0 2023-10-05T19:51:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.865+0000 7f90f37de700 1 -- 172.21.15.167:0/2433359059 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f910c02e740 con 0x5561aa3432f0 2023-10-05T19:51:25.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 -- 172.21.15.167:0/2433359059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 msgr2=0x5561aa3436c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2433359059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa3436c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x5561aa3291d0 tx=0x7f910c006000 comp rx=0 tx=0).stop 2023-10-05T19:51:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 -- 172.21.15.167:0/2433359059 shutdown_connections 2023-10-05T19:51:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2433359059 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa3436c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 -- 172.21.15.167:0/2433359059 >> 172.21.15.167:0/2433359059 conn(0x5561aa33e6b0 msgr2=0x5561aa33c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 -- 172.21.15.167:0/2433359059 shutdown_connections 2023-10-05T19:51:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 -- 172.21.15.167:0/2433359059 wait complete. 2023-10-05T19:51:25.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 Processor -- start 2023-10-05T19:51:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 -- start start 2023-10-05T19:51:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa348e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561aa349e90 con 0x5561aa3432f0 2023-10-05T19:51:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f911bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa348e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f911bfff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa348e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:45888/0 (socket says 172.21.15.167:45888) 2023-10-05T19:51:25.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f911bfff700 1 -- 172.21.15.167:0/2605806823 learned_addr learned my addr 172.21.15.167:0/2605806823 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:51:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f911bfff700 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c006070 con 0x5561aa3432f0 2023-10-05T19:51:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f911bfff700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa348e90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f910c00f4b0 tx=0x7f910c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f90f1fdb700 1 -- 172.21.15.167:0/2605806823 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f910c02c410 con 0x5561aa3432f0 2023-10-05T19:51:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f90f1fdb700 1 -- 172.21.15.167:0/2605806823 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910c02c570 con 0x5561aa3432f0 2023-10-05T19:51:25.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561aa349490 con 0x5561aa3432f0 2023-10-05T19:51:26.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f90f1fdb700 1 -- 172.21.15.167:0/2605806823 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f910c02c720 con 0x5561aa3432f0 2023-10-05T19:51:26.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561aa3498d0 con 0x5561aa3432f0 2023-10-05T19:51:26.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.869+0000 7f90f1fdb700 1 -- 172.21.15.167:0/2605806823 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f910c01a040 con 0x5561aa3432f0 2023-10-05T19:51:26.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f90f1fdb700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9068030bb0 0x7f9068033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:26.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f90f1fdb700 1 -- 172.21.15.167:0/2605806823 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f910c04cce0 con 0x5561aa3432f0 2023-10-05T19:51:26.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f912291b700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9068030bb0 0x7f9068033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:26.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa353a20 0x5561aa355e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:26.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3564d0 con 0x5561aa353a20 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f912211a700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa353a20 0x5561aa355e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f912291b700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9068030bb0 0x7f9068033060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5561aa335a80 tx=0x7f911c00ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f912211a700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa353a20 0x5561aa355e30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'32 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5561aa3571a0 0x5561aa3595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa359ce0 con 0x5561aa3571a0 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.873+0000 7f911bfff700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5561aa3571a0 0x5561aa3595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.877+0000 7f911bfff700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5561aa3571a0 0x5561aa3595b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.877+0000 7f911bfff700 1 -- 172.21.15.167:0/2605806823 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f910c040040 con 0x5561aa3571a0 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.877+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa35a9b0 0x5561aa35cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:26.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.877+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa35d4f0 con 0x5561aa35a9b0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.877+0000 7f912291b700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa35a9b0 0x5561aa35cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.877+0000 7f912291b700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa35a9b0 0x5561aa35cdc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.881+0000 7f912291b700 1 -- 172.21.15.167:0/2605806823 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa35a9b0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.881+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa35e1c0 0x5561aa3605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.881+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa360d00 con 0x5561aa35e1c0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.881+0000 7f912211a700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa35e1c0 0x5561aa3605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.881+0000 7f912211a700 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa35e1c0 0x5561aa3605d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.881+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'212 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.881+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa361350 con 0x5561aa35e1c0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.885+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'68 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.885+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa361970 con 0x5561aa35a9b0 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.885+0000 7f912291b700 1 -- 172.21.15.167:0/2605806823 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'46 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa35a9b0 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.885+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa361e60 con 0x5561aa353a20 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.889+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.889+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa35e1c0 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.889+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'44 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.889+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa353a20 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.893+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.893+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa352e80 con 0x5561aa353a20 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.897+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.897+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa35e1c0 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.897+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'69 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.897+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa35a9b0 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.901+0000 7f912291b700 1 -- 172.21.15.167:0/2605806823 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'29 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa35a9b0 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.901+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa353a20 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.901+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.901+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa35e1c0 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.905+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'63 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.905+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa35e1c0 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.905+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'213 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.905+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa353a20 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.909+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'65 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.909+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa35e1c0 2023-10-05T19:51:26.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.909+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'70 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.909+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362290 con 0x5561aa35a9b0 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.913+0000 7f912291b700 1 -- 172.21.15.167:0/2605806823 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa35a9b0 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.913+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362320 con 0x5561aa353a20 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.913+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.913+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362320 con 0x5561aa35e1c0 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.917+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'214 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.917+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362320 con 0x5561aa353a20 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.917+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'66 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.921+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362320 con 0x5561aa353a20 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.921+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.921+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362320 con 0x5561aa35a9b0 2023-10-05T19:51:26.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.925+0000 7f912291b700 1 -- 172.21.15.167:0/2605806823 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa35a9b0 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.925+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3623b0 con 0x5561aa353a20 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.925+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'34 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.925+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3623b0 con 0x5561aa35a9b0 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.929+0000 7f912291b700 1 -- 172.21.15.167:0/2605806823 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'24 uv20 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa35a9b0 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.929+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3623b0 con 0x5561aa35a9b0 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.929+0000 7f912291b700 1 -- 172.21.15.167:0/2605806823 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'47 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa35a9b0 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.929+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362590 con 0x5561aa35a9b0 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.933+0000 7f912291b700 1 -- 172.21.15.167:0/2605806823 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'30 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa35a9b0 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.933+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362590 con 0x5561aa353a20 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.937+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'40 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.937+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362590 con 0x5561aa35e1c0 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.937+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'45 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.937+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362590 con 0x5561aa353a20 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.941+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'67 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa353a20 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.941+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362590 con 0x5561aa35e1c0 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.941+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'64 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa35e1c0 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.941+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa362590 con 0x5561aa3571a0 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.945+0000 7f911bfff700 1 -- 172.21.15.167:0/2605806823 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f910c040040 con 0x5561aa3571a0 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f9062ffd700 20 reqs_thread_entry: start 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f9060ff9700 20 reqs_thread_entry: start 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 20 init_complete bucket index max shards: 11 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:51:26.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f9052ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:51:56 2023 2023-10-05T19:51:26.008 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:51:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f90527fc700 20 reqs_thread_entry: start 2023-10-05T19:51:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 20 get_system_obj_state: rctx=0x7fff2eebfd58 obj=default.rgw.meta:users.uid:foo state=0x5561aa1cb0b0 s->prefetch_data=0 2023-10-05T19:51:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:51:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3c1490 con 0x5561aa2f2230 2023-10-05T19:51:26.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:51:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:51:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:51:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:51:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 20 rados->read ofs=0 len=0 2023-10-05T19:51:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3c3f20 con 0x5561aa2f2230 2023-10-05T19:51:26.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.949+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3c3f20 con 0x7f9114038070 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.953+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv40 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.953+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93877955658976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa37fa40 con 0x5561aa325070 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.953+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 93877955658976] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.953+0000 7f91245e5e40 20 remove_watcher() i=0 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.953+0000 7f91245e5e40 2 removed watcher, disabling cache 2023-10-05T19:51:26.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.953+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93877955662400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3304e0 con 0x5561aa2f2230 2023-10-05T19:51:26.015 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-10-05T19:51:26.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.957+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 93877955662400] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:26.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.957+0000 7f91245e5e40 20 remove_watcher() i=1 2023-10-05T19:51:26.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.957+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93877955656688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3304e0 con 0x5561aa325070 2023-10-05T19:51:26.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.957+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 93877955656688] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.957+0000 7f91245e5e40 20 remove_watcher() i=2 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.957+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93877955663792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32fbf0 con 0x7f9114038070 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.961+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 93877955663792] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.961+0000 7f91245e5e40 20 remove_watcher() i=3 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.961+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93877955667664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3304e0 con 0x5561aa325070 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.961+0000 7f912211a700 1 -- 172.21.15.167:0/4141180180 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 93877955667664] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9114028040 con 0x5561aa325070 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.961+0000 7f91245e5e40 20 remove_watcher() i=4 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.961+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93877955670592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32fbf0 con 0x5561aa329ff0 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.965+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 93877955670592] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c040040 con 0x5561aa329ff0 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.965+0000 7f91245e5e40 20 remove_watcher() i=5 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.965+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93877955675536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3326d0 con 0x5561aa329ff0 2023-10-05T19:51:26.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.965+0000 7f911bfff700 1 -- 172.21.15.167:0/4141180180 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 93877955675536] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f910c040040 con 0x5561aa329ff0 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.965+0000 7f91245e5e40 20 remove_watcher() i=6 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.965+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93877955673328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa3304e0 con 0x7f9114038070 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.969+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 93877955673328] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x7f9114038070 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.969+0000 7f91245e5e40 20 remove_watcher() i=7 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.969+0000 7f90f3fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.969+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93877955679616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5561aa32fbf0 con 0x5561aa2f2230 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 93877955679616] v32'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f911c00a5a0 con 0x5561aa2f2230 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa325070 msgr2=0x5561aa327450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa325070 0x5561aa327450 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa2f2230 msgr2=0x5561aa3230f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa2f2230 0x5561aa3230f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9114038070 msgr2=0x7f911401c630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9114038070 0x7f911401c630 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa329ff0 msgr2=0x5561aa32c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa329ff0 0x5561aa32c3d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9104030c00 msgr2=0x7f91040330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9104030c00 0x7f91040330b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f910c00b300 tx=0x7f910c001430 comp rx=0 tx=0).stop 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 msgr2=0x5561aa317600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f912291b700 1 -- 172.21.15.167:0/4141180180 reap_dead start 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa317600 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f911400a5a0 tx=0x7f911401c000 comp rx=0 tx=0).stop 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 shutdown_connections 2023-10-05T19:51:26.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/4141180180 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa2f1920 0x5561aa317600 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 >> 172.21.15.167:0/4141180180 conn(0x5561aa2ed340 msgr2=0x5561aa30afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 shutdown_connections 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/4141180180 wait complete. 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa353a20 msgr2=0x5561aa355e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5561aa353a20 0x5561aa355e30 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa35e1c0 msgr2=0x5561aa3605d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5561aa35e1c0 0x5561aa3605d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5561aa3571a0 msgr2=0x5561aa3595b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x5561aa3571a0 0x5561aa3595b0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa35a9b0 msgr2=0x5561aa35cdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5561aa35a9b0 0x5561aa35cdc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9068030bb0 msgr2=0x7f9068033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9068030bb0 0x7f9068033060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x5561aa335a80 tx=0x7f911c00ae50 comp rx=0 tx=0).stop 2023-10-05T19:51:26.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 msgr2=0x5561aa348e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:51:26.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f912211a700 1 -- 172.21.15.167:0/2605806823 reap_dead start 2023-10-05T19:51:26.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa348e90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f910c00f4b0 tx=0x7f910c037000 comp rx=0 tx=0).stop 2023-10-05T19:51:26.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 shutdown_connections 2023-10-05T19:51:26.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 --2- 172.21.15.167:0/2605806823 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5561aa3432f0 0x5561aa348e90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:51:26.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 >> 172.21.15.167:0/2605806823 conn(0x5561aa33e6b0 msgr2=0x5561aa33c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:51:26.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 shutdown_connections 2023-10-05T19:51:26.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:51:25.973+0000 7f91245e5e40 1 -- 172.21.15.167:0/2605806823 wait complete. 2023-10-05T19:51:26.027 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:51:26.071 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2023-10-05T19:52:01.093 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2023-10-05T19:52:01.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2023-10-05T19:52:01.094 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2023-10-05T19:52:01.134 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:01.134 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:01.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.129+0000 7f9a5c031e40 1 Processor -- start 2023-10-05T19:52:01.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.129+0000 7f9a5c031e40 1 -- start start 2023-10-05T19:52:01.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.129+0000 7f9a5c031e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f883fe2b50 0x55f883fe2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.129+0000 7f9a5c031e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f883f2dbd0 con 0x55f883fe3460 2023-10-05T19:52:01.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.129+0000 7f9a5c031e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f883eeaee0 con 0x55f883fe2b50 2023-10-05T19:52:01.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.129+0000 7f9a59b66700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55f883fe2b50 0x55f883fe2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.129+0000 7f9a59365700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55f883fe3460 0x55f883fe3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50162/0 (socket says 172.21.15.167:50162) 2023-10-05T19:52:01.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.129+0000 7f9a59365700 1 -- 172.21.15.167:0/2067130924 learned_addr learned my addr 172.21.15.167:0/2067130924 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:01.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a58b64700 1 -- 172.21.15.167:0/2067130924 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296382850 0 0) 0x55f883f2dbd0 con 0x55f883fe3460 2023-10-05T19:52:01.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a58b64700 1 -- 172.21.15.167:0/2067130924 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a48001e10 con 0x55f883fe3460 2023-10-05T19:52:01.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a59b66700 1 -- 172.21.15.167:0/2067130924 >> v1:172.21.15.118:6789/0 conn(0x55f883fe3460 legacy=0x55f883fe3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a59b66700 1 -- 172.21.15.167:0/2067130924 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f883fe4600 con 0x55f883fe2b50 2023-10-05T19:52:01.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a59b66700 1 --2- 172.21.15.167:0/2067130924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f883fe2f20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00a5d0 tx=0x7f9a4c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3175e994a29d3875 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a58b64700 1 -- 172.21.15.167:0/2067130924 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4c007610 con 0x55f883fe2b50 2023-10-05T19:52:01.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a58b64700 1 -- 172.21.15.167:0/2067130924 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c007770 con 0x55f883fe2b50 2023-10-05T19:52:01.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a58b64700 1 -- 172.21.15.167:0/2067130924 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4c007a20 con 0x55f883fe2b50 2023-10-05T19:52:01.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2067130924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 msgr2=0x55f883fe2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/2067130924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f883fe2f20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00a5d0 tx=0x7f9a4c005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:01.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2067130924 shutdown_connections 2023-10-05T19:52:01.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/2067130924 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f883fe2f20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2067130924 >> 172.21.15.167:0/2067130924 conn(0x55f883f565c0 msgr2=0x55f883f569c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2067130924 shutdown_connections 2023-10-05T19:52:01.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2067130924 wait complete. 2023-10-05T19:52:01.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 Processor -- start 2023-10-05T19:52:01.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 -- start start 2023-10-05T19:52:01.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840019d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a5c031e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f883eaee30 con 0x55f883fe2b50 2023-10-05T19:52:01.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a59b66700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a59b66700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840019d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46758/0 (socket says 172.21.15.167:46758) 2023-10-05T19:52:01.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.133+0000 7f9a59b66700 1 -- 172.21.15.167:0/723972791 learned_addr learned my addr 172.21.15.167:0/723972791 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a59b66700 1 -- 172.21.15.167:0/723972791 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c005cf0 con 0x55f883fe2b50 2023-10-05T19:52:01.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a59b66700 1 --2- 172.21.15.167:0/723972791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840019d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c005cc0 tx=0x7f9a4c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5d3ceebf256c00 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a537fe700 1 -- 172.21.15.167:0/723972791 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4c007a30 con 0x55f883fe2b50 2023-10-05T19:52:01.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a537fe700 1 -- 172.21.15.167:0/723972791 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c007b90 con 0x55f883fe2b50 2023-10-05T19:52:01.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a537fe700 1 -- 172.21.15.167:0/723972791 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4c007e80 con 0x55f883fe2b50 2023-10-05T19:52:01.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 -- 172.21.15.167:0/723972791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 msgr2=0x55f8840019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/723972791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840019d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c005cc0 tx=0x7f9a4c014000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 -- 172.21.15.167:0/723972791 shutdown_connections 2023-10-05T19:52:01.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/723972791 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840019d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 -- 172.21.15.167:0/723972791 >> 172.21.15.167:0/723972791 conn(0x55f883f565c0 msgr2=0x55f883ffd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 -- 172.21.15.167:0/723972791 shutdown_connections 2023-10-05T19:52:01.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 -- 172.21.15.167:0/723972791 wait complete. 2023-10-05T19:52:01.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 Processor -- start 2023-10-05T19:52:01.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 -- start start 2023-10-05T19:52:01.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840085e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a5c031e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f883e81ed0 con 0x55f883fe2b50 2023-10-05T19:52:01.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a59b66700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a59b66700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840085e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46774/0 (socket says 172.21.15.167:46774) 2023-10-05T19:52:01.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 learned_addr learned my addr 172.21.15.167:0/1534925107 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.137+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f883fe4600 con 0x55f883fe2b50 2023-10-05T19:52:01.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a59b66700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840085e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00afd0 tx=0x7f9a4c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a51ffb700 1 -- 172.21.15.167:0/1534925107 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4c01db90 con 0x55f883fe2b50 2023-10-05T19:52:01.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a51ffb700 1 -- 172.21.15.167:0/1534925107 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c01dd10 con 0x55f883fe2b50 2023-10-05T19:52:01.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f884008b20 con 0x55f883fe2b50 2023-10-05T19:52:01.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a51ffb700 1 -- 172.21.15.167:0/1534925107 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4c012400 con 0x55f883fe2b50 2023-10-05T19:52:01.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f884008fc0 con 0x55f883fe2b50 2023-10-05T19:52:01.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a51ffb700 1 -- 172.21.15.167:0/1534925107 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9a4c02d070 con 0x55f883fe2b50 2023-10-05T19:52:01.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a51ffb700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9a3c030c50 0x7f9a3c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a51ffb700 1 -- 172.21.15.167:0/1534925107 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f9a4c045d20 con 0x55f883fe2b50 2023-10-05T19:52:01.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a59365700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9a3c030c50 0x7f9a3c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f883fe3460 0x55f884014080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884014780 con 0x55f883fe3460 2023-10-05T19:52:01.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.141+0000 7f9a5a367700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f883fe3460 0x55f884014080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a59365700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9a3c030c50 0x7f9a3c033100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9a440044f0 tx=0x7f9a44006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5a367700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f883fe3460 0x55f884014080 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a5400a500 con 0x55f883fe3460 2023-10-05T19:52:01.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 20 realm 2023-10-05T19:52:01.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840116e0 con 0x55f883fe3460 2023-10-05T19:52:01.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a5400a500 con 0x55f883fe3460 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884015260 con 0x55f883fe3460 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a5400a500 con 0x55f883fe3460 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f884014e90 0x55f8840180d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884018800 con 0x55f884014e90 2023-10-05T19:52:01.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a59b66700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f884014e90 0x55f8840180d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.145+0000 7f9a59b66700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f884014e90 0x55f8840180d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a5c031e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840190d0 con 0x55f883fe3460 2023-10-05T19:52:01.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9a5400a500 con 0x55f883fe3460 2023-10-05T19:52:01.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a5c031e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:01.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a5c031e40 20 searching for the correct realm 2023-10-05T19:52:01.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f884018c40 0x55f88401cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884018c40 2023-10-05T19:52:01.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a59365700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f884018c40 0x55f88401cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a59365700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f884018c40 0x55f88401cea0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a44004520 con 0x55f884018c40 2023-10-05T19:52:01.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884014e90 2023-10-05T19:52:01.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a59b66700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9a4c038040 0x7f9a4c0117e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x7f9a4c038040 2023-10-05T19:52:01.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.149+0000 7f9a5a367700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9a4c038040 0x7f9a4c0117e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a5a367700 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9a4c038040 0x7f9a4c0117e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x7f9a4c038040 2023-10-05T19:52:01.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884018c40 2023-10-05T19:52:01.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a44004520 con 0x55f884018c40 2023-10-05T19:52:01.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884014e90 2023-10-05T19:52:01.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.153+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884014e90 2023-10-05T19:52:01.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x7f9a4c038040 2023-10-05T19:52:01.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x7f9a4c038040 2023-10-05T19:52:01.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x7f9a4c038040 2023-10-05T19:52:01.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x7f9a4c038040 2023-10-05T19:52:01.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884014e90 2023-10-05T19:52:01.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.157+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884018c40 2023-10-05T19:52:01.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a44004520 con 0x55f884018c40 2023-10-05T19:52:01.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884014e90 2023-10-05T19:52:01.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884018c40 2023-10-05T19:52:01.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.161+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884018c40 2023-10-05T19:52:01.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x7f9a4c038040 2023-10-05T19:52:01.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x7f9a4c038040 2023-10-05T19:52:01.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f883fe3460 2023-10-05T19:52:01.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x7f9a4c038040 2023-10-05T19:52:01.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x7f9a4c038040 2023-10-05T19:52:01.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884018c40 2023-10-05T19:52:01.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x7f9a4c038040 2023-10-05T19:52:01.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x7f9a4c038040 2023-10-05T19:52:01.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.165+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884014e90 2023-10-05T19:52:01.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884014e90 2023-10-05T19:52:01.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401d480 con 0x55f884018c40 2023-10-05T19:52:01.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f9a44021040 con 0x55f884014e90 2023-10-05T19:52:01.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f9a44021040 con 0x55f884014e90 2023-10-05T19:52:01.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a5c031e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:01.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a5c031e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:01.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a5c031e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:01.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a5c031e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:01.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.169+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884019c40 con 0x55f883fe3460 2023-10-05T19:52:01.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401a5c0 con 0x55f884014e90 2023-10-05T19:52:01.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884019830 con 0x55f884014e90 2023-10-05T19:52:01.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:01.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401de30 con 0x55f884018c40 2023-10-05T19:52:01.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.173+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e590 con 0x55f884014e90 2023-10-05T19:52:01.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a5c031e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401f950 con 0x55f884018c40 2023-10-05T19:52:01.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401f950 con 0x55f884014e90 2023-10-05T19:52:01.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401f950 con 0x7f9a4c038040 2023-10-05T19:52:01.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x7f9a4c038040 2023-10-05T19:52:01.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.177+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884018c40 2023-10-05T19:52:01.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884014e90 2023-10-05T19:52:01.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884014e90 2023-10-05T19:52:01.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x7f9a4c038040 2023-10-05T19:52:01.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x7f9a4c038040 2023-10-05T19:52:01.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.181+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x7f9a4c038040 2023-10-05T19:52:01.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x7f9a4c038040 2023-10-05T19:52:01.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884014e90 2023-10-05T19:52:01.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884018c40 2023-10-05T19:52:01.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884014e90 2023-10-05T19:52:01.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.185+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884018c40 2023-10-05T19:52:01.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54014040 con 0x55f883fe3460 2023-10-05T19:52:01.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884018c40 2023-10-05T19:52:01.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x7f9a4c038040 2023-10-05T19:52:01.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.189+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f883fe3460 2023-10-05T19:52:01.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x7f9a4c038040 2023-10-05T19:52:01.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884018c40 2023-10-05T19:52:01.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x7f9a4c038040 2023-10-05T19:52:01.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884014e90 2023-10-05T19:52:01.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884014e90 2023-10-05T19:52:01.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884018c40 2023-10-05T19:52:01.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.193+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884014e90 2023-10-05T19:52:01.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e1e0 con 0x55f884014e90 2023-10-05T19:52:01.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:01.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:01.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:01.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:01.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401e940 con 0x55f884014e90 2023-10-05T19:52:01.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401ecf0 con 0x55f883fe3460 2023-10-05T19:52:01.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:01.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401da60 con 0x55f884014e90 2023-10-05T19:52:01.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.197+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401f610 con 0x55f884014e90 2023-10-05T19:52:01.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:01.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401f610 con 0x7f9a4c038040 2023-10-05T19:52:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 zone default found 2023-10-05T19:52:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 4 Realm: () 2023-10-05T19:52:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 zonegroup default 2023-10-05T19:52:01.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401f610 con 0x7f9a4c038040 2023-10-05T19:52:01.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884020f90 con 0x55f884018c40 2023-10-05T19:52:01.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884021340 con 0x55f884018c40 2023-10-05T19:52:01.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 started sync module instance, tier type = 2023-10-05T19:52:01.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:01.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.201+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884020650 con 0x55f884014e90 2023-10-05T19:52:01.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.205+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.205+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94525854970304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884020b80 con 0x55f884014e90 2023-10-05T19:52:01.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.205+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884021d60 con 0x55f883fe3460 2023-10-05T19:52:01.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.209+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94525854970304] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.209+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.209+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94525854975568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884021d20 con 0x55f883fe3460 2023-10-05T19:52:01.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.209+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884022600 con 0x55f884014e90 2023-10-05T19:52:01.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.209+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94525854975568] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.209+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.209+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94525854980144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884022170 con 0x55f884014e90 2023-10-05T19:52:01.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.209+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884022ef0 con 0x7f9a4c038040 2023-10-05T19:52:01.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.213+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94525854980144] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.213+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.213+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94525854981536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884022ef0 con 0x7f9a4c038040 2023-10-05T19:52:01.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.213+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884023790 con 0x55f884014e90 2023-10-05T19:52:01.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.213+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94525854981536] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.213+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.213+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94525854985264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884023570 con 0x55f884014e90 2023-10-05T19:52:01.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.213+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840241f0 con 0x55f884018c40 2023-10-05T19:52:01.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.217+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.217+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94525854985264] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.217+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94525854989568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884024a90 con 0x55f884018c40 2023-10-05T19:52:01.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.217+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884023080 con 0x55f884018c40 2023-10-05T19:52:01.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.217+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94525854989568] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.217+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.217+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94525854994352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840246b0 con 0x55f884018c40 2023-10-05T19:52:01.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.217+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884026090 con 0x7f9a4c038040 2023-10-05T19:52:01.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94525854994352] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94525854997408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884025ff0 con 0x7f9a4c038040 2023-10-05T19:52:01.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 20 add_watcher() i=0 2023-10-05T19:52:01.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 20 add_watcher() i=1 2023-10-05T19:52:01.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 20 add_watcher() i=2 2023-10-05T19:52:01.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 20 add_watcher() i=3 2023-10-05T19:52:01.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 20 add_watcher() i=4 2023-10-05T19:52:01.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 20 add_watcher() i=5 2023-10-05T19:52:01.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 20 add_watcher() i=6 2023-10-05T19:52:01.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94525854997408] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 20 add_watcher() i=7 2023-10-05T19:52:01.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:01.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884025430 con 0x55f883fe3460 2023-10-05T19:52:01.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.221+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94525854995504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884026910 con 0x55f883fe3460 2023-10-05T19:52:01.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94525854995504] v32'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a2afe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:01.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a5c031e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:01.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a5c031e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:01.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a5c031e40 1 Processor -- start 2023-10-05T19:52:01.230 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a5c031e40 1 -- start start 2023-10-05T19:52:01.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a5c031e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884033ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a5c031e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8840340e0 con 0x55f8840337d0 2023-10-05T19:52:01.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a59365700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884033ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a59365700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884033ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46786/0 (socket says 172.21.15.167:46786) 2023-10-05T19:52:01.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a59365700 1 -- 172.21.15.167:0/1521110577 learned_addr learned my addr 172.21.15.167:0/1521110577 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a59365700 1 -- 172.21.15.167:0/1521110577 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f884034220 con 0x55f8840337d0 2023-10-05T19:52:01.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a59365700 1 --2- 172.21.15.167:0/1521110577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884033ba0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c01c720 tx=0x7f9a44006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3aa0987920a70dc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a2a7e4700 1 -- 172.21.15.167:0/1521110577 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4401a040 con 0x55f8840337d0 2023-10-05T19:52:01.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a2a7e4700 1 -- 172.21.15.167:0/1521110577 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4402dae0 con 0x55f8840337d0 2023-10-05T19:52:01.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.225+0000 7f9a2a7e4700 1 -- 172.21.15.167:0/1521110577 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4402dc90 con 0x55f8840337d0 2023-10-05T19:52:01.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1521110577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 msgr2=0x55f884033ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1521110577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884033ba0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c01c720 tx=0x7f9a44006000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1521110577 shutdown_connections 2023-10-05T19:52:01.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1521110577 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884033ba0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1521110577 >> 172.21.15.167:0/1521110577 conn(0x55f88402eb90 msgr2=0x55f88402cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1521110577 shutdown_connections 2023-10-05T19:52:01.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1521110577 wait complete. 2023-10-05T19:52:01.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 Processor -- start 2023-10-05T19:52:01.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 -- start start 2023-10-05T19:52:01.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884039260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88403a260 con 0x55f8840337d0 2023-10-05T19:52:01.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a59365700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884039260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a59365700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884039260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46792/0 (socket says 172.21.15.167:46792) 2023-10-05T19:52:01.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a59365700 1 -- 172.21.15.167:0/2350906116 learned_addr learned my addr 172.21.15.167:0/2350906116 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a59365700 1 -- 172.21.15.167:0/2350906116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a48001e10 con 0x55f8840337d0 2023-10-05T19:52:01.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a59365700 1 --2- 172.21.15.167:0/2350906116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884039260 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9a44004fd0 tx=0x7f9a44036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a28fe1700 1 -- 172.21.15.167:0/2350906116 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a4401a040 con 0x55f8840337d0 2023-10-05T19:52:01.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2350906116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f884039860 con 0x55f8840337d0 2023-10-05T19:52:01.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a28fe1700 1 -- 172.21.15.167:0/2350906116 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a44004330 con 0x55f8840337d0 2023-10-05T19:52:01.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a28fe1700 1 -- 172.21.15.167:0/2350906116 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a44014930 con 0x55f8840337d0 2023-10-05T19:52:01.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.229+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2350906116 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f884039d00 con 0x55f8840337d0 2023-10-05T19:52:01.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9a28fe1700 1 -- 172.21.15.167:0/2350906116 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f9a44014b10 con 0x55f8840337d0 2023-10-05T19:52:01.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9a28fe1700 1 --2- 172.21.15.167:0/2350906116 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f99a0030c50 0x7f99a0033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9a28fe1700 1 -- 172.21.15.167:0/2350906116 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f9a44027040 con 0x55f8840337d0 2023-10-05T19:52:01.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9a5a367700 1 --2- 172.21.15.167:0/2350906116 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f99a0030c50 0x7f99a0033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9a5c031e40 5 note: GC not initialized 2023-10-05T19:52:01.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9a5a367700 1 --2- 172.21.15.167:0/2350906116 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f99a0030c50 0x7f99a0033100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55f884026290 tx=0x7f9a5400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f99937fe700 20 reqs_thread_entry: start 2023-10-05T19:52:01.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9a5c031e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:01.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9999ffb700 20 reqs_thread_entry: start 2023-10-05T19:52:01.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9a5c031e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:01.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9991ffb700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:31 2023 2023-10-05T19:52:01.240 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:01.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f99917fa700 20 reqs_thread_entry: start 2023-10-05T19:52:01.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.233+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f884014e90 2023-10-05T19:52:01.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f883fe3460 2023-10-05T19:52:01.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f884014e90 2023-10-05T19:52:01.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f884018c40 2023-10-05T19:52:01.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(105 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f884014e90 2023-10-05T19:52:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f884018c40 2023-10-05T19:52:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(107 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.237+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f883fe3460 2023-10-05T19:52:01.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(108 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f883fe3460 2023-10-05T19:52:01.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(109 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f884018c40 2023-10-05T19:52:01.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(110 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f884018c40 2023-10-05T19:52:01.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(111 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9a4401d040 con 0x55f884018c40 2023-10-05T19:52:01.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a23a0 con 0x55f884018c40 2023-10-05T19:52:01.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(112 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f9a44051500 con 0x55f884018c40 2023-10-05T19:52:01.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a04f0 con 0x55f883fe3460 2023-10-05T19:52:01.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.241+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a04f0 con 0x7f9a4c038040 2023-10-05T19:52:01.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(114 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884018c40 2023-10-05T19:52:01.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(115 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a44051040 con 0x55f884018c40 2023-10-05T19:52:01.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:116 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x7f9a4c038040 2023-10-05T19:52:01.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(116 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:117 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f883fe3460 2023-10-05T19:52:01.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(117 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:118 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884018c40 2023-10-05T19:52:01.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(118 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a44051040 con 0x55f884018c40 2023-10-05T19:52:01.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:119 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f883fe3460 2023-10-05T19:52:01.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(119 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.245+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:120 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884014e90 2023-10-05T19:52:01.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(120 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884014e90 2023-10-05T19:52:01.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(121 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:122 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884018c40 2023-10-05T19:52:01.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(122 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a44051040 con 0x55f884018c40 2023-10-05T19:52:01.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884014e90 2023-10-05T19:52:01.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(123 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:124 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884018c40 2023-10-05T19:52:01.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(124 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a44051040 con 0x55f884018c40 2023-10-05T19:52:01.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:125 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f883fe3460 2023-10-05T19:52:01.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(125 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:126 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884014e90 2023-10-05T19:52:01.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(126 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.249+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:127 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884014e90 2023-10-05T19:52:01.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(127 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:128 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884014e90 2023-10-05T19:52:01.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(128 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:129 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f883fe3460 2023-10-05T19:52:01.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(129 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:130 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884018c40 2023-10-05T19:52:01.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(130 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a44051040 con 0x55f884018c40 2023-10-05T19:52:01.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:131 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884018c40 2023-10-05T19:52:01.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(131 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a44051040 con 0x55f884018c40 2023-10-05T19:52:01.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:132 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f884014e90 2023-10-05T19:52:01.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(132 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.253+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:133 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a0000 con 0x55f883fe3460 2023-10-05T19:52:01.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.257+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(133 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.257+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94525854970304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f8840a08e0 con 0x55f884014e90 2023-10-05T19:52:01.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.257+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 94525854970304] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.257+0000 7f9a5c031e40 20 remove_watcher() i=0 2023-10-05T19:52:01.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.257+0000 7f9a5c031e40 2 removed watcher, disabling cache 2023-10-05T19:52:01.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.257+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94525854975568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401f1c0 con 0x55f883fe3460 2023-10-05T19:52:01.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.261+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 94525854975568] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.261+0000 7f9a5c031e40 20 remove_watcher() i=1 2023-10-05T19:52:01.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.261+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94525854980144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f88401f1c0 con 0x55f884014e90 2023-10-05T19:52:01.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.261+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 94525854980144] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.261+0000 7f9a5c031e40 20 remove_watcher() i=2 2023-10-05T19:52:01.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.261+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94525854981536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884021830 con 0x7f9a4c038040 2023-10-05T19:52:01.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.265+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 94525854981536] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.265+0000 7f9a5c031e40 20 remove_watcher() i=3 2023-10-05T19:52:01.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.265+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94525854985264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884021da0 con 0x55f884014e90 2023-10-05T19:52:01.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.269+0000 7f9a59b66700 1 -- 172.21.15.167:0/1534925107 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 94525854985264] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a4c02c030 con 0x55f884014e90 2023-10-05T19:52:01.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.269+0000 7f9a5c031e40 20 remove_watcher() i=4 2023-10-05T19:52:01.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.269+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94525854989568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884021830 con 0x55f884018c40 2023-10-05T19:52:01.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.269+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 94525854989568] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a44051040 con 0x55f884018c40 2023-10-05T19:52:01.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.269+0000 7f9a5c031e40 20 remove_watcher() i=5 2023-10-05T19:52:01.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.269+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94525854994352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884022c30 con 0x55f884018c40 2023-10-05T19:52:01.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.269+0000 7f9a59365700 1 -- 172.21.15.167:0/1534925107 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 94525854994352] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a44051040 con 0x55f884018c40 2023-10-05T19:52:01.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.273+0000 7f9a5c031e40 20 remove_watcher() i=6 2023-10-05T19:52:01.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.273+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94525854997408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884021da0 con 0x7f9a4c038040 2023-10-05T19:52:01.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.273+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 94525854997408] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x7f9a4c038040 2023-10-05T19:52:01.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.273+0000 7f9a5c031e40 20 remove_watcher() i=7 2023-10-05T19:52:01.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.273+0000 7f9a2afe5700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:01.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.273+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94525854995504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55f884021830 con 0x55f883fe3460 2023-10-05T19:52:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94525854995504] v32'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9a54033040 con 0x55f883fe3460 2023-10-05T19:52:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f884014e90 msgr2=0x55f8840180d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55f884014e90 0x55f8840180d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f883fe3460 msgr2=0x55f884014080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55f883fe3460 0x55f884014080 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9a4c038040 msgr2=0x7f9a4c0117e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f9a4c038040 0x7f9a4c0117e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f884018c40 msgr2=0x55f88401cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55f884018c40 0x55f88401cea0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9a3c030c50 msgr2=0x7f9a3c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f9a3c030c50 0x7f9a3c033100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9a440044f0 tx=0x7f9a44006690 comp rx=0 tx=0).stop 2023-10-05T19:52:01.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 msgr2=0x55f8840085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840085e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00afd0 tx=0x7f9a4c01c000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5a367700 1 -- 172.21.15.167:0/1534925107 reap_dead start 2023-10-05T19:52:01.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 shutdown_connections 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/1534925107 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f883fe2b50 0x55f8840085e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 >> 172.21.15.167:0/1534925107 conn(0x55f883f565c0 msgr2=0x55f883ffc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 shutdown_connections 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.277+0000 7f9a5c031e40 1 -- 172.21.15.167:0/1534925107 wait complete. 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2350906116 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f99a0030c50 msgr2=0x7f99a0033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/2350906116 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f99a0030c50 0x7f99a0033100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55f884026290 tx=0x7f9a5400e040 comp rx=0 tx=0).stop 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2350906116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 msgr2=0x55f884039260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/2350906116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884039260 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9a44004fd0 tx=0x7f9a44036000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2350906116 shutdown_connections 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/2350906116 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f99a0030c50 0x7f99a0033100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.286 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 --2- 172.21.15.167:0/2350906116 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55f8840337d0 0x55f884039260 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2350906116 >> 172.21.15.167:0/2350906116 conn(0x55f88402eb90 msgr2=0x55f88402cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2350906116 shutdown_connections 2023-10-05T19:52:01.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.281+0000 7f9a5c031e40 1 -- 172.21.15.167:0/2350906116 wait complete. 2023-10-05T19:52:01.287 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:01.287 INFO:teuthology.orchestra.run.smithi167.stdout: "entries": [ 2023-10-05T19:52:01.287 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.287 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "anonymous", 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: "buckets": [ 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "anonymous", 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.288 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: "buckets": [ 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.289 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_obj", 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.290 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.291 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:01.292 INFO:teuthology.orchestra.run.smithi167.stdout: "summary": [ 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "anonymous", 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [], 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: "total": { 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 0, 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 0 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.293 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_obj", 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: "total": { 2023-10-05T19:52:01.294 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.295 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.295 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:01.295 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:01.295 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.295 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.295 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.295 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:01.296 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2023-10-05T19:52:01.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2023-10-05T19:52:01.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2023-10-05T19:52:01.296 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2023-10-05T19:52:01.332 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:01.332 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:01.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 Processor -- start 2023-10-05T19:52:01.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 -- start start 2023-10-05T19:52:01.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5608027740f0 0x5608027764d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5608026bac00 con 0x56080276fb20 2023-10-05T19:52:01.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x560802677ee0 con 0x5608027740f0 2023-10-05T19:52:01.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5640546700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5608027740f0 0x5608027764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5640546700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x5608027740f0 0x5608027764d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46806/0 (socket says 172.21.15.167:46806) 2023-10-05T19:52:01.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5640546700 1 -- 172.21.15.167:0/1180429178 learned_addr learned my addr 172.21.15.167:0/1180429178 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5640d47700 1 --1- 172.21.15.167:0/1180429178 >> v1:172.21.15.118:6789/0 conn(0x56080276fb20 0x56080276fef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50172/0 (socket says 172.21.15.167:50172) 2023-10-05T19:52:01.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5640546700 1 -- 172.21.15.167:0/1180429178 >> v1:172.21.15.118:6789/0 conn(0x56080276fb20 legacy=0x56080276fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5640546700 1 -- 172.21.15.167:0/1180429178 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560802770730 con 0x5608027740f0 2023-10-05T19:52:01.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5640546700 1 --2- 172.21.15.167:0/1180429178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027740f0 0x5608027764d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f563800a5c0 tx=0x7f5638005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b487b7efa260d59 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f563fd45700 1 -- 172.21.15.167:0/1180429178 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f563800e510 con 0x5608027740f0 2023-10-05T19:52:01.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f563fd45700 1 -- 172.21.15.167:0/1180429178 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800e670 con 0x5608027740f0 2023-10-05T19:52:01.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f563fd45700 1 -- 172.21.15.167:0/1180429178 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f563800e920 con 0x5608027740f0 2023-10-05T19:52:01.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 -- 172.21.15.167:0/1180429178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027740f0 msgr2=0x5608027764d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 --2- 172.21.15.167:0/1180429178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027740f0 0x5608027764d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f563800a5c0 tx=0x7f5638005e00 comp rx=0 tx=0).stop 2023-10-05T19:52:01.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 -- 172.21.15.167:0/1180429178 shutdown_connections 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 --2- 172.21.15.167:0/1180429178 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027740f0 0x5608027764d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 -- 172.21.15.167:0/1180429178 >> 172.21.15.167:0/1180429178 conn(0x5608026e3590 msgr2=0x5608026e3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 -- 172.21.15.167:0/1180429178 shutdown_connections 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.329+0000 7f5643212e40 1 -- 172.21.15.167:0/1180429178 wait complete. 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 Processor -- start 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 -- start start 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x56080278eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080263be30 con 0x56080276fb20 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5640d47700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x56080278eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5640d47700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x56080278eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46822/0 (socket says 172.21.15.167:46822) 2023-10-05T19:52:01.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5640d47700 1 -- 172.21.15.167:0/1273633080 learned_addr learned my addr 172.21.15.167:0/1273633080 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5640d47700 1 -- 172.21.15.167:0/1273633080 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563800a180 con 0x56080276fb20 2023-10-05T19:52:01.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5640d47700 1 --2- 172.21.15.167:0/1273633080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x56080278eba0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5630001cf0 tx=0x7f56300018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5d308bd6c90373 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f563ed43700 1 -- 172.21.15.167:0/1273633080 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5630014070 con 0x56080276fb20 2023-10-05T19:52:01.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f563ed43700 1 -- 172.21.15.167:0/1273633080 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563000be10 con 0x56080276fb20 2023-10-05T19:52:01.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f563ed43700 1 -- 172.21.15.167:0/1273633080 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f563000f590 con 0x56080276fb20 2023-10-05T19:52:01.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 -- 172.21.15.167:0/1273633080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 msgr2=0x56080278eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 --2- 172.21.15.167:0/1273633080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x56080278eba0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5630001cf0 tx=0x7f56300018a0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 -- 172.21.15.167:0/1273633080 shutdown_connections 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 --2- 172.21.15.167:0/1273633080 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x56080278eba0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 -- 172.21.15.167:0/1273633080 >> 172.21.15.167:0/1273633080 conn(0x5608026e3590 msgr2=0x56080278a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 -- 172.21.15.167:0/1273633080 shutdown_connections 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 -- 172.21.15.167:0/1273633080 wait complete. 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 Processor -- start 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 -- start start 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x560802795940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5643212e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56080260eed0 con 0x56080276fb20 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.333+0000 7f5640d47700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x560802795940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f5640d47700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x560802795940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46834/0 (socket says 172.21.15.167:46834) 2023-10-05T19:52:01.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 learned_addr learned my addr 172.21.15.167:0/353059656 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608026bac00 con 0x56080276fb20 2023-10-05T19:52:01.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f5640d47700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x560802795940 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f56300018e0 tx=0x7f5630016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f563d540700 1 -- 172.21.15.167:0/353059656 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f563001c740 con 0x56080276fb20 2023-10-05T19:52:01.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f563d540700 1 -- 172.21.15.167:0/353059656 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563001c8a0 con 0x56080276fb20 2023-10-05T19:52:01.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560802795e80 con 0x56080276fb20 2023-10-05T19:52:01.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f563d540700 1 -- 172.21.15.167:0/353059656 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f563001cb90 con 0x56080276fb20 2023-10-05T19:52:01.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5608027962c0 con 0x56080276fb20 2023-10-05T19:52:01.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f563d540700 1 -- 172.21.15.167:0/353059656 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f5630023020 con 0x56080276fb20 2023-10-05T19:52:01.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f563d540700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5624030c00 0x7f56240330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f563d540700 1 -- 172.21.15.167:0/353059656 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f5630008030 con 0x56080276fb20 2023-10-05T19:52:01.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f5640546700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5624030c00 0x7f56240330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.337+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5608027740f0 0x5608027a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027a1b10 con 0x5608027740f0 2023-10-05T19:52:01.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5641548700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5608027740f0 0x5608027a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5640546700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5624030c00 0x7f56240330b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5638000f80 tx=0x7f5638013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5641548700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5608027740f0 0x5608027a13e0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f562800a500 con 0x5608027740f0 2023-10-05T19:52:01.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 20 realm 2023-10-05T19:52:01.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080279e9c0 con 0x5608027740f0 2023-10-05T19:52:01.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f562800a500 con 0x5608027740f0 2023-10-05T19:52:01.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.348 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:01.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027a25f0 con 0x5608027740f0 2023-10-05T19:52:01.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f562800a500 con 0x5608027740f0 2023-10-05T19:52:01.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5608027a2220 0x5608027a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027a5b90 con 0x5608027a2220 2023-10-05T19:52:01.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5640d47700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5608027a2220 0x5608027a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.341+0000 7f5640d47700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5608027a2220 0x5608027a5460 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5643212e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027a6460 con 0x5608027740f0 2023-10-05T19:52:01.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f562800a500 con 0x5608027740f0 2023-10-05T19:52:01.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5643212e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:01.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5643212e40 20 searching for the correct realm 2023-10-05T19:52:01.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5608027a5fd0 0x5608027aa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a5fd0 2023-10-05T19:52:01.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5640546700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5608027a5fd0 0x5608027aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5640546700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5608027a5fd0 0x5608027aa230 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a2220 2023-10-05T19:52:01.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5640d47700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f563001a070 0x7f5630042210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x7f563001a070 2023-10-05T19:52:01.353 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.345+0000 7f5641548700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f563001a070 0x7f5630042210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5641548700 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f563001a070 0x7f5630042210 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x7f563001a070 2023-10-05T19:52:01.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a5fd0 2023-10-05T19:52:01.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a2220 2023-10-05T19:52:01.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.349+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a2220 2023-10-05T19:52:01.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x7f563001a070 2023-10-05T19:52:01.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x7f563001a070 2023-10-05T19:52:01.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x7f563001a070 2023-10-05T19:52:01.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x7f563001a070 2023-10-05T19:52:01.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a2220 2023-10-05T19:52:01.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a5fd0 2023-10-05T19:52:01.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.353+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a2220 2023-10-05T19:52:01.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a5fd0 2023-10-05T19:52:01.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a5fd0 2023-10-05T19:52:01.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.357+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x7f563001a070 2023-10-05T19:52:01.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x7f563001a070 2023-10-05T19:52:01.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027740f0 2023-10-05T19:52:01.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x7f563001a070 2023-10-05T19:52:01.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x7f563001a070 2023-10-05T19:52:01.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a5fd0 2023-10-05T19:52:01.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x7f563001a070 2023-10-05T19:52:01.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x7f563001a070 2023-10-05T19:52:01.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a2220 2023-10-05T19:52:01.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a2220 2023-10-05T19:52:01.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.361+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a5fd0 2023-10-05T19:52:01.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a2220 2023-10-05T19:52:01.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aa810 con 0x5608027a2220 2023-10-05T19:52:01.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:01.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:01.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:01.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:01.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027a6fd0 con 0x5608027740f0 2023-10-05T19:52:01.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027a7460 con 0x5608027a2220 2023-10-05T19:52:01.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.365+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027a7890 con 0x5608027a2220 2023-10-05T19:52:01.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:01.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab170 con 0x5608027a5fd0 2023-10-05T19:52:01.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab8d0 con 0x5608027a2220 2023-10-05T19:52:01.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027acc90 con 0x5608027a5fd0 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027acc90 con 0x5608027a2220 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.369+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027acc90 con 0x7f563001a070 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x7f563001a070 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a5fd0 2023-10-05T19:52:01.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a2220 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.373+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a2220 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x7f563001a070 2023-10-05T19:52:01.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x7f563001a070 2023-10-05T19:52:01.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x7f563001a070 2023-10-05T19:52:01.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x7f563001a070 2023-10-05T19:52:01.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a2220 2023-10-05T19:52:01.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.377+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a5fd0 2023-10-05T19:52:01.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a2220 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a5fd0 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628014040 con 0x5608027740f0 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.381+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a5fd0 2023-10-05T19:52:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x7f563001a070 2023-10-05T19:52:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027740f0 2023-10-05T19:52:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x7f563001a070 2023-10-05T19:52:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a5fd0 2023-10-05T19:52:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x7f563001a070 2023-10-05T19:52:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.385+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a2220 2023-10-05T19:52:01.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a2220 2023-10-05T19:52:01.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a5fd0 2023-10-05T19:52:01.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a2220 2023-10-05T19:52:01.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ab520 con 0x5608027a2220 2023-10-05T19:52:01.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5643212e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:01.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5643212e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:01.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5643212e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:01.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5643212e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:01.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.389+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027abc80 con 0x5608027a2220 2023-10-05T19:52:01.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ac030 con 0x5608027740f0 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ac8d0 con 0x5608027a2220 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ac8d0 con 0x5608027a2220 2023-10-05T19:52:01.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.393+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ac8d0 con 0x7f563001a070 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 zone default found 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 4 Realm: () 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:01.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 zonegroup default 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ac8d0 con 0x7f563001a070 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ae250 con 0x5608027a5fd0 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ae600 con 0x5608027a5fd0 2023-10-05T19:52:01.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 started sync module instance, tier type = 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.397+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ad910 con 0x5608027a2220 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.401+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.401+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94592401331232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ade10 con 0x5608027a2220 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.401+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ad930 con 0x5608027740f0 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.401+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.401+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94592401331232] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.401+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94592401338016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027af8d0 con 0x5608027740f0 2023-10-05T19:52:01.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.401+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027afdf0 con 0x5608027a2220 2023-10-05T19:52:01.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.405+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.405+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94592401338016] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.405+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94592401339360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027afdf0 con 0x5608027a2220 2023-10-05T19:52:01.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.405+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b0690 con 0x7f563001a070 2023-10-05T19:52:01.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.405+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94592401339360] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.405+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.409+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94592401341936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aead0 con 0x7f563001a070 2023-10-05T19:52:01.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.409+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b0e30 con 0x5608027a2220 2023-10-05T19:52:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.409+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94592401341936] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.409+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.409+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94592401343040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027aead0 con 0x5608027a2220 2023-10-05T19:52:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.409+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b1890 con 0x5608027a5fd0 2023-10-05T19:52:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.413+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94592401343040] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.413+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.413+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94592401347488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b1c40 con 0x5608027a5fd0 2023-10-05T19:52:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.413+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b24e0 con 0x5608027a5fd0 2023-10-05T19:52:01.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.413+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94592401347488] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.413+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.413+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94592401344768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b2dd0 con 0x5608027a5fd0 2023-10-05T19:52:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.413+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b36b0 con 0x7f563001a070 2023-10-05T19:52:01.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.413+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94592401344768] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638017050 con 0x5608027a5fd0 2023-10-05T19:52:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94592401352928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b3ab0 con 0x7f563001a070 2023-10-05T19:52:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 20 add_watcher() i=0 2023-10-05T19:52:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 20 add_watcher() i=1 2023-10-05T19:52:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 20 add_watcher() i=2 2023-10-05T19:52:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 20 add_watcher() i=3 2023-10-05T19:52:01.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 20 add_watcher() i=4 2023-10-05T19:52:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 20 add_watcher() i=5 2023-10-05T19:52:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 20 add_watcher() i=6 2023-10-05T19:52:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94592401352928] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 20 add_watcher() i=7 2023-10-05T19:52:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b6fd0 con 0x5608027740f0 2023-10-05T19:52:01.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.417+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94592401357408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b43a0 con 0x5608027740f0 2023-10-05T19:52:01.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94592401357408] v32'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f56117f2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:01.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:01.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 Processor -- start 2023-10-05T19:52:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 -- start start 2023-10-05T19:52:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608027c1a90 con 0x5608027c1180 2023-10-05T19:52:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5640546700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5640546700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46842/0 (socket says 172.21.15.167:46842) 2023-10-05T19:52:01.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5640546700 1 -- 172.21.15.167:0/2798339574 learned_addr learned my addr 172.21.15.167:0/2798339574 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5640546700 1 -- 172.21.15.167:0/2798339574 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608027c1bd0 con 0x5608027c1180 2023-10-05T19:52:01.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5640546700 1 --2- 172.21.15.167:0/2798339574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c1550 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5638003000 tx=0x7f5638010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed508c32d1363f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5610ff1700 1 -- 172.21.15.167:0/2798339574 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f563802d040 con 0x5608027c1180 2023-10-05T19:52:01.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5610ff1700 1 -- 172.21.15.167:0/2798339574 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638010b30 con 0x5608027c1180 2023-10-05T19:52:01.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5610ff1700 1 -- 172.21.15.167:0/2798339574 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5638010cc0 con 0x5608027c1180 2023-10-05T19:52:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 -- 172.21.15.167:0/2798339574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 msgr2=0x5608027c1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 --2- 172.21.15.167:0/2798339574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c1550 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5638003000 tx=0x7f5638010000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 -- 172.21.15.167:0/2798339574 shutdown_connections 2023-10-05T19:52:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 --2- 172.21.15.167:0/2798339574 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c1550 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 -- 172.21.15.167:0/2798339574 >> 172.21.15.167:0/2798339574 conn(0x5608027bc540 msgr2=0x5608027ba6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 -- 172.21.15.167:0/2798339574 shutdown_connections 2023-10-05T19:52:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.421+0000 7f5643212e40 1 -- 172.21.15.167:0/2798339574 wait complete. 2023-10-05T19:52:01.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5643212e40 1 Processor -- start 2023-10-05T19:52:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5643212e40 1 -- start start 2023-10-05T19:52:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5643212e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5643212e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608027c7b90 con 0x5608027c1180 2023-10-05T19:52:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5640546700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5640546700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46858/0 (socket says 172.21.15.167:46858) 2023-10-05T19:52:01.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5640546700 1 -- 172.21.15.167:0/2483706710 learned_addr learned my addr 172.21.15.167:0/2483706710 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5640546700 1 -- 172.21.15.167:0/2483706710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560802770730 con 0x5608027c1180 2023-10-05T19:52:01.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5640546700 1 --2- 172.21.15.167:0/2483706710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c6b90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f563800ea70 tx=0x7f563802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f558affd700 1 -- 172.21.15.167:0/2483706710 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5638033430 con 0x5608027c1180 2023-10-05T19:52:01.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f558affd700 1 -- 172.21.15.167:0/2483706710 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638033590 con 0x5608027c1180 2023-10-05T19:52:01.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5643212e40 1 -- 172.21.15.167:0/2483706710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5608027c7190 con 0x5608027c1180 2023-10-05T19:52:01.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f558affd700 1 -- 172.21.15.167:0/2483706710 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5638033780 con 0x5608027c1180 2023-10-05T19:52:01.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.425+0000 7f5643212e40 1 -- 172.21.15.167:0/2483706710 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5608027c75d0 con 0x5608027c1180 2023-10-05T19:52:01.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f558affd700 1 -- 172.21.15.167:0/2483706710 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f56380338e0 con 0x5608027c1180 2023-10-05T19:52:01.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f558affd700 1 --2- 172.21.15.167:0/2483706710 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5580030c00 0x7f55800330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f558affd700 1 -- 172.21.15.167:0/2483706710 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f5638046cf0 con 0x5608027c1180 2023-10-05T19:52:01.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f5641548700 1 --2- 172.21.15.167:0/2483706710 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5580030c00 0x7f55800330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f5643212e40 5 note: GC not initialized 2023-10-05T19:52:01.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f5641548700 1 --2- 172.21.15.167:0/2483706710 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5580030c00 0x7f55800330b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5608027b3490 tx=0x7f562800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f557ffff700 20 reqs_thread_entry: start 2023-10-05T19:52:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f557dffb700 20 reqs_thread_entry: start 2023-10-05T19:52:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f5643212e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f5643212e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:01.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.429+0000 7f556bfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:31 2023 2023-10-05T19:52:01.436 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:01.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f556b7fe700 20 reqs_thread_entry: start 2023-10-05T19:52:01.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:102 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027a2220 2023-10-05T19:52:01.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(102 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027740f0 2023-10-05T19:52:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027a2220 2023-10-05T19:52:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(104 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027a5fd0 2023-10-05T19:52:01.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(105 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027a2220 2023-10-05T19:52:01.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.433+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027a5fd0 2023-10-05T19:52:01.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(107 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:108 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027740f0 2023-10-05T19:52:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(108 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027740f0 2023-10-05T19:52:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(109 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027a5fd0 2023-10-05T19:52:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(110 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027a5fd0 2023-10-05T19:52:01.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(111 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282fcf0 con 0x5608027a5fd0 2023-10-05T19:52:01.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(112 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282de40 con 0x5608027740f0 2023-10-05T19:52:01.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.437+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x7f563001a070 2023-10-05T19:52:01.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(114 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a5fd0 2023-10-05T19:52:01.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(115 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:116 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x7f563001a070 2023-10-05T19:52:01.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(116 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:117 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027740f0 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(117 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:118 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a5fd0 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(118 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:119 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282de40 con 0x5608027740f0 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(119 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.441+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:120 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a2220 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(120 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a2220 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(121 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:122 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a5fd0 2023-10-05T19:52:01.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(122 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a2220 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(123 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:124 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a5fd0 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(124 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:125 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027740f0 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(125 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.445+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:126 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a2220 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(126 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:127 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a2220 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(127 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:128 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a2220 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(128 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:129 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282de40 con 0x5608027740f0 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(129 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:130 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a5fd0 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(130 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:131 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a5fd0 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(131 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.449+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:132 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027a2220 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.453+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(132 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.453+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:133 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282d950 con 0x5608027740f0 2023-10-05T19:52:01.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.453+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(133 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.463 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:01.463 INFO:teuthology.orchestra.run.smithi167.stdout: "entries": [ 2023-10-05T19:52:01.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.463 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "anonymous", 2023-10-05T19:52:01.463 INFO:teuthology.orchestra.run.smithi167.stdout: "buckets": [ 2023-10-05T19:52:01.463 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.463 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:52:01.463 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "anonymous", 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_buckets", 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 231, 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.464 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: "buckets": [ 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.465 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_buckets", 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 322, 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.466 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 5, 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 5 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 217, 2023-10-05T19:52:01.467 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_obj", 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "get_acls", 2023-10-05T19:52:01.468 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 1026, 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 2 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "get_obj", 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 4, 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.469 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_bucket", 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 515, 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_acls", 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 2 2023-10-05T19:52:01.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_obj", 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 30000042, 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 11, 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 11 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.471 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.473 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.559 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.559 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.559 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.562 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: "summary": [ 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "anonymous", 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_buckets", 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 231, 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.563 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: "total": { 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 231, 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.564 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 8, 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 8 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 217, 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 5, 2023-10-05T19:52:01.565 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_obj", 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "get_acls", 2023-10-05T19:52:01.566 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 1026, 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 2 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "get_obj", 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 4, 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.567 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.453+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:134 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94592401331232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080282dd60 con 0x5608027a2220 2023-10-05T19:52:01.571 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.457+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(134 notify.0 [watch unwatch cookie 94592401331232] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.457+0000 7f5643212e40 20 remove_watcher() i=0 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.457+0000 7f5643212e40 2 removed watcher, disabling cache 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.457+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:135 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94592401338016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ad420 con 0x5608027740f0 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.457+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(135 notify.1 [watch unwatch cookie 94592401338016] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.457+0000 7f5643212e40 20 remove_watcher() i=1 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.457+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:136 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94592401339360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ad420 con 0x5608027a2220 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.461+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(136 notify.2 [watch unwatch cookie 94592401339360] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.461+0000 7f5643212e40 20 remove_watcher() i=2 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.461+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94592401341936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ad420 con 0x7f563001a070 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.461+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(137 notify.3 [watch unwatch cookie 94592401341936] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.461+0000 7f5643212e40 20 remove_watcher() i=3 2023-10-05T19:52:01.572 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.461+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:138 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94592401343040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027afdf0 con 0x5608027a2220 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.465+0000 7f5640d47700 1 -- 172.21.15.167:0/353059656 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(138 notify.4 [watch unwatch cookie 94592401343040] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5630016070 con 0x5608027a2220 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.465+0000 7f5643212e40 20 remove_watcher() i=4 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.465+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94592401347488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ad420 con 0x5608027a5fd0 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.469+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== osd_op_reply(139 notify.5 [watch unwatch cookie 94592401347488] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.469+0000 7f5643212e40 20 remove_watcher() i=5 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.469+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94592401344768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027b13a0 con 0x5608027a5fd0 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.469+0000 7f5640546700 1 -- 172.21.15.167:0/353059656 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== osd_op_reply(140 notify.6 [watch unwatch cookie 94592401344768] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5638042070 con 0x5608027a5fd0 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.469+0000 7f5643212e40 20 remove_watcher() i=6 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.469+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94592401352928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5608027ad420 con 0x7f563001a070 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.473+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(141 notify.7 [watch unwatch cookie 94592401352928] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5628033040 con 0x7f563001a070 2023-10-05T19:52:01.573 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.473+0000 7f5643212e40 20 remove_watcher() i=7 2023-10-05T19:52:01.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.473+0000 7f56117f2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:01.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.473+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:142 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94592401357408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56080279e290 con 0x5608027740f0 2023-10-05T19:52:01.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(142 data_loggenerations_metadata [watch unwatch cookie 94592401357408] v32'219 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5628033040 con 0x5608027740f0 2023-10-05T19:52:01.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5608027a2220 msgr2=0x5608027a5460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5608027a2220 0x5608027a5460 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.574 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5608027740f0 msgr2=0x5608027a13e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5608027740f0 0x5608027a13e0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f563001a070 msgr2=0x7f5630042210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f563001a070 0x7f5630042210 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5608027a5fd0 msgr2=0x5608027aa230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5608027a5fd0 0x5608027aa230 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5624030c00 msgr2=0x7f56240330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5624030c00 0x7f56240330b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5638000f80 tx=0x7f5638013000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 msgr2=0x560802795940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5641548700 1 -- 172.21.15.167:0/353059656 reap_dead start 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x560802795940 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f56300018e0 tx=0x7f5630016000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 shutdown_connections 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/353059656 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56080276fb20 0x560802795940 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 >> 172.21.15.167:0/353059656 conn(0x5608026e3590 msgr2=0x5608027891e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 shutdown_connections 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/353059656 wait complete. 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/2483706710 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5580030c00 msgr2=0x7f55800330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/2483706710 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5580030c00 0x7f55800330b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5608027b3490 tx=0x7f562800e040 comp rx=0 tx=0).stop 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/2483706710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 msgr2=0x5608027c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/2483706710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c6b90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f563800ea70 tx=0x7f563802c000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/2483706710 shutdown_connections 2023-10-05T19:52:01.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/2483706710 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f5580030c00 0x7f55800330b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 --2- 172.21.15.167:0/2483706710 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5608027c1180 0x5608027c6b90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/2483706710 >> 172.21.15.167:0/2483706710 conn(0x5608027bc540 msgr2=0x5608027ba640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/2483706710 shutdown_connections 2023-10-05T19:52:01.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.477+0000 7f5643212e40 1 -- 172.21.15.167:0/2483706710 wait complete. 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_bucket", 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 515, 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_buckets", 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 322, 2023-10-05T19:52:01.578 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_acls", 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 2 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.579 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_obj", 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 30000042, 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 11, 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 11 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: "total": { 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 2084, 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 30000042, 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 35, 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 34 2023-10-05T19:52:01.580 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.581 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.581 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.581 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:01.581 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2084, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2023-10-05T19:52:01.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2023-10-05T19:52:01.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2023-10-05T19:52:01.582 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2023-10-05T19:52:01.659 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:01.659 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:01.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.653+0000 7f2650b9be40 1 Processor -- start 2023-10-05T19:52:01.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.653+0000 7f2650b9be40 1 -- start start 2023-10-05T19:52:01.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.653+0000 7f2650b9be40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559da6d77570 0x559da6d75b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.653+0000 7f2650b9be40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559da6d4ebd0 con 0x559da6d76090 2023-10-05T19:52:01.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.653+0000 7f2650b9be40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x559da6d0bee0 con 0x559da6d77570 2023-10-05T19:52:01.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.653+0000 7f264e6d0700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559da6d77570 0x559da6d75b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.653+0000 7f264decf700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x559da6d76090 0x559da6e09a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50180/0 (socket says 172.21.15.167:50180) 2023-10-05T19:52:01.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.653+0000 7f264decf700 1 -- 172.21.15.167:0/548381655 learned_addr learned my addr 172.21.15.167:0/548381655 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:01.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.653+0000 7f264e6d0700 1 -- 172.21.15.167:0/548381655 >> v1:172.21.15.118:6789/0 conn(0x559da6d76090 legacy=0x559da6e09a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f264d6ce700 1 -- 172.21.15.167:0/548381655 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547815772 0 0) 0x559da6d4ebd0 con 0x559da6d76090 2023-10-05T19:52:01.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f264e6d0700 1 -- 172.21.15.167:0/548381655 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559da6d77a00 con 0x559da6d77570 2023-10-05T19:52:01.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f264e6d0700 1 --2- 172.21.15.167:0/548381655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d77570 0x559da6d75b50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f264800a5d0 tx=0x7f2648005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae076e821bcbc86 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f264d6ce700 1 -- 172.21.15.167:0/548381655 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26480086a0 con 0x559da6d77570 2023-10-05T19:52:01.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f264d6ce700 1 -- 172.21.15.167:0/548381655 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2648008800 con 0x559da6d77570 2023-10-05T19:52:01.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f264d6ce700 1 -- 172.21.15.167:0/548381655 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2648008ad0 con 0x559da6d77570 2023-10-05T19:52:01.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 -- 172.21.15.167:0/548381655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d77570 msgr2=0x559da6d75b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 --2- 172.21.15.167:0/548381655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d77570 0x559da6d75b50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f264800a5d0 tx=0x7f2648005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:01.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 -- 172.21.15.167:0/548381655 shutdown_connections 2023-10-05T19:52:01.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 --2- 172.21.15.167:0/548381655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d77570 0x559da6d75b50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 -- 172.21.15.167:0/548381655 >> 172.21.15.167:0/548381655 conn(0x559da6dfd340 msgr2=0x559da6dff750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 -- 172.21.15.167:0/548381655 shutdown_connections 2023-10-05T19:52:01.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 -- 172.21.15.167:0/548381655 wait complete. 2023-10-05T19:52:01.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 Processor -- start 2023-10-05T19:52:01.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 -- start start 2023-10-05T19:52:01.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e22a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f2650b9be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da6ccfe30 con 0x559da6d76090 2023-10-05T19:52:01.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f264e6d0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e22a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f264e6d0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e22a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46884/0 (socket says 172.21.15.167:46884) 2023-10-05T19:52:01.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.657+0000 7f264e6d0700 1 -- 172.21.15.167:0/1194145505 learned_addr learned my addr 172.21.15.167:0/1194145505 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f264e6d0700 1 -- 172.21.15.167:0/1194145505 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2648005cf0 con 0x559da6d76090 2023-10-05T19:52:01.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f264e6d0700 1 --2- 172.21.15.167:0/1194145505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e22a10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2648005a90 tx=0x7f2648015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6805900dea5480fe server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2647fff700 1 -- 172.21.15.167:0/1194145505 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2648008970 con 0x559da6d76090 2023-10-05T19:52:01.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2647fff700 1 -- 172.21.15.167:0/1194145505 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2648008af0 con 0x559da6d76090 2023-10-05T19:52:01.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2647fff700 1 -- 172.21.15.167:0/1194145505 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2648008de0 con 0x559da6d76090 2023-10-05T19:52:01.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 -- 172.21.15.167:0/1194145505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 msgr2=0x559da6e22a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1194145505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e22a10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2648005a90 tx=0x7f2648015000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 -- 172.21.15.167:0/1194145505 shutdown_connections 2023-10-05T19:52:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1194145505 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e22a10 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 -- 172.21.15.167:0/1194145505 >> 172.21.15.167:0/1194145505 conn(0x559da6dfd340 msgr2=0x559da6e1e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 -- 172.21.15.167:0/1194145505 shutdown_connections 2023-10-05T19:52:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 -- 172.21.15.167:0/1194145505 wait complete. 2023-10-05T19:52:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 Processor -- start 2023-10-05T19:52:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 -- start start 2023-10-05T19:52:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e29620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f2650b9be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da6ca2ed0 con 0x559da6d76090 2023-10-05T19:52:01.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f264e6d0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e29620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f264e6d0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e29620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46892/0 (socket says 172.21.15.167:46892) 2023-10-05T19:52:01.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 learned_addr learned my addr 172.21.15.167:0/1688909349 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559da6d77a00 con 0x559da6d76090 2023-10-05T19:52:01.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.661+0000 7f264e6d0700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e29620 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f264801e040 tx=0x7f2648003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f26467fc700 1 -- 172.21.15.167:0/1688909349 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f264801c410 con 0x559da6d76090 2023-10-05T19:52:01.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f26467fc700 1 -- 172.21.15.167:0/1688909349 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264801c570 con 0x559da6d76090 2023-10-05T19:52:01.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559da6e29b60 con 0x559da6d76090 2023-10-05T19:52:01.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f26467fc700 1 -- 172.21.15.167:0/1688909349 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f264801c840 con 0x559da6d76090 2023-10-05T19:52:01.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559da6e29f40 con 0x559da6d76090 2023-10-05T19:52:01.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f26467fc700 1 -- 172.21.15.167:0/1688909349 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2648019070 con 0x559da6d76090 2023-10-05T19:52:01.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f26467fc700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2630030c50 0x7f2630033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f26467fc700 1 -- 172.21.15.167:0/1688909349 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f2648031770 con 0x559da6d76090 2023-10-05T19:52:01.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f264decf700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2630030c50 0x7f2630033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559da6d77570 0x559da6e350b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e35760 con 0x559da6d77570 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f264eed1700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559da6d77570 0x559da6e350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.665+0000 7f264decf700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2630030c50 0x7f2630033100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f26380011e0 tx=0x7f26380013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f264eed1700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559da6d77570 0x559da6e350b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 20 realm 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e32710 con 0x559da6d77570 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e36240 con 0x559da6d77570 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559da6e35e70 0x559da6e390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e397e0 con 0x559da6e35e70 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f264e6d0700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559da6e35e70 0x559da6e390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f264e6d0700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559da6e35e70 0x559da6e390b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3a0b0 con 0x559da6d77570 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.669+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f2650b9be40 20 searching for the correct realm 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559da6e39c20 0x559da6e3de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e39c20 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264decf700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559da6e39c20 0x559da6e3de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264decf700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559da6e39c20 0x559da6e3de80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638006070 con 0x559da6e39c20 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e35e70 2023-10-05T19:52:01.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264e6d0700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2648039030 0x7f2648011a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x7f2648039030 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264eed1700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2648039030 0x7f2648011a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264eed1700 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2648039030 0x7f2648011a30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.673+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e39c20 2023-10-05T19:52:01.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638006070 con 0x559da6e39c20 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e35e70 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e35e70 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.677+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x7f2648039030 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x7f2648039030 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e35e70 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e39c20 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638006070 con 0x559da6e39c20 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e35e70 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.681+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e39c20 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638006070 con 0x559da6e39c20 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e39c20 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638006070 con 0x559da6e39c20 2023-10-05T19:52:01.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x7f2648039030 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6d77570 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.685+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x7f2648039030 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e39c20 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638006070 con 0x559da6e39c20 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x7f2648039030 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e35e70 2023-10-05T19:52:01.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e35e70 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e39c20 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638006070 con 0x559da6e39c20 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.689+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e35e70 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3e460 con 0x559da6e35e70 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:01.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3ac20 con 0x559da6d77570 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3b5a0 con 0x559da6e35e70 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3a810 con 0x559da6e35e70 2023-10-05T19:52:01.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3ee10 con 0x559da6e39c20 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2638006070 con 0x559da6e39c20 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.693+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3f1c0 con 0x559da6d77570 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.742 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3f570 con 0x559da6e35e70 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6e39c20 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6e35e70 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x7f2648039030 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.697+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6d77570 2023-10-05T19:52:01.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6d77570 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6e39c20 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6d77570 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6e35e70 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6e35e70 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6d77570 2023-10-05T19:52:01.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.701+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x7f2648039030 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6d77570 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x7f2648039030 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6e35e70 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40930 con 0x559da6e39c20 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.745 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6d77570 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.705+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6e35e70 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6e39c20 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6d77570 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6d77570 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6d77570 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6e39c20 2023-10-05T19:52:01.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x7f2648039030 2023-10-05T19:52:01.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.709+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6d77570 2023-10-05T19:52:01.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.747 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x7f2648039030 2023-10-05T19:52:01.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6e39c20 2023-10-05T19:52:01.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x7f2648039030 2023-10-05T19:52:01.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6e35e70 2023-10-05T19:52:01.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6e35e70 2023-10-05T19:52:01.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6e39c20 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.713+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6e35e70 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2638028040 con 0x559da6e35e70 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:01.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3f920 con 0x559da6e35e70 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3fd00 con 0x559da6d77570 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.717+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3ea40 con 0x559da6e35e70 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e3ea10 con 0x559da6e35e70 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40ce0 con 0x7f2648039030 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 zone default found 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 4 Realm: () 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:01.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 zonegroup default 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40ce0 con 0x7f2648039030 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e42660 con 0x559da6e39c20 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e42a10 con 0x559da6e39c20 2023-10-05T19:52:01.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 started sync module instance, tier type = 2023-10-05T19:52:01.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:01.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.721+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e41d20 con 0x559da6e35e70 2023-10-05T19:52:01.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.725+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.725+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94135598186816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e41d20 con 0x559da6e35e70 2023-10-05T19:52:01.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.725+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e432b0 con 0x559da6d77570 2023-10-05T19:52:01.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.729+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.729+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94135598186816] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.729+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94135598198208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e43210 con 0x559da6d77570 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.729+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e43ba0 con 0x559da6e35e70 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.729+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94135598198208] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.729+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.729+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94135598200496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e421d0 con 0x559da6e35e70 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.729+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e444e0 con 0x7f2648039030 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.733+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94135598200496] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.733+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.733+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94135598201600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e44440 con 0x7f2648039030 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.733+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e44ce0 con 0x559da6e35e70 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.737+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94135598201600] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.737+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.737+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94135598203264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e44ac0 con 0x559da6e35e70 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.737+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e45740 con 0x559da6e39c20 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.737+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94135598203264] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.737+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.737+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94135598204368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e44a20 con 0x559da6e39c20 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.737+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e464d0 con 0x559da6e39c20 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94135598204368] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94135598210336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e46d70 con 0x559da6e39c20 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e47610 con 0x7f2648039030 2023-10-05T19:52:01.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94135598210336] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94135598213808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e473f0 con 0x7f2648039030 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 20 add_watcher() i=0 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 20 add_watcher() i=1 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 20 add_watcher() i=2 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 20 add_watcher() i=3 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 20 add_watcher() i=4 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 20 add_watcher() i=5 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 20 add_watcher() i=6 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94135598213808] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 20 add_watcher() i=7 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.741+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e4a860 con 0x559da6d77570 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94135598215376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e47d20 con 0x559da6d77570 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94135598215376] v32'220 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f261ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f2650b9be40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f2650b9be40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f2650b9be40 1 Processor -- start 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f2650b9be40 1 -- start start 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f2650b9be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e54fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f2650b9be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da6e55500 con 0x559da6e54bf0 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f264decf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e54fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f264decf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e54fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46908/0 (socket says 172.21.15.167:46908) 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.745+0000 7f264decf700 1 -- 172.21.15.167:0/1020632377 learned_addr learned my addr 172.21.15.167:0/1020632377 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f264decf700 1 -- 172.21.15.167:0/1020632377 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559da6e55640 con 0x559da6e54bf0 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f264decf700 1 --2- 172.21.15.167:0/1020632377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e54fc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x559da6e3b290 tx=0x7f2638010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98216cdb9460318a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f261f7de700 1 -- 172.21.15.167:0/1020632377 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f263803b070 con 0x559da6e54bf0 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f261f7de700 1 -- 172.21.15.167:0/1020632377 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2638022040 con 0x559da6e54bf0 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f261f7de700 1 -- 172.21.15.167:0/1020632377 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2638021040 con 0x559da6e54bf0 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 -- 172.21.15.167:0/1020632377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 msgr2=0x559da6e54fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1020632377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e54fc0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x559da6e3b290 tx=0x7f2638010000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 -- 172.21.15.167:0/1020632377 shutdown_connections 2023-10-05T19:52:01.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1020632377 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e54fc0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 -- 172.21.15.167:0/1020632377 >> 172.21.15.167:0/1020632377 conn(0x559da6e4ffb0 msgr2=0x559da6e4e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 -- 172.21.15.167:0/1020632377 shutdown_connections 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 -- 172.21.15.167:0/1020632377 wait complete. 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 Processor -- start 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 -- start start 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e5a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f2650b9be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da6e5b660 con 0x559da6e54bf0 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f264decf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e5a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f264decf700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e5a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46914/0 (socket says 172.21.15.167:46914) 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.749+0000 7f264decf700 1 -- 172.21.15.167:0/3338385692 learned_addr learned my addr 172.21.15.167:0/3338385692 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f264decf700 1 -- 172.21.15.167:0/3338385692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263800ead0 con 0x559da6e54bf0 2023-10-05T19:52:01.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f264decf700 1 --2- 172.21.15.167:0/3338385692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e5a660 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x559da6e3a760 tx=0x7f2638037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f261dfdb700 1 -- 172.21.15.167:0/3338385692 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2638021070 con 0x559da6e54bf0 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f261dfdb700 1 -- 172.21.15.167:0/3338385692 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2638036e70 con 0x559da6e54bf0 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f2650b9be40 1 -- 172.21.15.167:0/3338385692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559da6e5ac60 con 0x559da6e54bf0 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f261dfdb700 1 -- 172.21.15.167:0/3338385692 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2638046070 con 0x559da6e54bf0 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f2650b9be40 1 -- 172.21.15.167:0/3338385692 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559da6e5b100 con 0x559da6e54bf0 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f261dfdb700 1 -- 172.21.15.167:0/3338385692 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f263803e020 con 0x559da6e54bf0 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f261dfdb700 1 --2- 172.21.15.167:0/3338385692 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594030bb0 0x7f2594033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f261dfdb700 1 -- 172.21.15.167:0/3338385692 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f263802e040 con 0x559da6e54bf0 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f264eed1700 1 --2- 172.21.15.167:0/3338385692 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594030bb0 0x7f2594033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f2650b9be40 5 note: GC not initialized 2023-10-05T19:52:01.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.753+0000 7f264eed1700 1 --2- 172.21.15.167:0/3338385692 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594030bb0 0x7f2594033060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x559da6e476d0 tx=0x7f264000ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f258cff9700 20 reqs_thread_entry: start 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f258effd700 20 reqs_thread_entry: start 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2586ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:31 2023 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f25867fc700 20 reqs_thread_entry: start 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 20 get_system_obj_state: rctx=0x7ffcbc675b28 obj=default.rgw.meta:users.uid:foo state=0x559da6cdb0b0 s->prefetch_data=0 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6ec2f50 con 0x559da6d77570 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:01.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:01.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6ec59e0 con 0x559da6d77570 2023-10-05T19:52:01.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:52:01.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.757+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6ec49d0 con 0x559da6e39c20 2023-10-05T19:52:01.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.761+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.784 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: "entries": [ 2023-10-05T19:52:01.784 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "buckets": [ 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_buckets", 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 322, 2023-10-05T19:52:01.785 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.786 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 5, 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 5 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 217, 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.787 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_obj", 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "get_acls", 2023-10-05T19:52:01.788 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 1026, 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 2 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "get_obj", 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 4, 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.789 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_bucket", 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 515, 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_acls", 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.790 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 2 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_obj", 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 30000042, 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 11, 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 11 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.791 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.792 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.793 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.761+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94135598186816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6ec2300 con 0x559da6e35e70 2023-10-05T19:52:01.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.765+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94135598186816] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.765+0000 7f2650b9be40 20 remove_watcher() i=0 2023-10-05T19:52:01.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.765+0000 7f2650b9be40 2 removed watcher, disabling cache 2023-10-05T19:52:01.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.765+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94135598198208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40140 con 0x559da6d77570 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.765+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94135598198208] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.765+0000 7f2650b9be40 20 remove_watcher() i=1 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.765+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94135598200496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e40140 con 0x559da6e35e70 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.769+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94135598200496] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.769+0000 7f2650b9be40 20 remove_watcher() i=2 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.769+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94135598201600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e436b0 con 0x7f2648039030 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.769+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94135598201600] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.769+0000 7f2650b9be40 20 remove_watcher() i=3 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.769+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94135598203264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e43ba0 con 0x559da6e35e70 2023-10-05T19:52:01.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.773+0000 7f264e6d0700 1 -- 172.21.15.167:0/1688909349 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94135598203264] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2648036070 con 0x559da6e35e70 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.773+0000 7f2650b9be40 20 remove_watcher() i=4 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.773+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94135598204368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e43ba0 con 0x559da6e39c20 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.773+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94135598204368] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.773+0000 7f2650b9be40 20 remove_watcher() i=5 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.773+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94135598210336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e43ba0 con 0x559da6e39c20 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.777+0000 7f264decf700 1 -- 172.21.15.167:0/1688909349 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94135598210336] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2638024040 con 0x559da6e39c20 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.777+0000 7f2650b9be40 20 remove_watcher() i=6 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.777+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94135598213808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e43ba0 con 0x7f2648039030 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.777+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94135598213808] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x7f2648039030 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.777+0000 7f2650b9be40 20 remove_watcher() i=7 2023-10-05T19:52:01.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.777+0000 7f261ffdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.777+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94135598215376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559da6e43ba0 con 0x559da6d77570 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94135598215376] v32'221 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f264000a5a0 con 0x559da6d77570 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559da6e35e70 msgr2=0x559da6e390b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559da6e35e70 0x559da6e390b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559da6d77570 msgr2=0x559da6e350b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559da6d77570 0x559da6e350b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2648039030 msgr2=0x7f2648011a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f2648039030 0x7f2648011a30 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559da6e39c20 msgr2=0x559da6e3de80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559da6e39c20 0x559da6e3de80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2630030c50 msgr2=0x7f2630033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2630030c50 0x7f2630033100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f26380011e0 tx=0x7f26380013a0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f264eed1700 1 -- 172.21.15.167:0/1688909349 reap_dead start 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 msgr2=0x559da6e29620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e29620 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f264801e040 tx=0x7f2648003050 comp rx=0 tx=0).stop 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 shutdown_connections 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/1688909349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6d76090 0x559da6e29620 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 >> 172.21.15.167:0/1688909349 conn(0x559da6dfd340 msgr2=0x559da6e1d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 shutdown_connections 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/1688909349 wait complete. 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/3338385692 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594030bb0 msgr2=0x7f2594033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/3338385692 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594030bb0 0x7f2594033060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x559da6e476d0 tx=0x7f264000ae50 comp rx=0 tx=0).stop 2023-10-05T19:52:01.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/3338385692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 msgr2=0x559da6e5a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/3338385692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e5a660 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x559da6e3a760 tx=0x7f2638037000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/3338385692 shutdown_connections 2023-10-05T19:52:01.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/3338385692 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f2594030bb0 0x7f2594033060 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 --2- 172.21.15.167:0/3338385692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559da6e54bf0 0x559da6e5a660 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/3338385692 >> 172.21.15.167:0/3338385692 conn(0x559da6e4ffb0 msgr2=0x559da6e4e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/3338385692 shutdown_connections 2023-10-05T19:52:01.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.781+0000 7f2650b9be40 1 -- 172.21.15.167:0/3338385692 wait complete. 2023-10-05T19:52:01.869 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:52:01.869 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.869 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.869 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.869 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.870 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.871 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.872 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: "summary": [ 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.873 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 8, 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 8 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 217, 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 5, 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:01.874 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_obj", 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "get_acls", 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 1026, 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.875 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 2 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "get_obj", 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 4, 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_bucket", 2023-10-05T19:52:01.876 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 515, 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "list_buckets", 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 322, 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.877 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_acls", 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 2 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_obj", 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 30000042, 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 11, 2023-10-05T19:52:01.878 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 11 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: "total": { 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 2084, 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 30000042, 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 35, 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 34 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:01.879 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:01.880 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2084, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2023-10-05T19:52:01.880 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2023-10-05T19:52:01.880 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2023-10-05T19:52:01.880 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2023-10-05T19:52:01.923 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:01.923 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:01.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.917+0000 7ff164558e40 1 Processor -- start 2023-10-05T19:52:01.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.917+0000 7ff164558e40 1 -- start start 2023-10-05T19:52:01.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.917+0000 7ff164558e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x564a8c137580 0x564a8c135b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.917+0000 7ff164558e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564a8c10ebd0 con 0x564a8c1360a0 2023-10-05T19:52:01.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.917+0000 7ff164558e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x564a8c0cbee0 con 0x564a8c137580 2023-10-05T19:52:01.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16208d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x564a8c137580 0x564a8c135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16208d700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x564a8c137580 0x564a8c135b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46916/0 (socket says 172.21.15.167:46916) 2023-10-05T19:52:01.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16208d700 1 -- 172.21.15.167:0/463930631 learned_addr learned my addr 172.21.15.167:0/463930631 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16188c700 1 --1- 172.21.15.167:0/463930631 >> v1:172.21.15.118:6789/0 conn(0x564a8c1360a0 0x564a8c1ce240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50184/0 (socket says 172.21.15.167:50184) 2023-10-05T19:52:01.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16208d700 1 -- 172.21.15.167:0/463930631 >> v1:172.21.15.118:6789/0 conn(0x564a8c1360a0 legacy=0x564a8c1ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16208d700 1 -- 172.21.15.167:0/463930631 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a8c137a10 con 0x564a8c137580 2023-10-05T19:52:01.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16208d700 1 --2- 172.21.15.167:0/463930631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c137580 0x564a8c135b60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff15400a650 tx=0x7ff154005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeea9307190dd5a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16108b700 1 -- 172.21.15.167:0/463930631 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff154008760 con 0x564a8c137580 2023-10-05T19:52:01.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16108b700 1 -- 172.21.15.167:0/463930631 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1540088c0 con 0x564a8c137580 2023-10-05T19:52:01.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff16108b700 1 -- 172.21.15.167:0/463930631 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff154008bb0 con 0x564a8c137580 2023-10-05T19:52:01.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 -- 172.21.15.167:0/463930631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c137580 msgr2=0x564a8c135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 --2- 172.21.15.167:0/463930631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c137580 0x564a8c135b60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff15400a650 tx=0x7ff154005b10 comp rx=0 tx=0).stop 2023-10-05T19:52:01.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 -- 172.21.15.167:0/463930631 shutdown_connections 2023-10-05T19:52:01.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 --2- 172.21.15.167:0/463930631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c137580 0x564a8c135b60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 -- 172.21.15.167:0/463930631 >> 172.21.15.167:0/463930631 conn(0x564a8c1bd350 msgr2=0x564a8c1bf760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 -- 172.21.15.167:0/463930631 shutdown_connections 2023-10-05T19:52:01.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 -- 172.21.15.167:0/463930631 wait complete. 2023-10-05T19:52:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 Processor -- start 2023-10-05T19:52:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 -- start start 2023-10-05T19:52:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1e7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.921+0000 7ff164558e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c08fe30 con 0x564a8c1360a0 2023-10-05T19:52:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff16208d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1e7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff16208d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1e7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46930/0 (socket says 172.21.15.167:46930) 2023-10-05T19:52:01.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff16208d700 1 -- 172.21.15.167:0/814472136 learned_addr learned my addr 172.21.15.167:0/814472136 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff16208d700 1 -- 172.21.15.167:0/814472136 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154005db0 con 0x564a8c1360a0 2023-10-05T19:52:01.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff16208d700 1 --2- 172.21.15.167:0/814472136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1e7030 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff154005b50 tx=0x7ff154015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f508ecb2e5b7d239 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff15bfff700 1 -- 172.21.15.167:0/814472136 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1540055f0 con 0x564a8c1360a0 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff15bfff700 1 -- 172.21.15.167:0/814472136 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154008a30 con 0x564a8c1360a0 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff15bfff700 1 -- 172.21.15.167:0/814472136 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff154008d00 con 0x564a8c1360a0 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 -- 172.21.15.167:0/814472136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 msgr2=0x564a8c1e7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 --2- 172.21.15.167:0/814472136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1e7030 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff154005b50 tx=0x7ff154015000 comp rx=0 tx=0).stop 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 -- 172.21.15.167:0/814472136 shutdown_connections 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 --2- 172.21.15.167:0/814472136 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1e7030 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 -- 172.21.15.167:0/814472136 >> 172.21.15.167:0/814472136 conn(0x564a8c1bd350 msgr2=0x564a8c1e2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 -- 172.21.15.167:0/814472136 shutdown_connections 2023-10-05T19:52:01.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 -- 172.21.15.167:0/814472136 wait complete. 2023-10-05T19:52:01.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 Processor -- start 2023-10-05T19:52:01.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 -- start start 2023-10-05T19:52:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff164558e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c062ed0 con 0x564a8c1360a0 2023-10-05T19:52:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff16208d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff16208d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1edc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46938/0 (socket says 172.21.15.167:46938) 2023-10-05T19:52:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.925+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 learned_addr learned my addr 172.21.15.167:0/2496841466 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:01.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a8c137a10 con 0x564a8c1360a0 2023-10-05T19:52:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff16208d700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1edc40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff15400a650 tx=0x7ff15401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff15a7fc700 1 -- 172.21.15.167:0/2496841466 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1540055b0 con 0x564a8c1360a0 2023-10-05T19:52:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff15a7fc700 1 -- 172.21.15.167:0/2496841466 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1540269b0 con 0x564a8c1360a0 2023-10-05T19:52:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a8c1ee180 con 0x564a8c1360a0 2023-10-05T19:52:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff15a7fc700 1 -- 172.21.15.167:0/2496841466 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff154026ca0 con 0x564a8c1360a0 2023-10-05T19:52:01.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a8c1ee620 con 0x564a8c1360a0 2023-10-05T19:52:01.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff15a7fc700 1 -- 172.21.15.167:0/2496841466 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff15402e030 con 0x564a8c1360a0 2023-10-05T19:52:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff15a7fc700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff144030c50 0x7ff144033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff15a7fc700 1 -- 172.21.15.167:0/2496841466 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7ff15403bce0 con 0x564a8c1360a0 2023-10-05T19:52:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff16188c700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff144030c50 0x7ff144033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564a8c137580 0x564a8c1f9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.929+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c1f9d70 con 0x564a8c137580 2023-10-05T19:52:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff16288e700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564a8c137580 0x564a8c1f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff16188c700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff144030c50 0x7ff144033100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00b300 tx=0x7ff14c001470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff16288e700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564a8c137580 0x564a8c1f9700 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 20 realm 2023-10-05T19:52:01.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c1f6d60 con 0x564a8c137580 2023-10-05T19:52:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c1fa850 con 0x564a8c137580 2023-10-05T19:52:01.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564a8c1fa480 0x564a8c1fd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c1fddf0 con 0x564a8c1fa480 2023-10-05T19:52:01.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff16208d700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564a8c1fa480 0x564a8c1fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.933+0000 7ff16208d700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564a8c1fa480 0x564a8c1fd6c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:01.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:01.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:01.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c1fe6c0 con 0x564a8c137580 2023-10-05T19:52:01.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:01.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff164558e40 20 searching for the correct realm 2023-10-05T19:52:01.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564a8c1fe230 0x564a8c202490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fe230 2023-10-05T19:52:01.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff16188c700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564a8c1fe230 0x564a8c202490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff16188c700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564a8c1fe230 0x564a8c202490 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:01.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fa480 2023-10-05T19:52:01.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:01.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff16208d700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff154007030 0x7ff15401e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:01.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.937+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x7ff154007030 2023-10-05T19:52:01.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff154007030 0x7ff15401e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:01.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff154007030 0x7ff15401e3b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:01.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:01.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fe230 2023-10-05T19:52:01.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:01.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.941+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fa480 2023-10-05T19:52:01.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:01.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fa480 2023-10-05T19:52:01.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:01.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x7ff154007030 2023-10-05T19:52:01.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:01.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x7ff154007030 2023-10-05T19:52:01.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:01.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fa480 2023-10-05T19:52:01.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:01.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.945+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fe230 2023-10-05T19:52:01.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:01.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fa480 2023-10-05T19:52:01.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:01.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fe230 2023-10-05T19:52:01.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:01.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.949+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fe230 2023-10-05T19:52:01.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:01.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x7ff154007030 2023-10-05T19:52:01.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:01.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c137580 2023-10-05T19:52:01.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:01.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x7ff154007030 2023-10-05T19:52:01.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:01.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fe230 2023-10-05T19:52:01.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:01.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x7ff154007030 2023-10-05T19:52:01.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:01.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.953+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fa480 2023-10-05T19:52:01.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:01.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fa480 2023-10-05T19:52:01.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:01.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fe230 2023-10-05T19:52:01.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:01.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fa480 2023-10-05T19:52:01.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:01.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c202a70 con 0x564a8c1fa480 2023-10-05T19:52:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff164558e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff164558e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff164558e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff164558e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c1ff230 con 0x564a8c137580 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.957+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c1ff6c0 con 0x564a8c1fa480 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c1ffaf0 con 0x564a8c1fa480 2023-10-05T19:52:02.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c2033d0 con 0x564a8c1fe230 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c203780 con 0x564a8c137580 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c203b30 con 0x564a8c1fa480 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.961+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fe230 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fa480 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x7ff154007030 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fe230 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.965+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fa480 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fa480 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x7ff154007030 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.969+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x7ff154007030 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fa480 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fe230 2023-10-05T19:52:02.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fa480 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fe230 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.973+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fe230 2023-10-05T19:52:02.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x7ff154007030 2023-10-05T19:52:02.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c137580 2023-10-05T19:52:02.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.977+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x7ff154007030 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fe230 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x7ff154007030 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fa480 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fa480 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fe230 2023-10-05T19:52:02.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.981+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fa480 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204ef0 con 0x564a8c1fa480 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c203ee0 con 0x564a8c1fa480 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c203ee0 con 0x564a8c137580 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c203000 con 0x564a8c1fa480 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.985+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204890 con 0x564a8c1fa480 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204890 con 0x7ff154007030 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 zone default found 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 4 Realm: () 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:02.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 zonegroup default 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204890 con 0x7ff154007030 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204890 con 0x564a8c1fe230 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c206c20 con 0x564a8c1fe230 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 started sync module instance, tier type = 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.989+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c2062e0 con 0x564a8c1fa480 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.993+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.993+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94878178493216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c2062e0 con 0x564a8c1fa480 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.993+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c2074c0 con 0x564a8c137580 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.997+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.997+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94878178493216] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.997+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94878178502368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c2074c0 con 0x564a8c137580 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.997+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c207d60 con 0x564a8c1fa480 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.997+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94878178502368] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.997+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.997+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94878178504656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c207910 con 0x564a8c1fa480 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:01.997+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c208470 con 0x7ff154007030 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.001+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.001+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94878178508608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c208390 con 0x7ff154007030 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.001+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c2093c0 con 0x564a8c1fa480 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.001+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94878178504656] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.001+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94878178508608] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.001+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.001+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94878178510960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c208ed0 con 0x564a8c1fa480 2023-10-05T19:52:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.001+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c209770 con 0x564a8c1fe230 2023-10-05T19:52:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.005+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.005+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94878178513152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c20a060 con 0x564a8c1fe230 2023-10-05T19:52:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.005+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c20aa70 con 0x564a8c1fe230 2023-10-05T19:52:02.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.005+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94878178510960] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.005+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94878178513152] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.005+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.005+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94878178518400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c20ae70 con 0x564a8c1fe230 2023-10-05T19:52:02.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.005+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c20b710 con 0x7ff154007030 2023-10-05T19:52:02.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94878178518400] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94878178521248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c20b4f0 con 0x7ff154007030 2023-10-05T19:52:02.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 20 add_watcher() i=0 2023-10-05T19:52:02.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 20 add_watcher() i=1 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 20 add_watcher() i=2 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 20 add_watcher() i=3 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 20 add_watcher() i=4 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 20 add_watcher() i=5 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 20 add_watcher() i=6 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94878178521248] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 20 add_watcher() i=7 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c20ea40 con 0x564a8c137580 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.009+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94878178505760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c20bf00 con 0x564a8c137580 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94878178505760] v32'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff133fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff164558e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff164558e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff164558e40 1 Processor -- start 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff164558e40 1 -- start start 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff164558e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c219210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff164558e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c219750 con 0x564a8c218e40 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff16188c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c219210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff16188c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c219210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46950/0 (socket says 172.21.15.167:46950) 2023-10-05T19:52:02.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff16188c700 1 -- 172.21.15.167:0/257769202 learned_addr learned my addr 172.21.15.167:0/257769202 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff16188c700 1 -- 172.21.15.167:0/257769202 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a8c219890 con 0x564a8c218e40 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff16188c700 1 --2- 172.21.15.167:0/257769202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c219210 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff14c000fd0 tx=0x7ff14c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effaaf40262830cb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff1337de700 1 -- 172.21.15.167:0/257769202 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff14c00f9f0 con 0x564a8c218e40 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff1337de700 1 -- 172.21.15.167:0/257769202 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c024040 con 0x564a8c218e40 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.013+0000 7ff1337de700 1 -- 172.21.15.167:0/257769202 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff14c02e7c0 con 0x564a8c218e40 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 -- 172.21.15.167:0/257769202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 msgr2=0x564a8c219210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 --2- 172.21.15.167:0/257769202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c219210 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff14c000fd0 tx=0x7ff14c006000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 -- 172.21.15.167:0/257769202 shutdown_connections 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 --2- 172.21.15.167:0/257769202 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c219210 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 -- 172.21.15.167:0/257769202 >> 172.21.15.167:0/257769202 conn(0x564a8c214200 msgr2=0x564a8c2123b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 -- 172.21.15.167:0/257769202 shutdown_connections 2023-10-05T19:52:02.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 -- 172.21.15.167:0/257769202 wait complete. 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 Processor -- start 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 -- start start 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c21e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a8c21f9a0 con 0x564a8c218e40 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff16188c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c21e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff16188c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c21e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46956/0 (socket says 172.21.15.167:46956) 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff16188c700 1 -- 172.21.15.167:0/276421326 learned_addr learned my addr 172.21.15.167:0/276421326 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff16188c700 1 -- 172.21.15.167:0/276421326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c006070 con 0x564a8c218e40 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff16188c700 1 --2- 172.21.15.167:0/276421326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c21e9a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff14c000fd0 tx=0x7ff14c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff131fdb700 1 -- 172.21.15.167:0/276421326 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff14c039500 con 0x564a8c218e40 2023-10-05T19:52:02.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff131fdb700 1 -- 172.21.15.167:0/276421326 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c039660 con 0x564a8c218e40 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff131fdb700 1 -- 172.21.15.167:0/276421326 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff14c039810 con 0x564a8c218e40 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 -- 172.21.15.167:0/276421326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a8c21efa0 con 0x564a8c218e40 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.017+0000 7ff164558e40 1 -- 172.21.15.167:0/276421326 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a8c21f3e0 con 0x564a8c218e40 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.021+0000 7ff131fdb700 1 -- 172.21.15.167:0/276421326 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff14c040040 con 0x564a8c218e40 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.021+0000 7ff131fdb700 1 --2- 172.21.15.167:0/276421326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff0a8030c50 0x7ff0a8033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.021+0000 7ff131fdb700 1 -- 172.21.15.167:0/276421326 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7ff14c04dd50 con 0x564a8c218e40 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.021+0000 7ff16288e700 1 --2- 172.21.15.167:0/276421326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff0a8030c50 0x7ff0a8033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.021+0000 7ff164558e40 5 note: GC not initialized 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.021+0000 7ff16288e700 1 --2- 172.21.15.167:0/276421326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff0a8030c50 0x7ff0a8033100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x564a8c20b760 tx=0x7ff15c00ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.021+0000 7ff0a2ffd700 20 reqs_thread_entry: start 2023-10-05T19:52:02.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.021+0000 7ff0a0ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.021+0000 7ff164558e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff096ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:32 2023 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff0967fc700 20 reqs_thread_entry: start 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 20 get_system_obj_state: rctx=0x7fff06645238 obj=default.rgw.meta:users.uid:foo state=0x564a8c09b0b0 s->prefetch_data=0 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c287090 con 0x564a8c137580 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c287080 con 0x564a8c137580 2023-10-05T19:52:02.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c288b10 con 0x564a8c1fe230 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.025+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94878178493216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c245640 con 0x564a8c1fa480 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.029+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94878178493216] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.029+0000 7ff164558e40 20 remove_watcher() i=0 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.029+0000 7ff164558e40 2 removed watcher, disabling cache 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.029+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94878178502368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204320 con 0x564a8c137580 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.029+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94878178502368] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.029+0000 7ff164558e40 20 remove_watcher() i=1 2023-10-05T19:52:02.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.029+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94878178504656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204320 con 0x564a8c1fa480 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.033+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94878178504656] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.033+0000 7ff164558e40 20 remove_watcher() i=2 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.033+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94878178508608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c206fd0 con 0x7ff154007030 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.033+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94878178508608] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.033+0000 7ff164558e40 20 remove_watcher() i=3 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.037+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94878178510960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204320 con 0x564a8c1fa480 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.037+0000 7ff16208d700 1 -- 172.21.15.167:0/2496841466 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94878178510960] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff1540303d0 con 0x564a8c1fa480 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.037+0000 7ff164558e40 20 remove_watcher() i=4 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.037+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94878178513152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c207f40 con 0x564a8c1fe230 2023-10-05T19:52:02.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.041+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94878178513152] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.041+0000 7ff164558e40 20 remove_watcher() i=5 2023-10-05T19:52:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.041+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94878178518400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c206fd0 con 0x564a8c1fe230 2023-10-05T19:52:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.041+0000 7ff16188c700 1 -- 172.21.15.167:0/2496841466 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94878178518400] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff14c00f560 con 0x564a8c1fe230 2023-10-05T19:52:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.041+0000 7ff164558e40 20 remove_watcher() i=6 2023-10-05T19:52:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.041+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94878178521248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c208870 con 0x7ff154007030 2023-10-05T19:52:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.045+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94878178521248] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x7ff154007030 2023-10-05T19:52:02.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.045+0000 7ff164558e40 20 remove_watcher() i=7 2023-10-05T19:52:02.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.045+0000 7ff133fdf700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.045+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94878178505760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a8c204320 con 0x564a8c137580 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94878178505760] v32'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff15c00a5a0 con 0x564a8c137580 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564a8c1fa480 msgr2=0x564a8c1fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x564a8c1fa480 0x564a8c1fd6c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564a8c137580 msgr2=0x564a8c1f9700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x564a8c137580 0x564a8c1f9700 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff154007030 msgr2=0x7ff15401e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff154007030 0x7ff15401e3b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564a8c1fe230 msgr2=0x564a8c202490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x564a8c1fe230 0x564a8c202490 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff144030c50 msgr2=0x7ff144033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff144030c50 0x7ff144033100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00b300 tx=0x7ff14c001470 comp rx=0 tx=0).stop 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff16288e700 1 -- 172.21.15.167:0/2496841466 reap_dead start 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 msgr2=0x564a8c1edc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1edc40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff15400a650 tx=0x7ff15401c000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 shutdown_connections 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/2496841466 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c1360a0 0x564a8c1edc40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 >> 172.21.15.167:0/2496841466 conn(0x564a8c1bd350 msgr2=0x564a8c1e1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 shutdown_connections 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/2496841466 wait complete. 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/276421326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff0a8030c50 msgr2=0x7ff0a8033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/276421326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff0a8030c50 0x7ff0a8033100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x564a8c20b760 tx=0x7ff15c00ae50 comp rx=0 tx=0).stop 2023-10-05T19:52:02.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/276421326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 msgr2=0x564a8c21e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/276421326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c21e9a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff14c000fd0 tx=0x7ff14c037000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/276421326 shutdown_connections 2023-10-05T19:52:02.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/276421326 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff0a8030c50 0x7ff0a8033100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 --2- 172.21.15.167:0/276421326 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x564a8c218e40 0x564a8c21e9a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/276421326 >> 172.21.15.167:0/276421326 conn(0x564a8c214200 msgr2=0x564a8c212300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/276421326 shutdown_connections 2023-10-05T19:52:02.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.049+0000 7ff164558e40 1 -- 172.21.15.167:0/276421326 wait complete. 2023-10-05T19:52:02.080 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: "entries": [ 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: "buckets": [ 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.081 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.082 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 5, 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 5 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.083 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.084 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.085 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:02.086 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: "summary": [ 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.087 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "create_bucket", 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 8, 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 8 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: "total": { 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 8, 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 8 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.088 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.089 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.089 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:02.089 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2023-10-05T19:52:02.089 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2023-10-05T19:52:02.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2023-10-05T19:52:02.089 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2023-10-05T19:52:02.131 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:02.131 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:02.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.125+0000 7ffab2f33e40 1 Processor -- start 2023-10-05T19:52:02.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.125+0000 7ffab2f33e40 1 -- start start 2023-10-05T19:52:02.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.125+0000 7ffab2f33e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x558579601b60 0x558579601f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.125+0000 7ffab2f33e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55857954cbd0 con 0x558579602470 2023-10-05T19:52:02.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.125+0000 7ffab2f33e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x558579509ee0 con 0x558579601b60 2023-10-05T19:52:02.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab0267700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x558579602470 0x558579602f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50196/0 (socket says 172.21.15.167:50196) 2023-10-05T19:52:02.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab0267700 1 -- 172.21.15.167:0/2394446168 learned_addr learned my addr 172.21.15.167:0/2394446168 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:02.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab0a68700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x558579601b60 0x558579601f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffaafa66700 1 -- 172.21.15.167:0/2394446168 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379387625 0 0) 0x55857954cbd0 con 0x558579602470 2023-10-05T19:52:02.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffaafa66700 1 -- 172.21.15.167:0/2394446168 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa90001e10 con 0x558579602470 2023-10-05T19:52:02.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab0a68700 1 -- 172.21.15.167:0/2394446168 >> v1:172.21.15.118:6789/0 conn(0x558579602470 legacy=0x558579602f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab0a68700 1 -- 172.21.15.167:0/2394446168 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558579603610 con 0x558579601b60 2023-10-05T19:52:02.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab0a68700 1 --2- 172.21.15.167:0/2394446168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x558579601f30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800a5d0 tx=0x7ffaa8005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf288acba0ed803 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffaafa66700 1 -- 172.21.15.167:0/2394446168 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaa8007610 con 0x558579601b60 2023-10-05T19:52:02.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffaafa66700 1 -- 172.21.15.167:0/2394446168 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa8007770 con 0x558579601b60 2023-10-05T19:52:02.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffaafa66700 1 -- 172.21.15.167:0/2394446168 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaa8007a40 con 0x558579601b60 2023-10-05T19:52:02.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2394446168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 msgr2=0x558579601f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/2394446168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x558579601f30 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800a5d0 tx=0x7ffaa8005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:02.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2394446168 shutdown_connections 2023-10-05T19:52:02.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/2394446168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x558579601f30 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2394446168 >> 172.21.15.167:0/2394446168 conn(0x5585795755d0 msgr2=0x5585795759d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2394446168 shutdown_connections 2023-10-05T19:52:02.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2394446168 wait complete. 2023-10-05T19:52:02.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 Processor -- start 2023-10-05T19:52:02.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 -- start start 2023-10-05T19:52:02.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x558579620a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.129+0000 7ffab2f33e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585794cde30 con 0x558579601b60 2023-10-05T19:52:02.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab0a68700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x558579620a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab0a68700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x558579620a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46984/0 (socket says 172.21.15.167:46984) 2023-10-05T19:52:02.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab0a68700 1 -- 172.21.15.167:0/4277745239 learned_addr learned my addr 172.21.15.167:0/4277745239 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab0a68700 1 -- 172.21.15.167:0/4277745239 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa8005cf0 con 0x558579601b60 2023-10-05T19:52:02.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab0a68700 1 --2- 172.21.15.167:0/4277745239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x558579620a10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8000c00 tx=0x7ffaa8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f66b07ca0016a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffaaea64700 1 -- 172.21.15.167:0/4277745239 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaa80078e0 con 0x558579601b60 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffaaea64700 1 -- 172.21.15.167:0/4277745239 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa8007a40 con 0x558579601b60 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffaaea64700 1 -- 172.21.15.167:0/4277745239 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaa8007bd0 con 0x558579601b60 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab2f33e40 1 -- 172.21.15.167:0/4277745239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 msgr2=0x558579620a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/4277745239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x558579620a10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8000c00 tx=0x7ffaa8014000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab2f33e40 1 -- 172.21.15.167:0/4277745239 shutdown_connections 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/4277745239 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x558579620a10 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab2f33e40 1 -- 172.21.15.167:0/4277745239 >> 172.21.15.167:0/4277745239 conn(0x5585795755d0 msgr2=0x55857961c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab2f33e40 1 -- 172.21.15.167:0/4277745239 shutdown_connections 2023-10-05T19:52:02.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab2f33e40 1 -- 172.21.15.167:0/4277745239 wait complete. 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab2f33e40 1 Processor -- start 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.133+0000 7ffab2f33e40 1 -- start start 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab2f33e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x5585796276d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab2f33e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585794a0ed0 con 0x558579601b60 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab0a68700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x5585796276d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab0a68700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x5585796276d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:46994/0 (socket says 172.21.15.167:46994) 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 learned_addr learned my addr 172.21.15.167:0/3227685747 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558579603610 con 0x558579601b60 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab0a68700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x5585796276d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ffaa801f040 tx=0x7ffaa801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffaad261700 1 -- 172.21.15.167:0/3227685747 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaa8007e50 con 0x558579601b60 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffaad261700 1 -- 172.21.15.167:0/3227685747 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa8029070 con 0x558579601b60 2023-10-05T19:52:02.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558579627c10 con 0x558579601b60 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffaad261700 1 -- 172.21.15.167:0/3227685747 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffaa8030480 con 0x558579601b60 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558579628050 con 0x558579601b60 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffaad261700 1 -- 172.21.15.167:0/3227685747 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ffaa8012400 con 0x558579601b60 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.137+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffaad261700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffa94030c40 0x7ffa940330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffaad261700 1 -- 172.21.15.167:0/3227685747 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7ffaa802b070 con 0x558579601b60 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab0267700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffa94030c40 0x7ffa940330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558579602470 0x558579633160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796337d0 con 0x558579602470 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab1269700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558579602470 0x558579633160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab0267700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffa94030c40 0x7ffa940330f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffa980044f0 tx=0x7ffa98006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab1269700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558579602470 0x558579633160 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaa000a500 con 0x558579602470 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 20 realm 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796307c0 con 0x558579602470 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaa000a500 con 0x558579602470 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796342b0 con 0x558579602470 2023-10-05T19:52:02.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaa000a500 con 0x558579602470 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558579633ee0 0x558579637120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.141+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579637850 con 0x558579633ee0 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab0a68700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558579633ee0 0x558579637120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab0a68700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558579633ee0 0x558579637120 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579637d30 con 0x558579602470 2023-10-05T19:52:02.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ffaa000a500 con 0x558579602470 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab2f33e40 20 searching for the correct realm 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558579639b80 0x55857963bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579639b80 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab0267700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558579639b80 0x55857963bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab0267700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558579639b80 0x55857963bf60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa98004520 con 0x558579639b80 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.145+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579633ee0 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab0a68700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ffaa8007030 0x7ffaa8000ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x7ffaa8007030 2023-10-05T19:52:02.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ffaa8007030 0x7ffaa8000ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ffaa8007030 0x7ffaa8000ed0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x7ffaa8007030 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579639b80 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa98004520 con 0x558579639b80 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.149+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579633ee0 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579633ee0 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x7ffaa8007030 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x7ffaa8007030 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x7ffaa8007030 2023-10-05T19:52:02.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x7ffaa8007030 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.153+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579633ee0 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579639b80 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa98004520 con 0x558579639b80 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579633ee0 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579639b80 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.157+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579639b80 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x7ffaa8007030 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x7ffaa8007030 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579602470 2023-10-05T19:52:02.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x7ffaa8007030 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x7ffaa8007030 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579639b80 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.161+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x7ffaa8007030 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x7ffaa8007030 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579633ee0 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579633ee0 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579639b80 2023-10-05T19:52:02.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579633ee0 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.165+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c4a0 con 0x558579633ee0 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796388f0 con 0x558579602470 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579639240 con 0x558579633ee0 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579638470 con 0x558579633ee0 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963cdd0 con 0x558579639b80 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.169+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d530 con 0x558579633ee0 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963e8f0 con 0x558579639b80 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963e8f0 con 0x558579633ee0 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963e8f0 con 0x7ffaa8007030 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x7ffaa8007030 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.173+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579639b80 2023-10-05T19:52:02.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579633ee0 2023-10-05T19:52:02.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579633ee0 2023-10-05T19:52:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.177+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x7ffaa8007030 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x7ffaa8007030 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x7ffaa8007030 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x7ffaa8007030 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579633ee0 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579639b80 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.181+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579633ee0 2023-10-05T19:52:02.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579639b80 2023-10-05T19:52:02.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0014040 con 0x558579602470 2023-10-05T19:52:02.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579639b80 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.185+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x7ffaa8007030 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579602470 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x7ffaa8007030 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579639b80 2023-10-05T19:52:02.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x7ffaa8007030 2023-10-05T19:52:02.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579633ee0 2023-10-05T19:52:02.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.189+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579633ee0 2023-10-05T19:52:02.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa801c7f0 con 0x558579633ee0 2023-10-05T19:52:02.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579639b80 2023-10-05T19:52:02.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579633ee0 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d180 con 0x558579633ee0 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab2f33e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab2f33e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab2f33e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab2f33e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d8e0 con 0x558579633ee0 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.193+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963d8e0 con 0x558579602470 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963ca00 con 0x558579633ee0 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963c9d0 con 0x558579633ee0 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963e200 con 0x7ffaa8007030 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 zone default found 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 4 Realm: () 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:02.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 zonegroup default 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.197+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963e200 con 0x7ffaa8007030 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963fb80 con 0x558579639b80 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963ff30 con 0x558579639b80 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 20 started sync module instance, tier type = 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.201+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963f240 con 0x558579633ee0 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.205+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.205+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94031755598992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857963f240 con 0x558579633ee0 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.205+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579640890 con 0x558579602470 2023-10-05T19:52:02.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.205+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.205+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94031755608992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579640ce0 con 0x558579602470 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.205+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796416f0 con 0x558579633ee0 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.205+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94031755598992] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.209+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94031755608992] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.209+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.209+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94031755612672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579640ce0 con 0x558579633ee0 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.209+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579641650 con 0x7ffaa8007030 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.209+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94031755612672] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.209+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.209+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94031755610096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579641650 con 0x7ffaa8007030 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.209+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796424d0 con 0x558579633ee0 2023-10-05T19:52:02.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.213+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94031755610096] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.213+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.213+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94031755614848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796423c0 con 0x558579633ee0 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.213+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579642c60 con 0x558579639b80 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94031755614848] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94031755617776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579643500 con 0x558579639b80 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579643da0 con 0x558579639b80 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94031755617776] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94031755622576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579644150 con 0x558579639b80 2023-10-05T19:52:02.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579644b60 con 0x7ffaa8007030 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94031755626656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579645450 con 0x7ffaa8007030 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 20 add_watcher() i=0 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 20 add_watcher() i=1 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 20 add_watcher() i=2 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 20 add_watcher() i=3 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 20 add_watcher() i=4 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.217+0000 7ffab2f33e40 20 add_watcher() i=5 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94031755622576] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 20 add_watcher() i=6 2023-10-05T19:52:02.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94031755626656] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 20 add_watcher() i=7 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579648480 con 0x558579602470 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94031755628208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796457f0 con 0x558579602470 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94031755628208] v32'224 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffa817f2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 1 Processor -- start 2023-10-05T19:52:02.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 1 -- start start 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x5585796529f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.221+0000 7ffab2f33e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558579652f30 con 0x558579652620 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab0267700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x5585796529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab0267700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x5585796529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47002/0 (socket says 172.21.15.167:47002) 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab0267700 1 -- 172.21.15.167:0/3257763296 learned_addr learned my addr 172.21.15.167:0/3257763296 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab0267700 1 -- 172.21.15.167:0/3257763296 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558579653070 con 0x558579652620 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab0267700 1 --2- 172.21.15.167:0/3257763296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x5585796529f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x558579633e20 tx=0x7ffa98006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551766b812553711 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffa80ff1700 1 -- 172.21.15.167:0/3257763296 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa9801a040 con 0x558579652620 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffa80ff1700 1 -- 172.21.15.167:0/3257763296 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9801b040 con 0x558579652620 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffa80ff1700 1 -- 172.21.15.167:0/3257763296 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa980049b0 con 0x558579652620 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3257763296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 msgr2=0x5585796529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3257763296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x5585796529f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x558579633e20 tx=0x7ffa98006000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3257763296 shutdown_connections 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3257763296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x5585796529f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3257763296 >> 172.21.15.167:0/3257763296 conn(0x55857964d9e0 msgr2=0x55857964bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3257763296 shutdown_connections 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3257763296 wait complete. 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 Processor -- start 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 -- start start 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x558579658190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab2f33e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558579659190 con 0x558579652620 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab0267700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x558579658190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.225+0000 7ffab0267700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x558579658190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47012/0 (socket says 172.21.15.167:47012) 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ffab0267700 1 -- 172.21.15.167:0/2201193379 learned_addr learned my addr 172.21.15.167:0/2201193379 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ffab0267700 1 -- 172.21.15.167:0/2201193379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90001e10 con 0x558579652620 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ffab0267700 1 --2- 172.21.15.167:0/2201193379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x558579658190 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ffa9803a040 tx=0x7ffa98030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ff9faffd700 1 -- 172.21.15.167:0/2201193379 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa9801a070 con 0x558579652620 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ff9faffd700 1 -- 172.21.15.167:0/2201193379 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98004260 con 0x558579652620 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2201193379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558579658790 con 0x558579652620 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ff9faffd700 1 -- 172.21.15.167:0/2201193379 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffa9802c940 con 0x558579652620 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2201193379 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558579658bd0 con 0x558579652620 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ff9faffd700 1 -- 172.21.15.167:0/2201193379 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ffa9802caa0 con 0x558579652620 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ff9faffd700 1 --2- 172.21.15.167:0/2201193379 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff9f0030ca0 0x7ff9f0033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ff9faffd700 1 -- 172.21.15.167:0/2201193379 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7ffa98027040 con 0x558579652620 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ffab1269700 1 --2- 172.21.15.167:0/2201193379 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff9f0030ca0 0x7ff9f0033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ffab2f33e40 5 note: GC not initialized 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.229+0000 7ffab1269700 1 --2- 172.21.15.167:0/2201193379 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff9f0030ca0 0x7ff9f0033150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x558579643350 tx=0x7ffaa000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ff9effff700 20 reqs_thread_entry: start 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ff9edffb700 20 reqs_thread_entry: start 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ffab2f33e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ffab2f33e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ff9dbfff700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:32 2023 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ff9db7fe700 20 reqs_thread_entry: start 2023-10-05T19:52:02.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ffab2f33e40 20 get_system_obj_state: rctx=0x7ffe21f68b88 obj=default.rgw.meta:users.uid:foo state=0x5585794d90b0 s->prefetch_data=0 2023-10-05T19:52:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796c0a00 con 0x558579602470 2023-10-05T19:52:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ffab2f33e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ffab2f33e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ffab2f33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.233+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796c09d0 con 0x558579602470 2023-10-05T19:52:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.237+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.237+0000 7ffab2f33e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:52:02.260 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.237+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796c09d0 con 0x558579639b80 2023-10-05T19:52:02.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.237+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.237+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94031755598992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857967edf0 con 0x558579633ee0 2023-10-05T19:52:02.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.237+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94031755598992] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.241+0000 7ffab2f33e40 20 remove_watcher() i=0 2023-10-05T19:52:02.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.241+0000 7ffab2f33e40 2 removed watcher, disabling cache 2023-10-05T19:52:02.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.241+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94031755608992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796172f0 con 0x558579602470 2023-10-05T19:52:02.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.241+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94031755608992] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.241+0000 7ffab2f33e40 20 remove_watcher() i=1 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.241+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94031755612672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5585796403a0 con 0x558579633ee0 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.245+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94031755612672] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.245+0000 7ffab2f33e40 20 remove_watcher() i=2 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.245+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94031755610096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579641200 con 0x7ffaa8007030 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.245+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94031755610096] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.245+0000 7ffab2f33e40 20 remove_watcher() i=3 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.245+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94031755614848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579640890 con 0x558579633ee0 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.245+0000 7ffab0a68700 1 -- 172.21.15.167:0/3227685747 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94031755614848] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa8062040 con 0x558579633ee0 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.249+0000 7ffab2f33e40 20 remove_watcher() i=4 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.249+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94031755617776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579640890 con 0x558579639b80 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.249+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94031755617776] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.249+0000 7ffab2f33e40 20 remove_watcher() i=5 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.249+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94031755622576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579640890 con 0x558579639b80 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.249+0000 7ffab0267700 1 -- 172.21.15.167:0/3227685747 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94031755622576] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffa9801d040 con 0x558579639b80 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.249+0000 7ffab2f33e40 20 remove_watcher() i=6 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.249+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94031755626656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558579640890 con 0x7ffaa8007030 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.253+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94031755626656] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x7ffaa8007030 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.253+0000 7ffab2f33e40 20 remove_watcher() i=7 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.253+0000 7ffa817f2700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.253+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94031755628208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55857967fda0 con 0x558579602470 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94031755628208] v32'225 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ffaa0033040 con 0x558579602470 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558579633ee0 msgr2=0x558579637120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558579633ee0 0x558579637120 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558579602470 msgr2=0x558579633160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558579602470 0x558579633160 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ffaa8007030 msgr2=0x7ffaa8000ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ffaa8007030 0x7ffaa8000ed0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558579639b80 msgr2=0x55857963bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558579639b80 0x55857963bf60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffa94030c40 msgr2=0x7ffa940330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ffa94030c40 0x7ffa940330f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffa980044f0 tx=0x7ffa98006690 comp rx=0 tx=0).stop 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab1269700 1 -- 172.21.15.167:0/3227685747 reap_dead start 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 msgr2=0x5585796276d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x5585796276d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ffaa801f040 tx=0x7ffaa801c000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 shutdown_connections 2023-10-05T19:52:02.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/3227685747 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579601b60 0x5585796276d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 >> 172.21.15.167:0/3227685747 conn(0x5585795755d0 msgr2=0x55857961b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 shutdown_connections 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/3227685747 wait complete. 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2201193379 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff9f0030ca0 msgr2=0x7ff9f0033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/2201193379 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff9f0030ca0 0x7ff9f0033150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x558579643350 tx=0x7ffaa000e040 comp rx=0 tx=0).stop 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2201193379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 msgr2=0x558579658190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/2201193379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x558579658190 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ffa9803a040 tx=0x7ffa98030000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2201193379 shutdown_connections 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/2201193379 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff9f0030ca0 0x7ff9f0033150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 --2- 172.21.15.167:0/2201193379 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558579652620 0x558579658190 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2201193379 >> 172.21.15.167:0/2201193379 conn(0x55857964d9e0 msgr2=0x55857964bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2201193379 shutdown_connections 2023-10-05T19:52:02.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.257+0000 7ffab2f33e40 1 -- 172.21.15.167:0/2201193379 wait complete. 2023-10-05T19:52:02.311 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "entries": [ 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "buckets": [ 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.312 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_obj", 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 30000042, 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 11, 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 11 2023-10-05T19:52:02.313 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:52:02.314 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.315 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "summary": [ 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "put_obj", 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 30000042, 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 11, 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 11 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.316 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "total": { 2023-10-05T19:52:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 30000042, 2023-10-05T19:52:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 11, 2023-10-05T19:52:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 11 2023-10-05T19:52:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.317 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.317 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:02.317 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2023-10-05T19:52:02.318 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2023-10-05T19:52:02.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2023-10-05T19:52:02.318 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2023-10-05T19:52:02.394 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:02.395 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:02.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.389+0000 7f343957fe40 1 Processor -- start 2023-10-05T19:52:02.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.389+0000 7f343957fe40 1 -- start start 2023-10-05T19:52:02.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.389+0000 7f343957fe40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55d32dfe4930 0x55d32dfe4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.389+0000 7f343957fe40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d32df31bd0 con 0x55d32dfe5240 2023-10-05T19:52:02.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.389+0000 7f343957fe40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d32deeeee0 con 0x55d32dfe4930 2023-10-05T19:52:02.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.389+0000 7f34370b4700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55d32dfe4930 0x55d32dfe4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.389+0000 7f34368b3700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55d32dfe5240 0x55d32dfe5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50208/0 (socket says 172.21.15.167:50208) 2023-10-05T19:52:02.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.389+0000 7f34368b3700 1 -- 172.21.15.167:0/1977687089 learned_addr learned my addr 172.21.15.167:0/1977687089 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:02.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34360b2700 1 -- 172.21.15.167:0/1977687089 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246599200 0 0) 0x55d32df31bd0 con 0x55d32dfe5240 2023-10-05T19:52:02.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34360b2700 1 -- 172.21.15.167:0/1977687089 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3418001e10 con 0x55d32dfe5240 2023-10-05T19:52:02.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34370b4700 1 -- 172.21.15.167:0/1977687089 >> v1:172.21.15.118:6789/0 conn(0x55d32dfe5240 legacy=0x55d32dfe5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34370b4700 1 -- 172.21.15.167:0/1977687089 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d32dfe63f0 con 0x55d32dfe4930 2023-10-05T19:52:02.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34370b4700 1 --2- 172.21.15.167:0/1977687089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32dfe4d00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f342000a5d0 tx=0x7f3420005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5fb82d04ed00fc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34360b2700 1 -- 172.21.15.167:0/1977687089 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3420007610 con 0x55d32dfe4930 2023-10-05T19:52:02.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34360b2700 1 -- 172.21.15.167:0/1977687089 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420007770 con 0x55d32dfe4930 2023-10-05T19:52:02.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34360b2700 1 -- 172.21.15.167:0/1977687089 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3420007a40 con 0x55d32dfe4930 2023-10-05T19:52:02.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 -- 172.21.15.167:0/1977687089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 msgr2=0x55d32dfe4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 --2- 172.21.15.167:0/1977687089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32dfe4d00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f342000a5d0 tx=0x7f3420005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:02.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 -- 172.21.15.167:0/1977687089 shutdown_connections 2023-10-05T19:52:02.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 --2- 172.21.15.167:0/1977687089 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32dfe4d00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 -- 172.21.15.167:0/1977687089 >> 172.21.15.167:0/1977687089 conn(0x55d32dfe0350 msgr2=0x55d32dfe2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 -- 172.21.15.167:0/1977687089 shutdown_connections 2023-10-05T19:52:02.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 -- 172.21.15.167:0/1977687089 wait complete. 2023-10-05T19:52:02.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 Processor -- start 2023-10-05T19:52:02.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 -- start start 2023-10-05T19:52:02.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32df5a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f343957fe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32deb2e30 con 0x55d32dfe4930 2023-10-05T19:52:02.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34370b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32df5a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34370b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32df5a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47034/0 (socket says 172.21.15.167:47034) 2023-10-05T19:52:02.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34370b4700 1 -- 172.21.15.167:0/3807797349 learned_addr learned my addr 172.21.15.167:0/3807797349 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.393+0000 7f34370b4700 1 -- 172.21.15.167:0/3807797349 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420005cf0 con 0x55d32dfe4930 2023-10-05T19:52:02.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f34370b4700 1 --2- 172.21.15.167:0/3807797349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32df5a240 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3420000c00 tx=0x7f3420014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784dbdf70eb0120b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f34350b0700 1 -- 172.21.15.167:0/3807797349 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34200078e0 con 0x55d32dfe4930 2023-10-05T19:52:02.402 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f34350b0700 1 -- 172.21.15.167:0/3807797349 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420007a40 con 0x55d32dfe4930 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f34350b0700 1 -- 172.21.15.167:0/3807797349 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3420007bd0 con 0x55d32dfe4930 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 -- 172.21.15.167:0/3807797349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 msgr2=0x55d32df5a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 --2- 172.21.15.167:0/3807797349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32df5a240 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3420000c00 tx=0x7f3420014000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 -- 172.21.15.167:0/3807797349 shutdown_connections 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 --2- 172.21.15.167:0/3807797349 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32df5a240 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 -- 172.21.15.167:0/3807797349 >> 172.21.15.167:0/3807797349 conn(0x55d32dfe0350 msgr2=0x55d32dfff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 -- 172.21.15.167:0/3807797349 shutdown_connections 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 -- 172.21.15.167:0/3807797349 wait complete. 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 Processor -- start 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 -- start start 2023-10-05T19:52:02.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32e00c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32de85ed0 con 0x55d32dfe4930 2023-10-05T19:52:02.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f34370b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32e00c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f34370b4700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32e00c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47036/0 (socket says 172.21.15.167:47036) 2023-10-05T19:52:02.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 learned_addr learned my addr 172.21.15.167:0/3028936679 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d32dfe63f0 con 0x55d32dfe4930 2023-10-05T19:52:02.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f34370b4700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32e00c6e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f342001f040 tx=0x7f342001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f342f7fe700 1 -- 172.21.15.167:0/3028936679 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3420007bb0 con 0x55d32dfe4930 2023-10-05T19:52:02.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f342f7fe700 1 -- 172.21.15.167:0/3028936679 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420029070 con 0x55d32dfe4930 2023-10-05T19:52:02.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d32e00cc20 con 0x55d32dfe4930 2023-10-05T19:52:02.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f342f7fe700 1 -- 172.21.15.167:0/3028936679 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3420012610 con 0x55d32dfe4930 2023-10-05T19:52:02.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.397+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d32e00d060 con 0x55d32dfe4930 2023-10-05T19:52:02.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f342f7fe700 1 -- 172.21.15.167:0/3028936679 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3420012840 con 0x55d32dfe4930 2023-10-05T19:52:02.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f342f7fe700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f341c030c50 0x7f341c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f342f7fe700 1 -- 172.21.15.167:0/3028936679 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f342002b070 con 0x55d32dfe4930 2023-10-05T19:52:02.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f34368b3700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f341c030c50 0x7f341c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d32dfe5240 0x55d32e0180f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e018820 con 0x55d32dfe5240 2023-10-05T19:52:02.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f34368b3700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f341c030c50 0x7f341c033100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f34300044f0 tx=0x7f3430006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.407 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f34378b5700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d32dfe5240 0x55d32e0180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f34378b5700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d32dfe5240 0x55d32e0180f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f342800a500 con 0x55d32dfe5240 2023-10-05T19:52:02.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f343957fe40 20 realm 2023-10-05T19:52:02.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.401+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0156d0 con 0x55d32dfe5240 2023-10-05T19:52:02.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f342800a500 con 0x55d32dfe5240 2023-10-05T19:52:02.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:02.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e019300 con 0x55d32dfe5240 2023-10-05T19:52:02.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f342800a500 con 0x55d32dfe5240 2023-10-05T19:52:02.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d32e018f30 0x55d32e01c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e01c8a0 con 0x55d32e018f30 2023-10-05T19:52:02.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f34370b4700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d32e018f30 0x55d32e01c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f34370b4700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d32e018f30 0x55d32e01c170 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e01d170 con 0x55d32dfe5240 2023-10-05T19:52:02.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f342800a500 con 0x55d32dfe5240 2023-10-05T19:52:02.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:02.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 20 searching for the correct realm 2023-10-05T19:52:02.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d32e01cce0 0x55d32e020f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e01cce0 2023-10-05T19:52:02.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.405+0000 7f34368b3700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d32e01cce0 0x55d32e020f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34368b3700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d32e01cce0 0x55d32e020f40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3430004520 con 0x55d32e01cce0 2023-10-05T19:52:02.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e018f30 2023-10-05T19:52:02.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34370b4700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3420007030 0x7f34200113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x7f3420007030 2023-10-05T19:52:02.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34378b5700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3420007030 0x7f34200113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34378b5700 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3420007030 0x7f34200113b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x7f3420007030 2023-10-05T19:52:02.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.409+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e01cce0 2023-10-05T19:52:02.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3430004520 con 0x55d32e01cce0 2023-10-05T19:52:02.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e018f30 2023-10-05T19:52:02.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e018f30 2023-10-05T19:52:02.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x7f3420007030 2023-10-05T19:52:02.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x7f3420007030 2023-10-05T19:52:02.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.413+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x7f3420007030 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x7f3420007030 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e018f30 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e01cce0 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3430004520 con 0x55d32e01cce0 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e018f30 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.417+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e01cce0 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e01cce0 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x7f3420007030 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x7f3420007030 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32dfe5240 2023-10-05T19:52:02.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.421+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x7f3420007030 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x7f3420007030 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e01cce0 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x7f3420007030 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x7f3420007030 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e018f30 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e018f30 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021520 con 0x55d32e01cce0 2023-10-05T19:52:02.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.425+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3430021040 con 0x55d32e018f30 2023-10-05T19:52:02.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3430021040 con 0x55d32e018f30 2023-10-05T19:52:02.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e01dce0 con 0x55d32dfe5240 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e01e660 con 0x55d32e018f30 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e01d8d0 con 0x55d32e018f30 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e021ed0 con 0x55d32e01cce0 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.429+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022630 con 0x55d32e018f30 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0239f0 con 0x55d32e01cce0 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0239f0 con 0x55d32e018f30 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0239f0 con 0x7f3420007030 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x7f3420007030 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.433+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e01cce0 2023-10-05T19:52:02.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e018f30 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e018f30 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.437+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x7f3420007030 2023-10-05T19:52:02.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x7f3420007030 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x7f3420007030 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x7f3420007030 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e018f30 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e01cce0 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.441+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e018f30 2023-10-05T19:52:02.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e01cce0 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428014040 con 0x55d32dfe5240 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e01cce0 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.445+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x7f3420007030 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32dfe5240 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x7f3420007030 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e01cce0 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x7f3420007030 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e018f30 2023-10-05T19:52:02.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.449+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e018f30 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e01cce0 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e018f30 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022280 con 0x55d32e018f30 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0229e0 con 0x55d32e018f30 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e022d90 con 0x55d32dfe5240 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.453+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e023630 con 0x55d32e018f30 2023-10-05T19:52:02.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e023630 con 0x55d32e018f30 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e023630 con 0x7f3420007030 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 zone default found 2023-10-05T19:52:02.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 4 Realm: () 2023-10-05T19:52:02.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:02.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:02.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:02.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 zonegroup default 2023-10-05T19:52:02.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e023630 con 0x7f3420007030 2023-10-05T19:52:02.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e024fb0 con 0x55d32e01cce0 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.457+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e025360 con 0x55d32e01cce0 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f343957fe40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f343957fe40 20 started sync module instance, tier type = 2023-10-05T19:52:02.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f343957fe40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e024670 con 0x55d32e018f30 2023-10-05T19:52:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94365498360192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e024bc0 con 0x55d32e018f30 2023-10-05T19:52:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.461+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0260f0 con 0x55d32dfe5240 2023-10-05T19:52:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.465+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94365498360192] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.465+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.465+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94365498365712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e024bc0 con 0x55d32dfe5240 2023-10-05T19:52:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.465+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0266b0 con 0x55d32e018f30 2023-10-05T19:52:02.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.469+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94365498365712] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.469+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.469+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94365498366816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0266b0 con 0x55d32e018f30 2023-10-05T19:52:02.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.469+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e026fa0 con 0x7f3420007030 2023-10-05T19:52:02.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.469+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.469+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94365498370736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0273f0 con 0x7f3420007030 2023-10-05T19:52:02.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.469+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e027e00 con 0x55d32e018f30 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.469+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94365498366816] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.473+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94365498370736] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.473+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.473+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94365498371840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e027350 con 0x55d32e018f30 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.473+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0282f0 con 0x55d32e01cce0 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.473+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.473+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94365498375680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e028b90 con 0x55d32e01cce0 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.473+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0295a0 con 0x55d32e01cce0 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.473+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94365498371840] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94365498375680] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94365498374416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e029e40 con 0x55d32e01cce0 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e02a1f0 con 0x7f3420007030 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94365498374416] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94365498382672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e02a290 con 0x7f3420007030 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 20 add_watcher() i=0 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 20 add_watcher() i=1 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 20 add_watcher() i=2 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 20 add_watcher() i=3 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 20 add_watcher() i=4 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 20 add_watcher() i=5 2023-10-05T19:52:02.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 20 add_watcher() i=6 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94365498382672] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 20 add_watcher() i=7 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.477+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e02d2c0 con 0x55d32dfe5240 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94365498383776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e02a830 con 0x55d32dfe5240 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94365498383776] v32'226 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f3407fef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f343957fe40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f343957fe40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:02.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f343957fe40 1 Processor -- start 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f343957fe40 1 -- start start 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f343957fe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e037ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f343957fe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32e0380e0 con 0x55d32e0377d0 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f34368b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e037ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f34368b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e037ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47038/0 (socket says 172.21.15.167:47038) 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.481+0000 7f34368b3700 1 -- 172.21.15.167:0/2050657215 learned_addr learned my addr 172.21.15.167:0/2050657215 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f34368b3700 1 -- 172.21.15.167:0/2050657215 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d32e038220 con 0x55d32e0377d0 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f34368b3700 1 --2- 172.21.15.167:0/2050657215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e037ba0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3420016010 tx=0x7f3430006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44468879543aaa9b server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f34077ee700 1 -- 172.21.15.167:0/2050657215 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f343001a040 con 0x55d32e0377d0 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f34077ee700 1 -- 172.21.15.167:0/2050657215 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343002da60 con 0x55d32e0377d0 2023-10-05T19:52:02.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f34077ee700 1 -- 172.21.15.167:0/2050657215 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f34300049d0 con 0x55d32e0377d0 2023-10-05T19:52:02.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 -- 172.21.15.167:0/2050657215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 msgr2=0x55d32e037ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 --2- 172.21.15.167:0/2050657215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e037ba0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3420016010 tx=0x7f3430006000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 -- 172.21.15.167:0/2050657215 shutdown_connections 2023-10-05T19:52:02.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 --2- 172.21.15.167:0/2050657215 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e037ba0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 -- 172.21.15.167:0/2050657215 >> 172.21.15.167:0/2050657215 conn(0x55d32e032b90 msgr2=0x55d32e030d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 -- 172.21.15.167:0/2050657215 shutdown_connections 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 -- 172.21.15.167:0/2050657215 wait complete. 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 Processor -- start 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 -- start start 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e03d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f343957fe40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32e03e330 con 0x55d32e0377d0 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f34368b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e03d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f34368b3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e03d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47054/0 (socket says 172.21.15.167:47054) 2023-10-05T19:52:02.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.485+0000 7f34368b3700 1 -- 172.21.15.167:0/2449063122 learned_addr learned my addr 172.21.15.167:0/2449063122 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f34368b3700 1 -- 172.21.15.167:0/2449063122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3418001e10 con 0x55d32e0377d0 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f34368b3700 1 --2- 172.21.15.167:0/2449063122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e03d330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3430006ee0 tx=0x7f3430030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f3405feb700 1 -- 172.21.15.167:0/2449063122 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f343001a040 con 0x55d32e0377d0 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f3405feb700 1 -- 172.21.15.167:0/2449063122 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3430004330 con 0x55d32e0377d0 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f343957fe40 1 -- 172.21.15.167:0/2449063122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d32e03d930 con 0x55d32e0377d0 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f3405feb700 1 -- 172.21.15.167:0/2449063122 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3430014930 con 0x55d32e0377d0 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f343957fe40 1 -- 172.21.15.167:0/2449063122 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d32e03dd70 con 0x55d32e0377d0 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f3405feb700 1 -- 172.21.15.167:0/2449063122 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3430014a90 con 0x55d32e0377d0 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f3405feb700 1 --2- 172.21.15.167:0/2449063122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f337c030c00 0x7f337c0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f3405feb700 1 -- 172.21.15.167:0/2449063122 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f3430027040 con 0x55d32e0377d0 2023-10-05T19:52:02.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f343957fe40 5 note: GC not initialized 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f34378b5700 1 --2- 172.21.15.167:0/2449063122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f337c030c00 0x7f337c0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.489+0000 7f34378b5700 1 --2- 172.21.15.167:0/2449063122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f337c030c00 0x7f337c0330b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55d32e02a790 tx=0x7f342800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f3376ffd700 20 reqs_thread_entry: start 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f343957fe40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f343957fe40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f3366ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:32 2023 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f343957fe40 20 get_system_obj_state: rctx=0x7ffe6ffe03c8 obj=default.rgw.meta:users.uid:foo state=0x55d32debe0b0 s->prefetch_data=0 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0a5ba0 con 0x55d32dfe5240 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f33667fc700 20 reqs_thread_entry: start 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f3374ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:02.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f343957fe40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f343957fe40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f343957fe40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0a8630 con 0x55d32dfe5240 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.493+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.497+0000 7f343957fe40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.497+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e0a7620 con 0x55d32e01cce0 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.497+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.497+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94365498360192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e063f90 con 0x55d32e018f30 2023-10-05T19:52:02.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.497+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94365498360192] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.501+0000 7f343957fe40 20 remove_watcher() i=0 2023-10-05T19:52:02.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.501+0000 7f343957fe40 2 removed watcher, disabling cache 2023-10-05T19:52:02.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.501+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94365498365712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e024180 con 0x55d32dfe5240 2023-10-05T19:52:02.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.501+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94365498365712] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.501+0000 7f343957fe40 20 remove_watcher() i=1 2023-10-05T19:52:02.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.501+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94365498366816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e024180 con 0x55d32e018f30 2023-10-05T19:52:02.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.505+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94365498366816] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.505+0000 7f343957fe40 20 remove_watcher() i=2 2023-10-05T19:52:02.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.505+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94365498370736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e025c00 con 0x7f3420007030 2023-10-05T19:52:02.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.505+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94365498370736] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.505+0000 7f343957fe40 20 remove_watcher() i=3 2023-10-05T19:52:02.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.505+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94365498371840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e025c00 con 0x55d32e018f30 2023-10-05T19:52:02.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.509+0000 7f34370b4700 1 -- 172.21.15.167:0/3028936679 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94365498371840] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f342001cc20 con 0x55d32e018f30 2023-10-05T19:52:02.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.509+0000 7f343957fe40 20 remove_watcher() i=4 2023-10-05T19:52:02.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.509+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94365498375680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e026fa0 con 0x55d32e01cce0 2023-10-05T19:52:02.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.509+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94365498375680] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.509+0000 7f343957fe40 20 remove_watcher() i=5 2023-10-05T19:52:02.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.509+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94365498374416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e026fa0 con 0x55d32e01cce0 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.513+0000 7f34368b3700 1 -- 172.21.15.167:0/3028936679 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94365498374416] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f343001d040 con 0x55d32e01cce0 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.513+0000 7f343957fe40 20 remove_watcher() i=6 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.513+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94365498382672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e026fa0 con 0x7f3420007030 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.513+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94365498382672] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3428033040 con 0x7f3420007030 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.513+0000 7f343957fe40 20 remove_watcher() i=7 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f3407fef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94365498383776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d32e026fa0 con 0x55d32dfe5240 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94365498383776] v32'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3428033040 con 0x55d32dfe5240 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d32e018f30 msgr2=0x55d32e01c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55d32e018f30 0x55d32e01c170 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d32dfe5240 msgr2=0x55d32e0180f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55d32dfe5240 0x55d32e0180f0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3420007030 msgr2=0x7f34200113b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3420007030 0x7f34200113b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d32e01cce0 msgr2=0x55d32e020f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55d32e01cce0 0x55d32e020f40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f341c030c50 msgr2=0x7f341c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f341c030c50 0x7f341c033100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f34300044f0 tx=0x7f3430006690 comp rx=0 tx=0).stop 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 msgr2=0x55d32e00c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f34378b5700 1 -- 172.21.15.167:0/3028936679 reap_dead start 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32e00c6e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f342001f040 tx=0x7f342001c000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 shutdown_connections 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 --2- 172.21.15.167:0/3028936679 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32dfe4930 0x55d32e00c6e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 >> 172.21.15.167:0/3028936679 conn(0x55d32dfe0350 msgr2=0x55d32dffde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 shutdown_connections 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.517+0000 7f343957fe40 1 -- 172.21.15.167:0/3028936679 wait complete. 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 -- 172.21.15.167:0/2449063122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f337c030c00 msgr2=0x7f337c0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 --2- 172.21.15.167:0/2449063122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f337c030c00 0x7f337c0330b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55d32e02a790 tx=0x7f342800e040 comp rx=0 tx=0).stop 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 -- 172.21.15.167:0/2449063122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 msgr2=0x55d32e03d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 --2- 172.21.15.167:0/2449063122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e03d330 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3430006ee0 tx=0x7f3430030000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 -- 172.21.15.167:0/2449063122 shutdown_connections 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 --2- 172.21.15.167:0/2449063122 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f337c030c00 0x7f337c0330b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 --2- 172.21.15.167:0/2449063122 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55d32e0377d0 0x55d32e03d330 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 -- 172.21.15.167:0/2449063122 >> 172.21.15.167:0/2449063122 conn(0x55d32e032b90 msgr2=0x55d32e030c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 -- 172.21.15.167:0/2449063122 shutdown_connections 2023-10-05T19:52:02.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.521+0000 7f343957fe40 1 -- 172.21.15.167:0/2449063122 wait complete. 2023-10-05T19:52:02.550 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:02.550 INFO:teuthology.orchestra.run.smithi167.stdout: "entries": [ 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: "buckets": [ 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.551 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_obj", 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:02.552 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.553 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.554 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: "summary": [ 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_obj", 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.555 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:02.556 INFO:teuthology.orchestra.run.smithi167.stdout: "total": { 2023-10-05T19:52:02.556 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.556 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.556 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 4, 2023-10-05T19:52:02.556 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:02.556 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.556 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.556 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.556 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:02.556 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2023-10-05T19:52:02.557 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2023-10-05T19:52:02.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2023-10-05T19:52:02.557 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2023-10-05T19:52:02.599 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:02.632 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.593+0000 7f209ac1be40 1 Processor -- start 2023-10-05T19:52:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- start start 2023-10-05T19:52:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x565517475130 0x565517477510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5655173bbbd0 con 0x565517470b60 2023-10-05T19:52:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x565517378ee0 con 0x565517475130 2023-10-05T19:52:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f2097f4f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x565517475130 0x565517477510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f2097f4f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x565517475130 0x565517477510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47064/0 (socket says 172.21.15.167:47064) 2023-10-05T19:52:02.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f2097f4f700 1 -- 172.21.15.167:0/2632791564 learned_addr learned my addr 172.21.15.167:0/2632791564 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f2098750700 1 --1- 172.21.15.167:0/2632791564 >> v1:172.21.15.118:6789/0 conn(0x565517470b60 0x565517470f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50224/0 (socket says 172.21.15.167:50224) 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f2097f4f700 1 -- 172.21.15.167:0/2632791564 >> v1:172.21.15.118:6789/0 conn(0x565517470b60 legacy=0x565517470f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f2097f4f700 1 -- 172.21.15.167:0/2632791564 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565517471770 con 0x565517475130 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f2097f4f700 1 --2- 172.21.15.167:0/2632791564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 0x565517477510 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f209000a5c0 tx=0x7f2090005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c9f36ff9f45e01 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209774e700 1 -- 172.21.15.167:0/2632791564 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f209000e510 con 0x565517475130 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209774e700 1 -- 172.21.15.167:0/2632791564 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209000e670 con 0x565517475130 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209774e700 1 -- 172.21.15.167:0/2632791564 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f209000e920 con 0x565517475130 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- 172.21.15.167:0/2632791564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 msgr2=0x565517477510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 --2- 172.21.15.167:0/2632791564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 0x565517477510 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f209000a5c0 tx=0x7f2090005e00 comp rx=0 tx=0).stop 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- 172.21.15.167:0/2632791564 shutdown_connections 2023-10-05T19:52:02.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 --2- 172.21.15.167:0/2632791564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 0x565517477510 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- 172.21.15.167:0/2632791564 >> 172.21.15.167:0/2632791564 conn(0x5655173e45d0 msgr2=0x5655173e49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- 172.21.15.167:0/2632791564 shutdown_connections 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- 172.21.15.167:0/2632791564 wait complete. 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 Processor -- start 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- start start 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517470b60 0x56551748fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.597+0000 7f209ac1be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551733ce30 con 0x565517470b60 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f2098750700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517470b60 0x56551748fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f2098750700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517470b60 0x56551748fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47076/0 (socket says 172.21.15.167:47076) 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f2098750700 1 -- 172.21.15.167:0/1501838798 learned_addr learned my addr 172.21.15.167:0/1501838798 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f2098750700 1 -- 172.21.15.167:0/1501838798 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209000a180 con 0x565517470b60 2023-10-05T19:52:02.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f2098750700 1 --2- 172.21.15.167:0/1501838798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517470b60 0x56551748fc40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2088001cf0 tx=0x7f20880018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0705f8c6178c06 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209674c700 1 -- 172.21.15.167:0/1501838798 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2088014070 con 0x565517470b60 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209674c700 1 -- 172.21.15.167:0/1501838798 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208800be10 con 0x565517470b60 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209674c700 1 -- 172.21.15.167:0/1501838798 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f208800f590 con 0x565517470b60 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 -- 172.21.15.167:0/1501838798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517470b60 msgr2=0x56551748fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1501838798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517470b60 0x56551748fc40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2088001cf0 tx=0x7f20880018a0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 -- 172.21.15.167:0/1501838798 shutdown_connections 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1501838798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517470b60 0x56551748fc40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 -- 172.21.15.167:0/1501838798 >> 172.21.15.167:0/1501838798 conn(0x5655173e45d0 msgr2=0x56551748b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 -- 172.21.15.167:0/1501838798 shutdown_connections 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 -- 172.21.15.167:0/1501838798 wait complete. 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 Processor -- start 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 -- start start 2023-10-05T19:52:02.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 0x565517496bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f209ac1be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56551730fed0 con 0x565517475130 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f2098750700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 0x565517496bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f2098750700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 0x565517496bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47082/0 (socket says 172.21.15.167:47082) 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.601+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 learned_addr learned my addr 172.21.15.167:0/1967321843 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.605+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5655173bbbd0 con 0x565517475130 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.605+0000 7f2098750700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 0x565517496bd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f20880018e0 tx=0x7f2088016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.605+0000 7f2094f49700 1 -- 172.21.15.167:0/1967321843 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f208801c670 con 0x565517475130 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.605+0000 7f2094f49700 1 -- 172.21.15.167:0/1967321843 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208801c7d0 con 0x565517475130 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.605+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565517497110 con 0x565517475130 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.605+0000 7f2094f49700 1 -- 172.21.15.167:0/1967321843 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f208801cac0 con 0x565517475130 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.605+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565517497550 con 0x565517475130 2023-10-05T19:52:02.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.605+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2094f49700 1 -- 172.21.15.167:0/1967321843 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2088023020 con 0x565517475130 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2094f49700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f207c030ca0 0x7f207c033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2094f49700 1 -- 172.21.15.167:0/1967321843 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f2088008030 con 0x565517475130 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2097f4f700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f207c030ca0 0x7f207c033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5655174a0650 0x5655174a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174a30a0 con 0x5655174a0650 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2098f51700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5655174a0650 0x5655174a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2097f4f700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f207c030ca0 0x7f207c033150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2090000f80 tx=0x7f2090013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2098f51700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5655174a0650 0x5655174a2a30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f208000a500 con 0x5655174a0650 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 20 realm 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56551749fcc0 con 0x5655174a0650 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f208000a500 con 0x5655174a0650 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174a3b80 con 0x5655174a0650 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f208000a500 con 0x5655174a0650 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5655174a37b0 0x5655174a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.609+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174a7120 con 0x5655174a37b0 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f2098750700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5655174a37b0 0x5655174a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f2098750700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5655174a37b0 0x5655174a69f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174a79f0 con 0x5655174a0650 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f208000a500 con 0x5655174a0650 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f209ac1be40 20 searching for the correct realm 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5655174a7560 0x5655174ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a7560 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f2097f4f700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5655174a7560 0x5655174ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f2097f4f700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5655174a7560 0x5655174ab7c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.613+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a37b0 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098750700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f208801a070 0x7f2088042130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x7f208801a070 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f208801a070 0x7f2088042130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f208801a070 0x7f2088042130 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x7f208801a070 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a7560 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.617+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a37b0 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a37b0 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x7f208801a070 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x7f208801a070 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x7f208801a070 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x7f208801a070 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.621+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a37b0 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a7560 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a37b0 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a7560 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.625+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a7560 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x7f208801a070 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x7f208801a070 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a0650 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x7f208801a070 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x7f208801a070 2023-10-05T19:52:02.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a7560 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x7f208801a070 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x7f208801a070 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.629+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a37b0 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a37b0 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a7560 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a37b0 2023-10-05T19:52:02.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174abda0 con 0x5655174a37b0 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f209ac1be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f209ac1be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f209ac1be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f209ac1be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.633+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174a8560 con 0x5655174a0650 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174a8ee0 con 0x5655174a37b0 2023-10-05T19:52:02.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174a8150 con 0x5655174a37b0 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ac750 con 0x5655174a7560 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.637+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174aceb0 con 0x5655174a37b0 2023-10-05T19:52:02.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ae270 con 0x5655174a7560 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ae270 con 0x5655174a37b0 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ae270 con 0x7f208801a070 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x7f208801a070 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.641+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a7560 2023-10-05T19:52:02.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a37b0 2023-10-05T19:52:02.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a37b0 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.645+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x7f208801a070 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x7f208801a070 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x7f208801a070 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x7f208801a070 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a37b0 2023-10-05T19:52:02.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a7560 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.649+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a37b0 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a7560 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080014040 con 0x5655174a0650 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a7560 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x7f208801a070 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.653+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a0650 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x7f208801a070 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a7560 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x7f208801a070 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a37b0 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a37b0 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.657+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a7560 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a37b0 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174acb00 con 0x5655174a37b0 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ad260 con 0x5655174a37b0 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ad610 con 0x5655174a0650 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:02.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.661+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174adeb0 con 0x5655174a37b0 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ae260 con 0x5655174a37b0 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ae260 con 0x7f208801a070 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 zone default found 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 4 Realm: () 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 zonegroup default 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ae260 con 0x7f208801a070 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174afbe0 con 0x5655174a7560 2023-10-05T19:52:02.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.665+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174aff90 con 0x5655174a7560 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f209ac1be40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f209ac1be40 20 started sync module instance, tier type = 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f209ac1be40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174af2a0 con 0x5655174a37b0 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94923462990272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b0340 con 0x5655174a37b0 2023-10-05T19:52:02.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.669+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b0be0 con 0x5655174a0650 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.673+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94923462990272] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.673+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.673+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94923462997664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b0830 con 0x5655174a0650 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.673+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b1240 con 0x5655174a37b0 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.673+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94923462997664] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.673+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.673+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94923463003760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b0830 con 0x5655174a37b0 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.677+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b1b30 con 0x7f208801a070 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.677+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94923463003760] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.677+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.677+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94923463001184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b1b30 con 0x7f208801a070 2023-10-05T19:52:02.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.677+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b23d0 con 0x5655174a37b0 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94923463001184] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94923463006320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b21b0 con 0x5655174a37b0 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b2e30 con 0x5655174a7560 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94923463010624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b36d0 con 0x5655174a7560 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94923463006320] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b40e0 con 0x5655174a7560 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94923463015408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b4980 con 0x5655174a7560 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.681+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b5390 con 0x7f208801a070 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94923463010624] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94923463015408] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2090017050 con 0x5655174a7560 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94923463012832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b45b0 con 0x7f208801a070 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 20 add_watcher() i=0 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 20 add_watcher() i=1 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 20 add_watcher() i=2 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 20 add_watcher() i=3 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 20 add_watcher() i=4 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 20 add_watcher() i=5 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 20 add_watcher() i=6 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94923463012832] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 20 add_watcher() i=7 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b8450 con 0x5655174a0650 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.685+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94923463020192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b5910 con 0x5655174a0650 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94923463020192] v32'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f2068ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f209ac1be40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f209ac1be40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f209ac1be40 1 Processor -- start 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f209ac1be40 1 -- start start 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f209ac1be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f209ac1be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655174c3120 con 0x5655174c2810 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f2097f4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f2097f4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47094/0 (socket says 172.21.15.167:47094) 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f2097f4f700 1 -- 172.21.15.167:0/3666316672 learned_addr learned my addr 172.21.15.167:0/3666316672 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f2097f4f700 1 -- 172.21.15.167:0/3666316672 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5655174c3260 con 0x5655174c2810 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.689+0000 7f2097f4f700 1 --2- 172.21.15.167:0/3666316672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c2be0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f209000a5c0 tx=0x7f209002a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6457169797100 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f1fe3fff700 1 -- 172.21.15.167:0/3666316672 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2090037070 con 0x5655174c2810 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f1fe3fff700 1 -- 172.21.15.167:0/3666316672 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209002e040 con 0x5655174c2810 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f1fe3fff700 1 -- 172.21.15.167:0/3666316672 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f209002d050 con 0x5655174c2810 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 -- 172.21.15.167:0/3666316672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 msgr2=0x5655174c2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 --2- 172.21.15.167:0/3666316672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c2be0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f209000a5c0 tx=0x7f209002a040 comp rx=0 tx=0).stop 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 -- 172.21.15.167:0/3666316672 shutdown_connections 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 --2- 172.21.15.167:0/3666316672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c2be0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 -- 172.21.15.167:0/3666316672 >> 172.21.15.167:0/3666316672 conn(0x5655174bdbd0 msgr2=0x5655174bbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 -- 172.21.15.167:0/3666316672 shutdown_connections 2023-10-05T19:52:02.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 -- 172.21.15.167:0/3666316672 wait complete. 2023-10-05T19:52:02.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 Processor -- start 2023-10-05T19:52:02.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 -- start start 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655174c9210 con 0x5655174c2810 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f2097f4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f2097f4f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47098/0 (socket says 172.21.15.167:47098) 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f2097f4f700 1 -- 172.21.15.167:0/3660109537 learned_addr learned my addr 172.21.15.167:0/3660109537 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f2097f4f700 1 -- 172.21.15.167:0/3660109537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565517471770 con 0x5655174c2810 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f2097f4f700 1 --2- 172.21.15.167:0/3660109537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c8210 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2090035040 tx=0x7f209002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f1fe27fc700 1 -- 172.21.15.167:0/3660109537 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2090037040 con 0x5655174c2810 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 -- 172.21.15.167:0/3660109537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5655174c8810 con 0x5655174c2810 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f1fe27fc700 1 -- 172.21.15.167:0/3660109537 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20900339b0 con 0x5655174c2810 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f1fe27fc700 1 -- 172.21.15.167:0/3660109537 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2090033b40 con 0x5655174c2810 2023-10-05T19:52:02.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.693+0000 7f209ac1be40 1 -- 172.21.15.167:0/3660109537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5655174c8c50 con 0x5655174c2810 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.697+0000 7f1fe27fc700 1 -- 172.21.15.167:0/3660109537 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f2090033ca0 con 0x5655174c2810 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.697+0000 7f1fe27fc700 1 --2- 172.21.15.167:0/3660109537 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1fd8030bf0 0x7f1fd80330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.697+0000 7f1fe27fc700 1 -- 172.21.15.167:0/3660109537 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f2090047cf0 con 0x5655174c2810 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.697+0000 7f2098f51700 1 --2- 172.21.15.167:0/3660109537 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1fd8030bf0 0x7f1fd80330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.697+0000 7f209ac1be40 5 note: GC not initialized 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.697+0000 7f2098f51700 1 --2- 172.21.15.167:0/3660109537 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1fd8030bf0 0x7f1fd80330a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5655174b4820 tx=0x7f208000e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.697+0000 7f1fd77fe700 20 reqs_thread_entry: start 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f1fd57fa700 20 reqs_thread_entry: start 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:02.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f1fc37fe700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:33 2023 2023-10-05T19:52:02.770 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:02.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f1fc2ffd700 20 reqs_thread_entry: start 2023-10-05T19:52:02.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 20 get_system_obj_state: rctx=0x7ffc26551ef8 obj=default.rgw.meta:users.uid:foo state=0x5655173480b0 s->prefetch_data=0 2023-10-05T19:52:02.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565517530ae0 con 0x5655174a0650 2023-10-05T19:52:02.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:02.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:02.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565517533570 con 0x5655174a0650 2023-10-05T19:52:02.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:52:02.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565517532560 con 0x5655174a7560 2023-10-05T19:52:02.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.701+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f2090043070 con 0x5655174a7560 2023-10-05T19:52:02.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.705+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94923462990272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174eeed0 con 0x5655174a37b0 2023-10-05T19:52:02.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.705+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94923462990272] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.705+0000 7f209ac1be40 20 remove_watcher() i=0 2023-10-05T19:52:02.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.705+0000 7f209ac1be40 2 removed watcher, disabling cache 2023-10-05T19:52:02.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.705+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94923462997664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ad9c0 con 0x5655174a0650 2023-10-05T19:52:02.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.709+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94923462997664] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.709+0000 7f209ac1be40 20 remove_watcher() i=1 2023-10-05T19:52:02.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.709+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94923463003760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174ad9c0 con 0x5655174a37b0 2023-10-05T19:52:02.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.709+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94923463003760] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.709+0000 7f209ac1be40 20 remove_watcher() i=2 2023-10-05T19:52:02.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.709+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94923463001184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b0e70 con 0x7f208801a070 2023-10-05T19:52:02.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.713+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94923463001184] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.713+0000 7f209ac1be40 20 remove_watcher() i=3 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.713+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94923463006320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b0e70 con 0x5655174a37b0 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.713+0000 7f2098750700 1 -- 172.21.15.167:0/1967321843 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94923463006320] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2088016070 con 0x5655174a37b0 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.713+0000 7f209ac1be40 20 remove_watcher() i=4 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.713+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94923463010624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b1870 con 0x5655174a7560 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.717+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94923463010624] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2090043070 con 0x5655174a7560 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.717+0000 7f209ac1be40 20 remove_watcher() i=5 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.717+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94923463015408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b0e70 con 0x5655174a7560 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.717+0000 7f2097f4f700 1 -- 172.21.15.167:0/1967321843 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94923463015408] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2090043070 con 0x5655174a7560 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.717+0000 7f209ac1be40 20 remove_watcher() i=6 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.717+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94923463012832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b0e70 con 0x7f208801a070 2023-10-05T19:52:02.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.721+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94923463012832] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2080033040 con 0x7f208801a070 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.721+0000 7f209ac1be40 20 remove_watcher() i=7 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.721+0000 7f2068ff1700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.721+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94923463020192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5655174b0e70 con 0x5655174a0650 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94923463020192] v32'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2080033040 con 0x5655174a0650 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5655174a37b0 msgr2=0x5655174a69f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5655174a37b0 0x5655174a69f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5655174a0650 msgr2=0x5655174a2a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x5655174a0650 0x5655174a2a30 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f208801a070 msgr2=0x7f2088042130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f208801a070 0x7f2088042130 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5655174a7560 msgr2=0x5655174ab7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5655174a7560 0x5655174ab7c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f207c030ca0 msgr2=0x7f207c033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f207c030ca0 0x7f207c033150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2090000f80 tx=0x7f2090013000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f2098f51700 1 -- 172.21.15.167:0/1967321843 reap_dead start 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 msgr2=0x565517496bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 0x565517496bd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f20880018e0 tx=0x7f2088016000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 shutdown_connections 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/1967321843 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565517475130 0x565517496bd0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 >> 172.21.15.167:0/1967321843 conn(0x5655173e45d0 msgr2=0x56551748a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 shutdown_connections 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/1967321843 wait complete. 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/3660109537 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1fd8030bf0 msgr2=0x7f1fd80330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/3660109537 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1fd8030bf0 0x7f1fd80330a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5655174b4820 tx=0x7f208000e040 comp rx=0 tx=0).stop 2023-10-05T19:52:02.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/3660109537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 msgr2=0x5655174c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/3660109537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c8210 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f2090035040 tx=0x7f209002b000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/3660109537 shutdown_connections 2023-10-05T19:52:02.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/3660109537 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1fd8030bf0 0x7f1fd80330a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 --2- 172.21.15.167:0/3660109537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5655174c2810 0x5655174c8210 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/3660109537 >> 172.21.15.167:0/3660109537 conn(0x5655174bdbd0 msgr2=0x5655174bbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/3660109537 shutdown_connections 2023-10-05T19:52:02.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.725+0000 7f209ac1be40 1 -- 172.21.15.167:0/3660109537 wait complete. 2023-10-05T19:52:02.781 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "entries": [ 2023-10-05T19:52:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "buckets": [ 2023-10-05T19:52:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.781 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "", 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [] 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo", 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.782 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 217, 2023-10-05T19:52:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 2, 2023-10-05T19:52:02.783 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo2", 2023-10-05T19:52:02.799 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.800 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo3", 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:02.801 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket": "myfoo4", 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "time": "2023-10-05T19:00:00.000000Z", 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "epoch": 1696532400, 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "owner": "foo", 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 0, 2023-10-05T19:52:02.802 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 1, 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 1 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "summary": [ 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "foo", 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: "categories": [ 2023-10-05T19:52:02.803 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "category": "delete_bucket", 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 217, 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 5, 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "total": { 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_sent": 217, 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "bytes_received": 0, 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "ops": 5, 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: "successful_ops": 4 2023-10-05T19:52:02.804 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:02.805 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:02.805 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:02.805 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 217, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 217, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2023-10-05T19:52:02.805 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2023-10-05T19:52:02.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2023-10-05T19:52:02.805 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2023-10-05T19:52:02.854 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:02.854 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc2059c4e40 1 Processor -- start 2023-10-05T19:52:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc2059c4e40 1 -- start start 2023-10-05T19:52:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc2059c4e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x563b832a64d0 0x563b83333520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc2059c4e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563b8327fbd0 con 0x563b83333a60 2023-10-05T19:52:02.855 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc2059c4e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x563b8323cee0 con 0x563b832a64d0 2023-10-05T19:52:02.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc202cf8700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x563b83333a60 0x563b83335e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50232/0 (socket says 172.21.15.167:50232) 2023-10-05T19:52:02.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc202cf8700 1 -- 172.21.15.167:0/1735404485 learned_addr learned my addr 172.21.15.167:0/1735404485 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:02.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc2034f9700 1 --2- 172.21.15.167:0/1735404485 >> v2:172.21.15.118:3300/0 conn(0x563b832a64d0 0x563b83333520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc2034f9700 1 -- 172.21.15.167:0/1735404485 >> v1:172.21.15.118:6789/0 conn(0x563b83333a60 legacy=0x563b83335e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc2024f7700 1 -- 172.21.15.167:0/1735404485 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648089990 0 0) 0x563b8327fbd0 con 0x563b83333a60 2023-10-05T19:52:02.856 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.849+0000 7fc2034f9700 1 -- 172.21.15.167:0/1735404485 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b83337590 con 0x563b832a64d0 2023-10-05T19:52:02.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2034f9700 1 --2- 172.21.15.167:0/1735404485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b832a64d0 0x563b83333520 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00a5d0 tx=0x7fc1ec005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a472703398817f42 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2024f7700 1 -- 172.21.15.167:0/1735404485 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1ec0086a0 con 0x563b832a64d0 2023-10-05T19:52:02.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2024f7700 1 -- 172.21.15.167:0/1735404485 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec008800 con 0x563b832a64d0 2023-10-05T19:52:02.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2024f7700 1 -- 172.21.15.167:0/1735404485 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1ec008ad0 con 0x563b832a64d0 2023-10-05T19:52:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1735404485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b832a64d0 msgr2=0x563b83333520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/1735404485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b832a64d0 0x563b83333520 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00a5d0 tx=0x7fc1ec005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1735404485 shutdown_connections 2023-10-05T19:52:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/1735404485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b832a64d0 0x563b83333520 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.858 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1735404485 >> 172.21.15.167:0/1735404485 conn(0x563b8332d280 msgr2=0x563b8332f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1735404485 shutdown_connections 2023-10-05T19:52:02.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1735404485 wait complete. 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 Processor -- start 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 -- start start 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b83357fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2059c4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b83200e30 con 0x563b83333a60 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2034f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b83357fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2034f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b83357fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47118/0 (socket says 172.21.15.167:47118) 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2034f9700 1 -- 172.21.15.167:0/2578277003 learned_addr learned my addr 172.21.15.167:0/2578277003 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2034f9700 1 -- 172.21.15.167:0/2578277003 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec005cf0 con 0x563b83333a60 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.853+0000 7fc2034f9700 1 --2- 172.21.15.167:0/2578277003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b83357fe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00c010 tx=0x7fc1ec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8445c554f027dccb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2014f5700 1 -- 172.21.15.167:0/2578277003 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1ec008970 con 0x563b83333a60 2023-10-05T19:52:02.863 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2014f5700 1 -- 172.21.15.167:0/2578277003 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec008ad0 con 0x563b83333a60 2023-10-05T19:52:02.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2014f5700 1 -- 172.21.15.167:0/2578277003 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1ec008da0 con 0x563b83333a60 2023-10-05T19:52:02.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2578277003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 msgr2=0x563b83357fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2578277003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b83357fe0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00c010 tx=0x7fc1ec015000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2578277003 shutdown_connections 2023-10-05T19:52:02.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2578277003 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b83357fe0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2578277003 >> 172.21.15.167:0/2578277003 conn(0x563b8332d280 msgr2=0x563b83353ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2578277003 shutdown_connections 2023-10-05T19:52:02.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2578277003 wait complete. 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 Processor -- start 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 -- start start 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b8335ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2059c4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b831d3ed0 con 0x563b83333a60 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2034f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b8335ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2034f9700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b8335ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47120/0 (socket says 172.21.15.167:47120) 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.857+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 learned_addr learned my addr 172.21.15.167:0/2155657892 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b83337590 con 0x563b83333a60 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc2034f9700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b8335ebf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0030c0 tx=0x7fc1ec01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc1fb7fe700 1 -- 172.21.15.167:0/2155657892 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1ec01c410 con 0x563b83333a60 2023-10-05T19:52:02.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc1fb7fe700 1 -- 172.21.15.167:0/2155657892 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec01c570 con 0x563b83333a60 2023-10-05T19:52:02.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b8335f130 con 0x563b83333a60 2023-10-05T19:52:02.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc1fb7fe700 1 -- 172.21.15.167:0/2155657892 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1ec01c860 con 0x563b83333a60 2023-10-05T19:52:02.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b8335f570 con 0x563b83333a60 2023-10-05T19:52:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc1fb7fe700 1 -- 172.21.15.167:0/2155657892 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fc1ec019070 con 0x563b83333a60 2023-10-05T19:52:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc1fb7fe700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc1e8030c50 0x7fc1e8033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc1fb7fe700 1 -- 172.21.15.167:0/2155657892 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7fc1ec045bf0 con 0x563b83333a60 2023-10-05T19:52:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc202cf8700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc1e8030c50 0x7fc1e8033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b833686d0 0x563b8336aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.861+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8336b160 con 0x563b833686d0 2023-10-05T19:52:02.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc203cfa700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b833686d0 0x563b8336aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc202cf8700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc1e8030c50 0x7fc1e8033100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc001560 tx=0x7fc1fc006650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc203cfa700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b833686d0 0x563b8336aab0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1f400a500 con 0x563b833686d0 2023-10-05T19:52:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 20 realm 2023-10-05T19:52:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83367d40 con 0x563b833686d0 2023-10-05T19:52:02.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1f400a500 con 0x563b833686d0 2023-10-05T19:52:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8336bc40 con 0x563b833686d0 2023-10-05T19:52:02.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1f400a500 con 0x563b833686d0 2023-10-05T19:52:02.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8336ca70 0x563b8336ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8336f390 con 0x563b8336ca70 2023-10-05T19:52:02.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2034f9700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8336ca70 0x563b8336ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.865+0000 7fc2034f9700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8336ca70 0x563b8336ee50 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2059c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8336fc30 con 0x563b833686d0 2023-10-05T19:52:02.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc1f400a500 con 0x563b833686d0 2023-10-05T19:52:02.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2059c4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:02.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2059c4e40 20 searching for the correct realm 2023-10-05T19:52:02.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b833719f0 0x563b83373dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833719f0 2023-10-05T19:52:02.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc202cf8700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b833719f0 0x563b83373dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc202cf8700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b833719f0 0x563b83373dd0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc004520 con 0x563b833719f0 2023-10-05T19:52:02.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b8336ca70 2023-10-05T19:52:02.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2034f9700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc1ec02c020 0x7fc1ec0113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x7fc1ec02c020 2023-10-05T19:52:02.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc203cfa700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc1ec02c020 0x7fc1ec0113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.869+0000 7fc203cfa700 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc1ec02c020 0x7fc1ec0113b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x7fc1ec02c020 2023-10-05T19:52:02.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833719f0 2023-10-05T19:52:02.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc004520 con 0x563b833719f0 2023-10-05T19:52:02.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b8336ca70 2023-10-05T19:52:02.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b8336ca70 2023-10-05T19:52:02.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.873+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x7fc1ec02c020 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x7fc1ec02c020 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x7fc1ec02c020 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x7fc1ec02c020 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b8336ca70 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833719f0 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc004520 con 0x563b833719f0 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.877+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b8336ca70 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833719f0 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833719f0 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x7fc1ec02c020 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x7fc1ec02c020 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.881+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833686d0 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x7fc1ec02c020 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x7fc1ec02c020 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833719f0 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x7fc1ec02c020 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x7fc1ec02c020 2023-10-05T19:52:02.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b8336ca70 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b8336ca70 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b833719f0 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.885+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b8336ca70 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374310 con 0x563b8336ca70 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833707a0 con 0x563b833686d0 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833710f0 con 0x563b8336ca70 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833746c0 con 0x563b8336ca70 2023-10-05T19:52:02.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.889+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374a70 con 0x563b833719f0 2023-10-05T19:52:02.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83370c90 con 0x563b8336ca70 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2059c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83376720 con 0x563b833719f0 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83376720 con 0x563b8336ca70 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.946 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83376720 con 0x7fc1ec02c020 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x7fc1ec02c020 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.893+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833719f0 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b8336ca70 2023-10-05T19:52:02.947 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b8336ca70 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.897+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x7fc1ec02c020 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x7fc1ec02c020 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x7fc1ec02c020 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x7fc1ec02c020 2023-10-05T19:52:02.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b8336ca70 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833719f0 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.901+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b8336ca70 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833719f0 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4014040 con 0x563b833686d0 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833719f0 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.905+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x7fc1ec02c020 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833686d0 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:02.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x7fc1ec02c020 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833719f0 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x7fc1ec02c020 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b8336ca70 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.909+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b8336ca70 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b833719f0 2023-10-05T19:52:02.951 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b8336ca70 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83374e20 con 0x563b8336ca70 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2059c4e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2059c4e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2059c4e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2059c4e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83375710 con 0x563b8336ca70 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2059c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.913+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83375710 con 0x563b833686d0 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83375fb0 con 0x563b8336ca70 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83375fb0 con 0x563b8336ca70 2023-10-05T19:52:02.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833760b0 con 0x7fc1ec02c020 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 zone default found 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 4 Realm: () 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:02.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 zonegroup default 2023-10-05T19:52:02.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833760b0 con 0x7fc1ec02c020 2023-10-05T19:52:02.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:02.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83377a30 con 0x563b833719f0 2023-10-05T19:52:02.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.917+0000 7fc2059c4e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.921+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83377de0 con 0x563b833719f0 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.921+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.921+0000 7fc2059c4e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.921+0000 7fc2059c4e40 20 started sync module instance, tier type = 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.921+0000 7fc2059c4e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.921+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833770f0 con 0x563b8336ca70 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.921+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.921+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94813604506624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83377610 con 0x563b8336ca70 2023-10-05T19:52:02.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.921+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83377080 con 0x563b833686d0 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.925+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94813604506624] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.925+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.925+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94813604512144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83377080 con 0x563b833686d0 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.925+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83379130 con 0x563b8336ca70 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.925+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94813604512144] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.929+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.929+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94813604513248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83379130 con 0x563b8336ca70 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.929+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833799d0 con 0x7fc1ec02c020 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.929+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.929+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94813604516144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83379b80 con 0x7fc1ec02c020 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.929+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94813604513248] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.929+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83379b80 con 0x563b8336ca70 2023-10-05T19:52:02.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94813604516144] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:02.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94813604517392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83379aa0 con 0x563b8336ca70 2023-10-05T19:52:02.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8337aad0 con 0x563b833719f0 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94813604521440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8337b370 con 0x563b833719f0 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8337be10 con 0x563b833719f0 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94813604517392] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94813604521440] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94813604526368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8337c210 con 0x563b833719f0 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.933+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8337cab0 con 0x7fc1ec02c020 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:02.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94813604530160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8337d3a0 con 0x7fc1ec02c020 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 20 add_watcher() i=0 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 20 add_watcher() i=1 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 20 add_watcher() i=2 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 20 add_watcher() i=3 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 20 add_watcher() i=4 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 20 add_watcher() i=5 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94813604526368] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 20 add_watcher() i=6 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94813604530160] v32'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 20 add_watcher() i=7 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:02.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833803d0 con 0x563b833686d0 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.937+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94813604531808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8337d7a0 con 0x563b833686d0 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94813604531808] v32'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc1d3fef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc2059c4e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc2059c4e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc2059c4e40 1 Processor -- start 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc2059c4e40 1 -- start start 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc2059c4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b8338ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc2059c4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b8338b150 con 0x563b8338a840 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc202cf8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b8338ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc202cf8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b8338ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47130/0 (socket says 172.21.15.167:47130) 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc202cf8700 1 -- 172.21.15.167:0/1107490593 learned_addr learned my addr 172.21.15.167:0/1107490593 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.941+0000 7fc202cf8700 1 -- 172.21.15.167:0/1107490593 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b8338b290 con 0x563b8338a840 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc202cf8700 1 --2- 172.21.15.167:0/1107490593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b8338ac10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x563b83368170 tx=0x7fc1fc006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f684876e13a03ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc1d37ee700 1 -- 172.21.15.167:0/1107490593 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc01a040 con 0x563b8338a840 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc1d37ee700 1 -- 172.21.15.167:0/1107490593 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc01b040 con 0x563b8338a840 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc1d37ee700 1 -- 172.21.15.167:0/1107490593 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc0049b0 con 0x563b8338a840 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1107490593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 msgr2=0x563b8338ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/1107490593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b8338ac10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x563b83368170 tx=0x7fc1fc006000 comp rx=0 tx=0).stop 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1107490593 shutdown_connections 2023-10-05T19:52:02.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/1107490593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b8338ac10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1107490593 >> 172.21.15.167:0/1107490593 conn(0x563b83385c00 msgr2=0x563b83383d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1107490593 shutdown_connections 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 -- 172.21.15.167:0/1107490593 wait complete. 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 Processor -- start 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 -- start start 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b83390340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc2059c4e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b83391340 con 0x563b8338a840 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc202cf8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b83390340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc202cf8700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b83390340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47140/0 (socket says 172.21.15.167:47140) 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc202cf8700 1 -- 172.21.15.167:0/3427658971 learned_addr learned my addr 172.21.15.167:0/3427658971 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc202cf8700 1 -- 172.21.15.167:0/3427658971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc004b10 con 0x563b8338a840 2023-10-05T19:52:02.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.945+0000 7fc202cf8700 1 --2- 172.21.15.167:0/3427658971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b83390340 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc006040 tx=0x7fc1fc036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:02.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc1d1feb700 1 -- 172.21.15.167:0/3427658971 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc01a040 con 0x563b8338a840 2023-10-05T19:52:02.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc1d1feb700 1 -- 172.21.15.167:0/3427658971 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc02cc20 con 0x563b8338a840 2023-10-05T19:52:02.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc1d1feb700 1 -- 172.21.15.167:0/3427658971 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc02cdf0 con 0x563b8338a840 2023-10-05T19:52:02.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc2059c4e40 1 -- 172.21.15.167:0/3427658971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b83390940 con 0x563b8338a840 2023-10-05T19:52:02.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc2059c4e40 1 -- 172.21.15.167:0/3427658971 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b83390d80 con 0x563b8338a840 2023-10-05T19:52:02.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc1d1feb700 1 -- 172.21.15.167:0/3427658971 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fc1fc011410 con 0x563b8338a840 2023-10-05T19:52:02.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc1d1feb700 1 --2- 172.21.15.167:0/3427658971 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc148030ca0 0x7fc148033150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:02.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc1d1feb700 1 -- 172.21.15.167:0/3427658971 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7fc1fc027040 con 0x563b8338a840 2023-10-05T19:52:02.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc203cfa700 1 --2- 172.21.15.167:0/3427658971 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc148030ca0 0x7fc148033150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc2059c4e40 5 note: GC not initialized 2023-10-05T19:52:03.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.949+0000 7fc203cfa700 1 --2- 172.21.15.167:0/3427658971 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc148030ca0 0x7fc148033150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x563b8337a1d0 tx=0x7fc1f400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc142ffd700 20 reqs_thread_entry: start 2023-10-05T19:52:03.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc140ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc136ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:33 2023 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc1367fc700 20 reqs_thread_entry: start 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 20 get_system_obj_state: rctx=0x7ffc0e051e18 obj=default.rgw.meta:users.uid:bar state=0x563b8320c0b0 s->prefetch_data=0 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833f8c40 con 0x7fc1ec02c020 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 bar [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:03.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 20 get_system_obj_state: rctx=0x7ffc0e051b08 obj=default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A state=0x563b8320c0b0 s->prefetch_data=0 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833f8c40 con 0x563b833686d0 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(103 NX5QOQKC6BH2IDN8HC7A [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 20 get_system_obj_state: rctx=0x7ffc0e0513a8 obj=default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A state=0x563b8320c0b0 s->prefetch_data=0 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 20 get_system_obj_state: rctx=0x7ffc0e051a48 obj=default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A state=0x563b8320c0b0 s->prefetch_data=0 2023-10-05T19:52:03.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.953+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833fb1e0 con 0x7fc1ec02c020 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(104 bar [delete,create,call,writefull 0~346] v32'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc2059c4e40 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc2059c4e40 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc2059c4e40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [notify cookie 94813605044688 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833fab10 con 0x7fc1ec02c020 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== watch-notify(notify (1) cookie 94813604530160 notify 137438953495 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7fc1f403cbd0 con 0x7fc1ec02c020 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc200cf4700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94813604530160 notifier 4715 bl.length()=522 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc200cf4700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc200cf4700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc200cf4700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc1dc003d90 con 0x7fc1ec02c020 2023-10-05T19:52:03.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(105 notify.7 [notify cookie 94813605044688 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== watch-notify(notify_complete (2) cookie 94813605044688 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc1f403cd60 con 0x7fc1ec02c020 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(106 notify.7 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833f91c0 con 0x563b833686d0 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(107 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc2059c4e40 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc2059c4e40 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc2059c4e40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.957+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [notify cookie 94813605048112 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b833fa6c0 con 0x563b833719f0 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.961+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== watch-notify(notify (1) cookie 94813604521440 notify 137438953490 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x563b83390d80 con 0x563b833719f0 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.961+0000 7fc2014f5700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94813604521440 notifier 4715 bl.length()=177 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.961+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(108 notify.5 [notify cookie 94813605048112 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:03.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.961+0000 7fc2014f5700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-10-05T19:52:03.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.961+0000 7fc2014f5700 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T19:52:03.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.961+0000 7fc2014f5700 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc150003450 con 0x563b833719f0 2023-10-05T19:52:03.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.961+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== watch-notify(notify_complete (2) cookie 94813605048112 notify 137438953490 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x563b83390940 con 0x563b833719f0 2023-10-05T19:52:03.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.961+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(109 notify.5 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:03.010 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:03.010 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "bar", 2023-10-05T19:52:03.010 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Bar", 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "", 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "bar", 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "NX5QOQKC6BH2IDN8HC7A", 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn" 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:03.011 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:03.012 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:03.013 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:52:03.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.961+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94813604506624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8334e7a0 con 0x563b8336ca70 2023-10-05T19:52:03.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.965+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94813604506624] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:03.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.965+0000 7fc2059c4e40 20 remove_watcher() i=0 2023-10-05T19:52:03.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.965+0000 7fc2059c4e40 2 removed watcher, disabling cache 2023-10-05T19:52:03.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.965+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94813604512144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83376c00 con 0x563b833686d0 2023-10-05T19:52:03.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.965+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94813604512144] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:03.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.965+0000 7fc2059c4e40 20 remove_watcher() i=1 2023-10-05T19:52:03.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.965+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94813604513248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83376c00 con 0x563b8336ca70 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.969+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94813604513248] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.969+0000 7fc2059c4e40 20 remove_watcher() i=2 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.969+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94813604516144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83378680 con 0x7fc1ec02c020 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.969+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94813604516144] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.969+0000 7fc2059c4e40 20 remove_watcher() i=3 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.969+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94813604517392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83378680 con 0x563b8336ca70 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.973+0000 7fc2034f9700 1 -- 172.21.15.167:0/2155657892 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94813604517392] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1ec032070 con 0x563b8336ca70 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.973+0000 7fc2059c4e40 20 remove_watcher() i=4 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.973+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94813604521440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83378680 con 0x563b833719f0 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.973+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94813604521440] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc01d040 con 0x563b833719f0 2023-10-05T19:52:03.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.973+0000 7fc2059c4e40 20 remove_watcher() i=5 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.973+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94813604526368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83378680 con 0x563b833719f0 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.977+0000 7fc202cf8700 1 -- 172.21.15.167:0/2155657892 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94813604526368] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1fc052040 con 0x563b833719f0 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.977+0000 7fc2059c4e40 20 remove_watcher() i=6 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.977+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94813604530160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b83379130 con 0x7fc1ec02c020 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.977+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94813604530160] v32'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x7fc1ec02c020 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.977+0000 7fc2059c4e40 20 remove_watcher() i=7 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc1d3fef700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94813604531808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563b8337a5e0 con 0x563b833686d0 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94813604531808] v32'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc1f4033040 con 0x563b833686d0 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8336ca70 msgr2=0x563b8336ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x563b8336ca70 0x563b8336ee50 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.020 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b833686d0 msgr2=0x563b8336aab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x563b833686d0 0x563b8336aab0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc1ec02c020 msgr2=0x7fc1ec0113b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fc1ec02c020 0x7fc1ec0113b0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b833719f0 msgr2=0x563b83373dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x563b833719f0 0x563b83373dd0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc1e8030c50 msgr2=0x7fc1e8033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc1e8030c50 0x7fc1e8033100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc001560 tx=0x7fc1fc006650 comp rx=0 tx=0).stop 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc203cfa700 1 -- 172.21.15.167:0/2155657892 reap_dead start 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 msgr2=0x563b8335ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b8335ebf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0030c0 tx=0x7fc1ec01c000 comp rx=0 tx=0).stop 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 shutdown_connections 2023-10-05T19:52:03.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/2155657892 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b83333a60 0x563b8335ebf0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 >> 172.21.15.167:0/2155657892 conn(0x563b8332d280 msgr2=0x563b83352620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 shutdown_connections 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.981+0000 7fc2059c4e40 1 -- 172.21.15.167:0/2155657892 wait complete. 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 -- 172.21.15.167:0/3427658971 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc148030ca0 msgr2=0x7fc148033150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/3427658971 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc148030ca0 0x7fc148033150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x563b8337a1d0 tx=0x7fc1f400e040 comp rx=0 tx=0).stop 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 -- 172.21.15.167:0/3427658971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 msgr2=0x563b83390340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/3427658971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b83390340 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc006040 tx=0x7fc1fc036000 comp rx=0 tx=0).stop 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 -- 172.21.15.167:0/3427658971 shutdown_connections 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/3427658971 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fc148030ca0 0x7fc148033150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 --2- 172.21.15.167:0/3427658971 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x563b8338a840 0x563b83390340 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 -- 172.21.15.167:0/3427658971 >> 172.21.15.167:0/3427658971 conn(0x563b83385c00 msgr2=0x563b83383ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:03.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 -- 172.21.15.167:0/3427658971 shutdown_connections 2023-10-05T19:52:03.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:02.985+0000 7fc2059c4e40 1 -- 172.21.15.167:0/3427658971 wait complete. 2023-10-05T19:52:03.023 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:03.043 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:52:03.052 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2023-10-05T19:52:03.052 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2023-10-05T19:52:03.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2023-10-05T19:52:03.099 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2023-10-05T19:52:03.141 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:03.142 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:03.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d4794ae40 1 Processor -- start 2023-10-05T19:52:03.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d4794ae40 1 -- start start 2023-10-05T19:52:03.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d4794ae40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x565377594b60 0x565377594f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d4794ae40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5653774dfbd0 con 0x565377595470 2023-10-05T19:52:03.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d4794ae40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x56537749cee0 con 0x565377594b60 2023-10-05T19:52:03.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d4547f700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x565377594b60 0x565377594f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d44c7e700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x565377595470 0x565377595f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:50244/0 (socket says 172.21.15.167:50244) 2023-10-05T19:52:03.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d44c7e700 1 -- 172.21.15.167:0/1081548537 learned_addr learned my addr 172.21.15.167:0/1081548537 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:03.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d3ffff700 1 -- 172.21.15.167:0/1081548537 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55001203 0 0) 0x5653774dfbd0 con 0x565377595470 2023-10-05T19:52:03.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d3ffff700 1 -- 172.21.15.167:0/1081548537 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d34001e10 con 0x565377595470 2023-10-05T19:52:03.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d4547f700 1 -- 172.21.15.167:0/1081548537 >> v1:172.21.15.118:6789/0 conn(0x565377595470 legacy=0x565377595f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.137+0000 7f1d4547f700 1 -- 172.21.15.167:0/1081548537 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565377596610 con 0x565377594b60 2023-10-05T19:52:03.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4547f700 1 --2- 172.21.15.167:0/1081548537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x565377594f30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a520 tx=0x7f1d40005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c5e55287913b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d3ffff700 1 -- 172.21.15.167:0/1081548537 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d4000f590 con 0x565377594b60 2023-10-05T19:52:03.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d3ffff700 1 -- 172.21.15.167:0/1081548537 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4000f6f0 con 0x565377594b60 2023-10-05T19:52:03.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d3ffff700 1 -- 172.21.15.167:0/1081548537 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d4000f880 con 0x565377594b60 2023-10-05T19:52:03.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 -- 172.21.15.167:0/1081548537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 msgr2=0x565377594f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/1081548537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x565377594f30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000a520 tx=0x7f1d40005d40 comp rx=0 tx=0).stop 2023-10-05T19:52:03.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 -- 172.21.15.167:0/1081548537 shutdown_connections 2023-10-05T19:52:03.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/1081548537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x565377594f30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 -- 172.21.15.167:0/1081548537 >> 172.21.15.167:0/1081548537 conn(0x5653775085d0 msgr2=0x5653775089d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:03.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 -- 172.21.15.167:0/1081548537 shutdown_connections 2023-10-05T19:52:03.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 -- 172.21.15.167:0/1081548537 wait complete. 2023-10-05T19:52:03.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 Processor -- start 2023-10-05T19:52:03.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 -- start start 2023-10-05T19:52:03.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4794ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x565377460e30 con 0x565377594b60 2023-10-05T19:52:03.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4547f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4547f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47160/0 (socket says 172.21.15.167:47160) 2023-10-05T19:52:03.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4547f700 1 -- 172.21.15.167:0/2557604289 learned_addr learned my addr 172.21.15.167:0/2557604289 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:03.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4547f700 1 -- 172.21.15.167:0/2557604289 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4000a0e0 con 0x565377594b60 2023-10-05T19:52:03.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.141+0000 7f1d4547f700 1 --2- 172.21.15.167:0/2557604289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775b39e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005d80 tx=0x7f1d40014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48669911edfdc611 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d3effd700 1 -- 172.21.15.167:0/2557604289 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d4000f860 con 0x565377594b60 2023-10-05T19:52:03.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d3effd700 1 -- 172.21.15.167:0/2557604289 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4000f9c0 con 0x565377594b60 2023-10-05T19:52:03.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d3effd700 1 -- 172.21.15.167:0/2557604289 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d4000fb70 con 0x565377594b60 2023-10-05T19:52:03.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 -- 172.21.15.167:0/2557604289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 msgr2=0x5653775b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/2557604289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775b39e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005d80 tx=0x7f1d40014000 comp rx=0 tx=0).stop 2023-10-05T19:52:03.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 -- 172.21.15.167:0/2557604289 shutdown_connections 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/2557604289 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775b39e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 -- 172.21.15.167:0/2557604289 >> 172.21.15.167:0/2557604289 conn(0x5653775085d0 msgr2=0x5653775af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 -- 172.21.15.167:0/2557604289 shutdown_connections 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 -- 172.21.15.167:0/2557604289 wait complete. 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 Processor -- start 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 -- start start 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775ba5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x565377433ed0 con 0x565377594b60 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4547f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775ba5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4547f700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775ba5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47164/0 (socket says 172.21.15.167:47164) 2023-10-05T19:52:03.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 learned_addr learned my addr 172.21.15.167:0/3372468269 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:03.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565377596610 con 0x565377594b60 2023-10-05T19:52:03.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4547f700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775ba5f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005d80 tx=0x7f1d4001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d3d7fa700 1 -- 172.21.15.167:0/3372468269 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d4002f470 con 0x565377594b60 2023-10-05T19:52:03.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d3d7fa700 1 -- 172.21.15.167:0/3372468269 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4002f5d0 con 0x565377594b60 2023-10-05T19:52:03.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5653775bab30 con 0x565377594b60 2023-10-05T19:52:03.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d3d7fa700 1 -- 172.21.15.167:0/3372468269 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d4002f780 con 0x565377594b60 2023-10-05T19:52:03.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.145+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653775baf70 con 0x565377594b60 2023-10-05T19:52:03.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d3d7fa700 1 -- 172.21.15.167:0/3372468269 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f1d40010420 con 0x565377594b60 2023-10-05T19:52:03.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d3d7fa700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1d28030c00 0x7f1d280330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d3d7fa700 1 -- 172.21.15.167:0/3372468269 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f1d4002b070 con 0x565377594b60 2023-10-05T19:52:03.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d44c7e700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1d28030c00 0x7f1d280330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565377595470 0x5653775c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775c6770 con 0x565377595470 2023-10-05T19:52:03.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d44c7e700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1d28030c00 0x7f1d280330b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d30004170 tx=0x7f1d30001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d45c80700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565377595470 0x5653775c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.149+0000 7f1d45c80700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565377595470 0x5653775c6040 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d3800a500 con 0x565377595470 2023-10-05T19:52:03.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 realm 2023-10-05T19:52:03.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775c3670 con 0x565377595470 2023-10-05T19:52:03.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d3800a500 con 0x565377595470 2023-10-05T19:52:03.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:03.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775c72a0 con 0x565377595470 2023-10-05T19:52:03.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d3800a500 con 0x565377595470 2023-10-05T19:52:03.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5653775c80d0 0x5653775ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775ca9f0 con 0x5653775c80d0 2023-10-05T19:52:03.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4547f700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5653775c80d0 0x5653775ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4547f700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5653775c80d0 0x5653775ca4b0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:03.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cb290 con 0x565377595470 2023-10-05T19:52:03.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1d3800a500 con 0x565377595470 2023-10-05T19:52:03.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:03.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 20 searching for the correct realm 2023-10-05T19:52:03.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5653775cd050 0x5653775cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775cd050 2023-10-05T19:52:03.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.153+0000 7f1d44c7e700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5653775cd050 0x5653775cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d44c7e700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5653775cd050 0x5653775cf430 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30006070 con 0x5653775cd050 2023-10-05T19:52:03.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775c80d0 2023-10-05T19:52:03.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d4547f700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1d40045040 0x7f1d4003aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x7f1d40045040 2023-10-05T19:52:03.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d45c80700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1d40045040 0x7f1d4003aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d45c80700 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1d40045040 0x7f1d4003aa10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x7f1d40045040 2023-10-05T19:52:03.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.157+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775cd050 2023-10-05T19:52:03.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30006070 con 0x5653775cd050 2023-10-05T19:52:03.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775c80d0 2023-10-05T19:52:03.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775c80d0 2023-10-05T19:52:03.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x7f1d40045040 2023-10-05T19:52:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x7f1d40045040 2023-10-05T19:52:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x7f1d40045040 2023-10-05T19:52:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x7f1d40045040 2023-10-05T19:52:03.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.161+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775c80d0 2023-10-05T19:52:03.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775cd050 2023-10-05T19:52:03.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30006070 con 0x5653775cd050 2023-10-05T19:52:03.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775c80d0 2023-10-05T19:52:03.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775cd050 2023-10-05T19:52:03.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30006070 con 0x5653775cd050 2023-10-05T19:52:03.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.165+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775cd050 2023-10-05T19:52:03.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30006070 con 0x5653775cd050 2023-10-05T19:52:03.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x7f1d40045040 2023-10-05T19:52:03.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x7f1d40045040 2023-10-05T19:52:03.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x565377595470 2023-10-05T19:52:03.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x7f1d40045040 2023-10-05T19:52:03.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x7f1d40045040 2023-10-05T19:52:03.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775cd050 2023-10-05T19:52:03.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30006070 con 0x5653775cd050 2023-10-05T19:52:03.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x7f1d40045040 2023-10-05T19:52:03.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.169+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x7f1d40045040 2023-10-05T19:52:03.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775c80d0 2023-10-05T19:52:03.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775c80d0 2023-10-05T19:52:03.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775cd050 2023-10-05T19:52:03.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30006070 con 0x5653775cd050 2023-10-05T19:52:03.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775c80d0 2023-10-05T19:52:03.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cf970 con 0x5653775c80d0 2023-10-05T19:52:03.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4794ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:03.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4794ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:03.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4794ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:03.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4794ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:03.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.173+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cbe00 con 0x565377595470 2023-10-05T19:52:03.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cc750 con 0x5653775c80d0 2023-10-05T19:52:03.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:03.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cfdb0 con 0x5653775c80d0 2023-10-05T19:52:03.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:03.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0160 con 0x5653775cd050 2023-10-05T19:52:03.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f1d30006070 con 0x5653775cd050 2023-10-05T19:52:03.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x565377595470 2023-10-05T19:52:03.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775cc2f0 con 0x5653775c80d0 2023-10-05T19:52:03.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:03.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.177+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d1e10 con 0x5653775cd050 2023-10-05T19:52:03.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d1e10 con 0x5653775c80d0 2023-10-05T19:52:03.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d1e10 con 0x7f1d40045040 2023-10-05T19:52:03.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x7f1d40045040 2023-10-05T19:52:03.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x565377595470 2023-10-05T19:52:03.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x565377595470 2023-10-05T19:52:03.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x5653775cd050 2023-10-05T19:52:03.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.181+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x565377595470 2023-10-05T19:52:03.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x5653775c80d0 2023-10-05T19:52:03.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x5653775c80d0 2023-10-05T19:52:03.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x565377595470 2023-10-05T19:52:03.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x7f1d40045040 2023-10-05T19:52:03.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x7f1d40045040 2023-10-05T19:52:03.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x565377595470 2023-10-05T19:52:03.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x7f1d40045040 2023-10-05T19:52:03.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x7f1d40045040 2023-10-05T19:52:03.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.185+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x5653775c80d0 2023-10-05T19:52:03.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0510 con 0x5653775cd050 2023-10-05T19:52:03.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x565377595470 2023-10-05T19:52:03.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x5653775c80d0 2023-10-05T19:52:03.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.234 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x5653775cd050 2023-10-05T19:52:03.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.189+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x565377595470 2023-10-05T19:52:03.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38014040 con 0x565377595470 2023-10-05T19:52:03.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x565377595470 2023-10-05T19:52:03.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x565377595470 2023-10-05T19:52:03.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x5653775cd050 2023-10-05T19:52:03.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x7f1d40045040 2023-10-05T19:52:03.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x565377595470 2023-10-05T19:52:03.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x7f1d40045040 2023-10-05T19:52:03.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x5653775cd050 2023-10-05T19:52:03.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.193+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x7f1d40045040 2023-10-05T19:52:03.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x5653775c80d0 2023-10-05T19:52:03.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x5653775c80d0 2023-10-05T19:52:03.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x5653775cd050 2023-10-05T19:52:03.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x5653775c80d0 2023-10-05T19:52:03.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d30028040 con 0x5653775c80d0 2023-10-05T19:52:03.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4794ae40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:03.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4794ae40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:03.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4794ae40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:03.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4794ae40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:03.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.197+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0e00 con 0x5653775c80d0 2023-10-05T19:52:03.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:03.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d0e00 con 0x565377595470 2023-10-05T19:52:03.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:03.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d16a0 con 0x5653775c80d0 2023-10-05T19:52:03.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:03.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d16a0 con 0x5653775c80d0 2023-10-05T19:52:03.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:03.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d16a0 con 0x7f1d40045040 2023-10-05T19:52:03.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 zone default found 2023-10-05T19:52:03.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 4 Realm: () 2023-10-05T19:52:03.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:03.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:03.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:03.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 zonegroup default 2023-10-05T19:52:03.261 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.201+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d16a0 con 0x7f1d40045040 2023-10-05T19:52:03.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d3020 con 0x5653775cd050 2023-10-05T19:52:03.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d33d0 con 0x5653775cd050 2023-10-05T19:52:03.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 20 started sync module instance, tier type = 2023-10-05T19:52:03.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:03.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.205+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d2730 con 0x5653775c80d0 2023-10-05T19:52:03.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.209+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.209+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94916484866624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d2c50 con 0x5653775c80d0 2023-10-05T19:52:03.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.209+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d4160 con 0x565377595470 2023-10-05T19:52:03.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.209+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94916484866624] v32'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.209+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.209+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94916484872064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d2c50 con 0x565377595470 2023-10-05T19:52:03.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.209+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d4760 con 0x5653775c80d0 2023-10-05T19:52:03.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.213+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94916484872064] v32'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.213+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.213+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94916484873168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d2c50 con 0x5653775c80d0 2023-10-05T19:52:03.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.213+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d51c0 con 0x7f1d40045040 2023-10-05T19:52:03.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.213+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.264 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.213+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94916484877520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d5610 con 0x7f1d40045040 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.213+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d6020 con 0x5653775c80d0 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.213+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94916484873168] v32'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.217+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94916484877520] v32'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.217+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.217+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94916484874800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d5610 con 0x5653775c80d0 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.217+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d6230 con 0x5653775cd050 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.217+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94916484874800] v32'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.217+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.217+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94916484878624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d5570 con 0x5653775cd050 2023-10-05T19:52:03.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.217+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d7010 con 0x5653775cd050 2023-10-05T19:52:03.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94916484878624] v32'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94916484884576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d7900 con 0x5653775cd050 2023-10-05T19:52:03.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d81e0 con 0x7f1d40045040 2023-10-05T19:52:03.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94916484884576] v32'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'243 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94916484887568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d7d50 con 0x7f1d40045040 2023-10-05T19:52:03.266 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 20 add_watcher() i=0 2023-10-05T19:52:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 20 add_watcher() i=1 2023-10-05T19:52:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 20 add_watcher() i=2 2023-10-05T19:52:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 20 add_watcher() i=3 2023-10-05T19:52:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 20 add_watcher() i=4 2023-10-05T19:52:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 20 add_watcher() i=5 2023-10-05T19:52:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d4794ae40 20 add_watcher() i=6 2023-10-05T19:52:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.221+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94916484887568] v32'244 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 20 add_watcher() i=7 2023-10-05T19:52:03.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:03.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775db610 con 0x565377595470 2023-10-05T19:52:03.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94916484889136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775d8a60 con 0x565377595470 2023-10-05T19:52:03.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94916484889136] v32'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.268 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d167e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 1 Processor -- start 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 1 -- start start 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775e6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d4794ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653775e65c0 con 0x5653775e5cb0 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d44c7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d44c7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775e6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47176/0 (socket says 172.21.15.167:47176) 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.225+0000 7f1d44c7e700 1 -- 172.21.15.167:0/884326204 learned_addr learned my addr 172.21.15.167:0/884326204 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:03.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d44c7e700 1 -- 172.21.15.167:0/884326204 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653775e6700 con 0x5653775e5cb0 2023-10-05T19:52:03.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d44c7e700 1 --2- 172.21.15.167:0/884326204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775e6080 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5653775c6e40 tx=0x7f1d30010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd3f706f6af5374 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d15fe3700 1 -- 172.21.15.167:0/884326204 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d3003b070 con 0x5653775e5cb0 2023-10-05T19:52:03.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d15fe3700 1 -- 172.21.15.167:0/884326204 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30022040 con 0x5653775e5cb0 2023-10-05T19:52:03.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d15fe3700 1 -- 172.21.15.167:0/884326204 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d30021040 con 0x5653775e5cb0 2023-10-05T19:52:03.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 -- 172.21.15.167:0/884326204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 msgr2=0x5653775e6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/884326204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775e6080 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x5653775c6e40 tx=0x7f1d30010000 comp rx=0 tx=0).stop 2023-10-05T19:52:03.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 -- 172.21.15.167:0/884326204 shutdown_connections 2023-10-05T19:52:03.270 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/884326204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775e6080 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 -- 172.21.15.167:0/884326204 >> 172.21.15.167:0/884326204 conn(0x5653775e1070 msgr2=0x5653775df1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:03.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 -- 172.21.15.167:0/884326204 shutdown_connections 2023-10-05T19:52:03.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 -- 172.21.15.167:0/884326204 wait complete. 2023-10-05T19:52:03.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 Processor -- start 2023-10-05T19:52:03.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 -- start start 2023-10-05T19:52:03.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775eb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d4794ae40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653775ec790 con 0x5653775e5cb0 2023-10-05T19:52:03.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d44c7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d44c7e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775eb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47186/0 (socket says 172.21.15.167:47186) 2023-10-05T19:52:03.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d44c7e700 1 -- 172.21.15.167:0/68965839 learned_addr learned my addr 172.21.15.167:0/68965839 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:03.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.229+0000 7f1d44c7e700 1 -- 172.21.15.167:0/68965839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34001e10 con 0x5653775e5cb0 2023-10-05T19:52:03.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1d44c7e700 1 --2- 172.21.15.167:0/68965839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775eb790 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000b960 tx=0x7f1d30037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1c87fff700 1 -- 172.21.15.167:0/68965839 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d30021070 con 0x5653775e5cb0 2023-10-05T19:52:03.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1c87fff700 1 -- 172.21.15.167:0/68965839 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30034440 con 0x5653775e5cb0 2023-10-05T19:52:03.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1d4794ae40 1 -- 172.21.15.167:0/68965839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5653775ebd90 con 0x5653775e5cb0 2023-10-05T19:52:03.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1c87fff700 1 -- 172.21.15.167:0/68965839 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d30046070 con 0x5653775e5cb0 2023-10-05T19:52:03.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1d4794ae40 1 -- 172.21.15.167:0/68965839 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653775ec230 con 0x5653775e5cb0 2023-10-05T19:52:03.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1c87fff700 1 -- 172.21.15.167:0/68965839 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f1d3003e020 con 0x5653775e5cb0 2023-10-05T19:52:03.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1c87fff700 1 --2- 172.21.15.167:0/68965839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1c8c030c50 0x7f1c8c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:03.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1c87fff700 1 -- 172.21.15.167:0/68965839 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f1d3002e040 con 0x5653775e5cb0 2023-10-05T19:52:03.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1d45c80700 1 --2- 172.21.15.167:0/68965839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1c8c030c50 0x7f1c8c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:03.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1d4794ae40 5 note: GC not initialized 2023-10-05T19:52:03.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.233+0000 7f1d45c80700 1 --2- 172.21.15.167:0/68965839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1c8c030c50 0x7f1c8c033100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5653775d7f70 tx=0x7f1d3800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:03.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:03.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1c7effd700 20 reqs_thread_entry: start 2023-10-05T19:52:03.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1c7d7fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:33 2023 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1c7cff9700 20 reqs_thread_entry: start 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 20 get_system_obj_state: rctx=0x7ffd5a337e58 obj=default.rgw.meta:users.uid:bar state=0x56537746c0b0 s->prefetch_data=0 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377653f20 con 0x7f1d40045040 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1c857fa700 20 reqs_thread_entry: start 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 bar [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x16 2023-10-05T19:52:03.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 10 cache get: name=default.rgw.meta+users.uid+bar : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.e 8:718f6a54:users.uid::bar:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653776569b0 con 0x7f1d40045040 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 bar [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2023-10-05T19:52:03.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:03.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.237+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377658000 con 0x7f1d40045040 2023-10-05T19:52:03.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(104 bud [create,call,writefull 0~181] v32'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-10-05T19:52:03.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d4794ae40 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T19:52:03.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d4794ae40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2023-10-05T19:52:03.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 7.3 7:c609908c:::notify.5:head [notify cookie 94916485409536 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653776586f0 con 0x5653775cd050 2023-10-05T19:52:03.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== watch-notify(notify (1) cookie 94916484878624 notify 137438953491 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x5653775ec230 con 0x5653775cd050 2023-10-05T19:52:03.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d3e7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94916484878624 notifier 4721 bl.length()=357 2023-10-05T19:52:03.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d3e7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d3e7fc700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d3e7fc700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d24003d90 con 0x5653775cd050 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(105 notify.5 [notify cookie 94916485409536 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== watch-notify(notify_complete (2) cookie 94916485409536 notify 137438953491 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5653775ebd90 con 0x5653775cd050 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(106 notify.5 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377656ff0 con 0x565377595470 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(107 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d4794ae40 20 get_system_obj_state: rctx=0x7ffd5a337dc0 obj=default.rgw.meta:root:.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 state=0x56537746c0b0 s->prefetch_data=0 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d4794ae40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 : miss 2023-10-05T19:52:03.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.241+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 8.17 8:eb04119c:root::.bucket.meta.myfoo6%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377655fe0 con 0x5653775c80d0 2023-10-05T19:52:03.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(108 .bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 291+0+282 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 info.flags=0x16 2023-10-05T19:52:03.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 to cache LRU end 2023-10-05T19:52:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 20 Read xattr: user.rgw.acl 2023-10-05T19:52:03.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 8.17 8:eb04119c:root::.bucket.meta.myfoo6%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377656c30 con 0x5653775c80d0 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(109 .bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 [call,call out=48b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 333+0+619 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=353 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 info.flags=0x13 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 to cache LRU end 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 2023-10-05T19:52:03.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 8.17 8:eb04119c:root::.bucket.meta.myfoo6%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377660400 con 0x5653775c80d0 2023-10-05T19:52:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(110 .bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 [delete,create,call,call,writefull 0~353,setxattr (117)] v32'2 uv2 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 info.flags=0x17 2023-10-05T19:52:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 to cache LRU end 2023-10-05T19:52:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T19:52:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7, ofs0, ns] 2023-10-05T19:52:03.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.245+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 7.15 7:a93a5511:::notify.2:head [notify cookie 94916485448560 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653776568a0 con 0x5653775c80d0 2023-10-05T19:52:03.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify (1) cookie 94916484873168 notify 137438953510 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x5653775baf70 con 0x5653775c80d0 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d3effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94916484873168 notifier 4721 bl.length()=721 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d3effd700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 info.flags=0x17 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d3effd700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 to cache LRU end 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d3effd700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(111 notify.2 [notify cookie 94916485448560 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d3effd700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1c94003520 con 0x5653775c80d0 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(112 notify.2 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== watch-notify(notify_complete (2) cookie 94916485448560 notify 137438953510 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5653775bab30 con 0x5653775c80d0 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4794ae40 20 handle_bi_update(): bucket=:myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]): orig_sources= new_sources= 2023-10-05T19:52:03.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4794ae40 20 handle_bi_update(): bucket=:myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]): potential sources added=[] removed=[] 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4794ae40 20 handle_bi_update(): bucket=:myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]): orig_dests= new_dests= 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4794ae40 20 handle_bi_update(): bucket=:myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]): potential dests added=[] removed=[] 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653776567e0 con 0x565377595470 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(113 bar.buckets [call] v32'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.249+0000 7f1d4794ae40 20 get_system_obj_state: rctx=0x7ffd5a337678 obj=default.rgw.meta:root:myfoo6 state=0x56537746c0b0 s->prefetch_data=0 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:114 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653776567e0 con 0x565377595470 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(114 myfoo6 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x16 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T19:52:03.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 cache get: name=default.rgw.meta+root+myfoo6 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653776567e0 con 0x565377595470 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(115 myfoo6 [call,call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 276+0+289 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 20 rados_obj.operate() r=0 bl.length=166 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:03.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:116 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56537765cc20 con 0x565377595470 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(116 myfoo6 [delete,create,call,call,writefull 0~166] v32'17 uv17 ondisk = 0) v8 ==== 318+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.253+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.e 7:7759931f:::notify.3:head [notify cookie 94916485401312 in=352b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56537765d380 con 0x7f1d40045040 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.257+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== watch-notify(notify (1) cookie 94916484877520 notify 137438953497 ret 0) v3 ==== 382+0+0 (crc 0 0 0) 0x7f1d38002c70 con 0x7f1d40045040 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.257+0000 7f1d3e7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94916484877520 notifier 4721 bl.length()=340 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.257+0000 7f1d3e7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x17 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.257+0000 7f1d3e7fc700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.257+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(117 notify.3 [notify cookie 94916485401312 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.257+0000 7f1d3e7fc700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:118 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d24003d90 con 0x7f1d40045040 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.257+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== watch-notify(notify_complete (2) cookie 94916485401312 notify 137438953497 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1d38002e00 con 0x7f1d40045040 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.257+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(118 notify.3 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.257+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56537765f250 con 0x5653775c80d0 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(119 bud.buckets [call] v32'3 uv3 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:120 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x565377595470 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(120 myfoo6 [delete,create,call,writefull 0~166] v32'18 uv18 ondisk = 0) v8 ==== 276+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d4794ae40 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d4794ae40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:121 7.e 7:7759931f:::notify.3:head [notify cookie 94916485420800 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659b50 con 0x7f1d40045040 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== watch-notify(notify (1) cookie 94916484877520 notify 137438953498 ret 0) v3 ==== 358+0+0 (crc 0 0 0) 0x7f1d38002e00 con 0x7f1d40045040 2023-10-05T19:52:03.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d3effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94916484877520 notifier 4721 bl.length()=316 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d3effd700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d3effd700 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(121 notify.3 [notify cookie 94916485420800 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d3effd700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:122 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1c94003550 con 0x7f1d40045040 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 28 ==== watch-notify(notify_complete (2) cookie 94916485420800 notify 137438953498 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1d3804e510 con 0x7f1d40045040 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 29 ==== osd_op_reply(122 notify.3 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d4794ae40 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.261+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:123 4.28 4:14e4fd64:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x7f1d40045040 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.265+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 30 ==== osd_op_reply(123 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.265+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:124 4.1f 4:f94fa9d5:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x5653775c80d0 2023-10-05T19:52:03.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.265+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(124 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.265+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:125 4.10 4:0a81f3bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x5653775cd050 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.265+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(125 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.265+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:126 4.31 4:8ca52ea4:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x5653775c80d0 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.269+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(126 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.269+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:127 4.8 4:10af645e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x5653775cd050 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.269+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(127 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.269+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:128 4.39 4:9dfe1dca:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x5653775cd050 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.269+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(128 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.269+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:129 4.1a 4:5bc2cca0:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x5653775c80d0 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.269+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(129 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.269+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:130 4.1c 4:3ac9a2dc:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x7f1d40045040 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.273+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 31 ==== osd_op_reply(130 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.273+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:131 4.24 4:26f3e49f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x565377595470 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.273+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(131 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.273+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:132 4.3a 4:5d1a43ff:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x5653775cd050 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.273+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(132 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 [call out=378b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+378 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.273+0000 7f1d4794ae40 10 cls_bucket_list_unordered: got thirteen 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.273+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:133 4.20 4:07d1f63a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x5653775c80d0 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(133 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 get_obj_state: rctx=0x7ffd5a3376d0 obj=myfoo6:thirteen state=0x56537765ef48 s->prefetch_data=0 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:134 3.16s0 3:6a48f971:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377659bf0 con 0x5653775c80d0 2023-10-05T19:52:03.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(134 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+872 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 10 manifest: total_size = 8 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 get_obj_state: setting s->obj_tag to e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.14160317608470994741 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr rgw_rados: user.rgw.acl 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr rgw_rados: user.rgw.content_type 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr rgw_rados: user.rgw.etag 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr rgw_rados: user.rgw.idtag 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr rgw_rados: user.rgw.manifest 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr rgw_rados: user.rgw.pg_ver 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr rgw_rados: user.rgw.source_zone 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr rgw_rados: user.rgw.tail_tag 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 get_obj_state: rctx=0x7ffd5a3376d0 obj=myfoo6:thirteen state=0x56537765ef48 s->prefetch_data=0 2023-10-05T19:52:03.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 get_system_obj_state: rctx=0x7ffd5a335da0 obj=default.rgw.meta:root:.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 state=0x56537746c0b0 s->prefetch_data=0 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 : hit (requested=0x16, cached=0x17) 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr: user.rgw.acl 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 : hit (requested=0x13, cached=0x17) 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:135 4.3a 4:5d1a43ff:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653776640c0 con 0x5653775cd050 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(135 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 [stat,call,call] v32'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.277+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:136 3.16s0 3:6a48f971:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377662270 con 0x5653775c80d0 2023-10-05T19:52:03.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.281+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(136 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.281+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:137 4.3a 4:5d1a43ff:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56537765a770 con 0x5653775cd050 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.281+0000 7f1d4794ae40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo6 : miss 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.281+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.281+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:138 6.9 6:936e6ff6:::bucket.sync-source-hints.myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377666980 con 0x5653775cd050 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(138 bucket.sync-source-hints.myfoo6 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo6 info.flags=0x0 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 10 adding default.rgw.log++bucket.sync-source-hints.myfoo6 to cache LRU end 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo6 : miss 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 20 rados->read ofs=0 len=0 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:139 6.19 6:9e3df8ab:::bucket.sync-target-hints.myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377666950 con 0x5653775c80d0 2023-10-05T19:52:03.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 46 ==== osd_op_reply(139 bucket.sync-target-hints.myfoo6 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo6 info.flags=0x0 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 10 adding default.rgw.log++bucket.sync-target-hints.myfoo6 to cache LRU end 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 10 chain_cache_entry: cache_locator= 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:1 objects processed in :myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]). Next marker thirteen 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:140 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377665820 con 0x7f1d40045040 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(137 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.285+0000 7f1d3effd700 20 handle_completion(): completion ok for obj=thirteen 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 32 ==== osd_op_reply(140 bud [delete,create,call,writefull 0~346] v32'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d4794ae40 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d4794ae40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify cookie 94916485423744 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56537765ed60 con 0x5653775cd050 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== watch-notify(notify (1) cookie 94916484878624 notify 137438953492 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7f1d3005b000 con 0x5653775cd050 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d3e7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94916484878624 notifier 4721 bl.length()=522 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d3e7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d3e7fc700 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== osd_op_reply(141 notify.5 [notify cookie 94916485423744 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d3e7fc700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:142 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d24003d90 con 0x5653775cd050 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 35 ==== osd_op_reply(142 notify.5 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 36 ==== watch-notify(notify_complete (2) cookie 94916485423744 notify 137438953492 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5653775ebd90 con 0x5653775cd050 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:143 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377666320 con 0x565377595470 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(143 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'5 uv5 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d4794ae40 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d4794ae40 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d4794ae40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.289+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:144 7.3 7:c609908c:::notify.5:head [notify cookie 94916485423744 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56537765ed60 con 0x5653775cd050 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 37 ==== watch-notify(notify (1) cookie 94916484878624 notify 137438953493 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x5653775ebd90 con 0x5653775cd050 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d3e7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94916484878624 notifier 4721 bl.length()=177 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d3e7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-10-05T19:52:03.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d3e7fc700 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 38 ==== osd_op_reply(144 notify.5 [notify cookie 94916485423744 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d3e7fc700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:145 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1d24003d90 con 0x5653775cd050 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 39 ==== watch-notify(notify_complete (2) cookie 94916485423744 notify 137438953493 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1d34001e10 con 0x5653775cd050 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d4794ae40 10 removing user index: bar 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d4794ae40 10 removing default.rgw.meta+users.uid+bar from cache 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 40 ==== osd_op_reply(145 notify.5 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d4794ae40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:146 7.9 7:93e5b521:::notify.7:head [notify cookie 94916485423744 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56537765ed60 con 0x7f1d40045040 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 33 ==== watch-notify(notify (1) cookie 94916484887568 notify 137438953499 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f1d3804e510 con 0x7f1d40045040 2023-10-05T19:52:03.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d3effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94916484887568 notifier 4721 bl.length()=152 2023-10-05T19:52:03.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 34 ==== osd_op_reply(146 notify.7 [notify cookie 94916485423744 out=8b] v0'0 uv243 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d3effd700 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:147 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1c94003550 con 0x7f1d40045040 2023-10-05T19:52:03.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 35 ==== watch-notify(notify_complete (2) cookie 94916485423744 notify 137438953499 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1d3804e740 con 0x7f1d40045040 2023-10-05T19:52:03.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 36 ==== osd_op_reply(147 notify.7 [notify-ack] v0'0 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.293+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:148 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x565377666320 con 0x7f1d40045040 2023-10-05T19:52:03.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.297+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 37 ==== osd_op_reply(148 bar [delete] v32'4 uv4 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.335 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "bud", 2023-10-05T19:52:03.335 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Bar", 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "", 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "bud", 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "NX5QOQKC6BH2IDN8HC7A", 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn" 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:52:03.336 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:03.337 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:52:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:52:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:52:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:52:03.338 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:52:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:52:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:52:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:52:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:52:03.388 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:03.388 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:52:03.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.297+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:149 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94916484866624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775aa2c0 con 0x5653775c80d0 2023-10-05T19:52:03.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.297+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 47 ==== osd_op_reply(149 notify.0 [watch unwatch cookie 94916484866624] v32'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.297+0000 7f1d4794ae40 20 remove_watcher() i=0 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.297+0000 7f1d4794ae40 2 removed watcher, disabling cache 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.297+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:150 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94916484872064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775aa2c0 con 0x565377595470 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.301+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(150 notify.1 [watch unwatch cookie 94916484872064] v32'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.301+0000 7f1d4794ae40 20 remove_watcher() i=1 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.301+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:151 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94916484873168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775aa2c0 con 0x5653775c80d0 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.301+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 48 ==== osd_op_reply(151 notify.2 [watch unwatch cookie 94916484873168] v32'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.301+0000 7f1d4794ae40 20 remove_watcher() i=2 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.301+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:152 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94916484877520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775aa2c0 con 0x7f1d40045040 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.301+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 38 ==== osd_op_reply(152 notify.3 [watch unwatch cookie 94916484877520] v32'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.301+0000 7f1d4794ae40 20 remove_watcher() i=3 2023-10-05T19:52:03.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.301+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:153 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94916484874800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775aa2c0 con 0x5653775c80d0 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.305+0000 7f1d4547f700 1 -- 172.21.15.167:0/3372468269 <== osd.0 v2:172.21.15.118:6800/26580 49 ==== osd_op_reply(153 notify.4 [watch unwatch cookie 94916484874800] v32'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d400187b0 con 0x5653775c80d0 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.305+0000 7f1d4794ae40 20 remove_watcher() i=4 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.305+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94916484878624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775aa2c0 con 0x5653775cd050 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.305+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 41 ==== osd_op_reply(154 notify.5 [watch unwatch cookie 94916484878624] v32'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.305+0000 7f1d4794ae40 20 remove_watcher() i=5 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.305+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94916484884576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775aa2c0 con 0x5653775cd050 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.309+0000 7f1d44c7e700 1 -- 172.21.15.167:0/3372468269 <== osd.3 v2:172.21.15.167:6800/26773 42 ==== osd_op_reply(155 notify.6 [watch unwatch cookie 94916484884576] v32'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d30024040 con 0x5653775cd050 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.309+0000 7f1d4794ae40 20 remove_watcher() i=6 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.309+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:156 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94916484887568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775aa2c0 con 0x7f1d40045040 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.309+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.2 v2:172.21.15.167:6816/26774 39 ==== osd_op_reply(156 notify.7 [watch unwatch cookie 94916484887568] v32'245 uv243 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x7f1d40045040 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.309+0000 7f1d4794ae40 20 remove_watcher() i=7 2023-10-05T19:52:03.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d167e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:157 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94916484889136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5653775aa2c0 con 0x565377595470 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(157 data_loggenerations_metadata [watch unwatch cookie 94916484889136] v32'233 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1d38033040 con 0x565377595470 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5653775c80d0 msgr2=0x5653775ca4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x5653775c80d0 0x5653775ca4b0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565377595470 msgr2=0x5653775c6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x565377595470 0x5653775c6040 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1d40045040 msgr2=0x7f1d4003aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f1d40045040 0x7f1d4003aa10 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5653775cd050 msgr2=0x5653775cf430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x5653775cd050 0x5653775cf430 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1d28030c00 msgr2=0x7f1d280330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1d28030c00 0x7f1d280330b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d30004170 tx=0x7f1d30001400 comp rx=0 tx=0).stop 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 msgr2=0x5653775ba5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d45c80700 1 -- 172.21.15.167:0/3372468269 reap_dead start 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775ba5f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1d40005d80 tx=0x7f1d4001d000 comp rx=0 tx=0).stop 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 shutdown_connections 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/3372468269 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x565377594b60 0x5653775ba5f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 >> 172.21.15.167:0/3372468269 conn(0x5653775085d0 msgr2=0x5653775ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 shutdown_connections 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.313+0000 7f1d4794ae40 1 -- 172.21.15.167:0/3372468269 wait complete. 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 -- 172.21.15.167:0/68965839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1c8c030c50 msgr2=0x7f1c8c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/68965839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1c8c030c50 0x7f1c8c033100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5653775d7f70 tx=0x7f1d3800e040 comp rx=0 tx=0).stop 2023-10-05T19:52:03.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 -- 172.21.15.167:0/68965839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 msgr2=0x5653775eb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/68965839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775eb790 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000b960 tx=0x7f1d30037000 comp rx=0 tx=0).stop 2023-10-05T19:52:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 -- 172.21.15.167:0/68965839 shutdown_connections 2023-10-05T19:52:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/68965839 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f1c8c030c50 0x7f1c8c033100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 --2- 172.21.15.167:0/68965839 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x5653775e5cb0 0x5653775eb790 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 -- 172.21.15.167:0/68965839 >> 172.21.15.167:0/68965839 conn(0x5653775e1070 msgr2=0x5653775df110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 -- 172.21.15.167:0/68965839 shutdown_connections 2023-10-05T19:52:03.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:03.317+0000 7f1d4794ae40 1 -- 172.21.15.167:0/68965839 wait complete. 2023-10-05T19:52:03.398 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:08.410 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:52:08.410 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2023-10-05T19:52:08.410 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2023-10-05T19:52:08.410 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2023-10-05T19:52:08.410 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2023-10-05T19:52:08.457 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:08.457 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:08.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6f723e40 1 Processor -- start 2023-10-05T19:52:08.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6f723e40 1 -- start start 2023-10-05T19:52:08.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6f723e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55eb6e258e40 0x55eb6e25b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6f723e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55eb6e1a2bd0 con 0x55eb6e254860 2023-10-05T19:52:08.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6f723e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55eb6e15fee0 con 0x55eb6e258e40 2023-10-05T19:52:08.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6ca57700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55eb6e258e40 0x55eb6e25b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6d258700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55eb6e254860 0x55eb6e254c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:34568/0 (socket says 172.21.15.167:34568) 2023-10-05T19:52:08.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6d258700 1 -- 172.21.15.167:0/1674571933 learned_addr learned my addr 172.21.15.167:0/1674571933 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:08.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6ca57700 1 -- 172.21.15.167:0/1674571933 >> v1:172.21.15.118:6789/0 conn(0x55eb6e254860 legacy=0x55eb6e254c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6ca57700 1 -- 172.21.15.167:0/1674571933 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb6e255470 con 0x55eb6e258e40 2023-10-05T19:52:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e6ca57700 1 --2- 172.21.15.167:0/1674571933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e258e40 0x55eb6e25b220 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800a5d0 tx=0x7f6e58005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881178f6c5f571de server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e67fff700 1 -- 172.21.15.167:0/1674571933 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e580086a0 con 0x55eb6e258e40 2023-10-05T19:52:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e67fff700 1 -- 172.21.15.167:0/1674571933 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e58008800 con 0x55eb6e258e40 2023-10-05T19:52:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.453+0000 7f6e67fff700 1 -- 172.21.15.167:0/1674571933 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e58008ad0 con 0x55eb6e258e40 2023-10-05T19:52:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1674571933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e258e40 msgr2=0x55eb6e25b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1674571933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e258e40 0x55eb6e25b220 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800a5d0 tx=0x7f6e58005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1674571933 shutdown_connections 2023-10-05T19:52:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1674571933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e258e40 0x55eb6e25b220 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.461 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1674571933 >> 172.21.15.167:0/1674571933 conn(0x55eb6e250280 msgr2=0x55eb6e252690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1674571933 shutdown_connections 2023-10-05T19:52:08.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1674571933 wait complete. 2023-10-05T19:52:08.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 Processor -- start 2023-10-05T19:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- start start 2023-10-05T19:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e274bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6e123e30 con 0x55eb6e254860 2023-10-05T19:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6d258700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e274bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6d258700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e274bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36498/0 (socket says 172.21.15.167:36498) 2023-10-05T19:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6d258700 1 -- 172.21.15.167:0/1853268655 learned_addr learned my addr 172.21.15.167:0/1853268655 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6d258700 1 -- 172.21.15.167:0/1853268655 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58005cf0 con 0x55eb6e254860 2023-10-05T19:52:08.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6d258700 1 --2- 172.21.15.167:0/1853268655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e274bc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6e60001bf0 tx=0x7f6e600017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c001c0686971f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e66ffd700 1 -- 172.21.15.167:0/1853268655 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e6000bc80 con 0x55eb6e254860 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e66ffd700 1 -- 172.21.15.167:0/1853268655 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6000bde0 con 0x55eb6e254860 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e66ffd700 1 -- 172.21.15.167:0/1853268655 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e6000e5d0 con 0x55eb6e254860 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1853268655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 msgr2=0x55eb6e274bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1853268655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e274bc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6e60001bf0 tx=0x7f6e600017a0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1853268655 shutdown_connections 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1853268655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e274bc0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1853268655 >> 172.21.15.167:0/1853268655 conn(0x55eb6e250280 msgr2=0x55eb6e1c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1853268655 shutdown_connections 2023-10-05T19:52:08.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.457+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1853268655 wait complete. 2023-10-05T19:52:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6f723e40 1 Processor -- start 2023-10-05T19:52:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6f723e40 1 -- start start 2023-10-05T19:52:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6f723e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e2709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.467 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6f723e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6e0f6ed0 con 0x55eb6e254860 2023-10-05T19:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6d258700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e2709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6d258700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e2709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36512/0 (socket says 172.21.15.167:36512) 2023-10-05T19:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 learned_addr learned my addr 172.21.15.167:0/901139019 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb6e1a2bd0 con 0x55eb6e254860 2023-10-05T19:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6d258700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e2709f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6e60001270 tx=0x7f6e60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e657fa700 1 -- 172.21.15.167:0/901139019 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e6001f070 con 0x55eb6e254860 2023-10-05T19:52:08.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eb6e270f30 con 0x55eb6e254860 2023-10-05T19:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e657fa700 1 -- 172.21.15.167:0/901139019 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e60018760 con 0x55eb6e254860 2023-10-05T19:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e657fa700 1 -- 172.21.15.167:0/901139019 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e60018a50 con 0x55eb6e254860 2023-10-05T19:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb6e26f2f0 con 0x55eb6e254860 2023-10-05T19:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.461+0000 7f6e657fa700 1 -- 172.21.15.167:0/901139019 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f6e60018c40 con 0x55eb6e254860 2023-10-05T19:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e657fa700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c00 0x7f6e500330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e657fa700 1 -- 172.21.15.167:0/901139019 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f6e60045240 con 0x55eb6e254860 2023-10-05T19:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6ca57700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c00 0x7f6e500330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55eb6e258e40 0x55eb6e289650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e289c60 con 0x55eb6e258e40 2023-10-05T19:52:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6da59700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55eb6e258e40 0x55eb6e289650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6ca57700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c00 0x7f6e500330b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6e58005a90 tx=0x7f6e58015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6da59700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55eb6e258e40 0x55eb6e289650 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 20 realm 2023-10-05T19:52:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e286cb0 con 0x55eb6e258e40 2023-10-05T19:52:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:08.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e28a740 con 0x55eb6e258e40 2023-10-05T19:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55eb6e28b570 0x55eb6e28d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e28de90 con 0x55eb6e28b570 2023-10-05T19:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6d258700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55eb6e28b570 0x55eb6e28d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.465+0000 7f6e6d258700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55eb6e28b570 0x55eb6e28d950 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6f723e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e28e730 con 0x55eb6e258e40 2023-10-05T19:52:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6f723e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6f723e40 20 searching for the correct realm 2023-10-05T19:52:08.478 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55eb6e2904f0 0x55eb6e2928d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e2904f0 2023-10-05T19:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6ca57700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55eb6e2904f0 0x55eb6e2928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6ca57700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55eb6e2904f0 0x55eb6e2928d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e28b570 2023-10-05T19:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6d258700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6e6002d020 0x7f6e60017430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x7f6e6002d020 2023-10-05T19:52:08.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.469+0000 7f6e6da59700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6e6002d020 0x7f6e60017430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6da59700 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6e6002d020 0x7f6e60017430 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.480 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e2904f0 2023-10-05T19:52:08.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e28b570 2023-10-05T19:52:08.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.473+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e28b570 2023-10-05T19:52:08.482 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x7f6e6002d020 2023-10-05T19:52:08.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x7f6e6002d020 2023-10-05T19:52:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e28b570 2023-10-05T19:52:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e2904f0 2023-10-05T19:52:08.485 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.477+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e28b570 2023-10-05T19:52:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e2904f0 2023-10-05T19:52:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e2904f0 2023-10-05T19:52:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.489 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x7f6e6002d020 2023-10-05T19:52:08.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.481+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e258e40 2023-10-05T19:52:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x7f6e6002d020 2023-10-05T19:52:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e2904f0 2023-10-05T19:52:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x7f6e6002d020 2023-10-05T19:52:08.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e28b570 2023-10-05T19:52:08.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e28b570 2023-10-05T19:52:08.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e2904f0 2023-10-05T19:52:08.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.485+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e28b570 2023-10-05T19:52:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e292e10 con 0x55eb6e28b570 2023-10-05T19:52:08.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:08.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:08.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:08.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:08.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e28f2a0 con 0x55eb6e258e40 2023-10-05T19:52:08.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e28fbf0 con 0x55eb6e28b570 2023-10-05T19:52:08.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e2931c0 con 0x55eb6e28b570 2023-10-05T19:52:08.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:08.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.489+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e293570 con 0x55eb6e2904f0 2023-10-05T19:52:08.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e293920 con 0x55eb6e258e40 2023-10-05T19:52:08.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e28f790 con 0x55eb6e28b570 2023-10-05T19:52:08.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6f723e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e2904f0 2023-10-05T19:52:08.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e28b570 2023-10-05T19:52:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.493+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x7f6e6002d020 2023-10-05T19:52:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e2904f0 2023-10-05T19:52:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e28b570 2023-10-05T19:52:08.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.497+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e28b570 2023-10-05T19:52:08.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x7f6e6002d020 2023-10-05T19:52:08.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x7f6e6002d020 2023-10-05T19:52:08.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e28b570 2023-10-05T19:52:08.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e2904f0 2023-10-05T19:52:08.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.501+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e28b570 2023-10-05T19:52:08.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e2904f0 2023-10-05T19:52:08.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.505+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e2904f0 2023-10-05T19:52:08.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x7f6e6002d020 2023-10-05T19:52:08.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e258e40 2023-10-05T19:52:08.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x7f6e6002d020 2023-10-05T19:52:08.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e2904f0 2023-10-05T19:52:08.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x7f6e6002d020 2023-10-05T19:52:08.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.509+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e28b570 2023-10-05T19:52:08.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e28b570 2023-10-05T19:52:08.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e2904f0 2023-10-05T19:52:08.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e28b570 2023-10-05T19:52:08.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e295220 con 0x55eb6e28b570 2023-10-05T19:52:08.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6f723e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:08.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6f723e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:08.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6f723e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:08.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6f723e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:08.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e294210 con 0x55eb6e28b570 2023-10-05T19:52:08.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6f723e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.513+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e294210 con 0x55eb6e258e40 2023-10-05T19:52:08.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:08.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e294b00 con 0x55eb6e28b570 2023-10-05T19:52:08.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e294b00 con 0x55eb6e28b570 2023-10-05T19:52:08.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:08.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e294b00 con 0x7f6e6002d020 2023-10-05T19:52:08.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 zone default found 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 4 Realm: () 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 zonegroup default 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e294b00 con 0x7f6e6002d020 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.517+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e294b00 con 0x55eb6e2904f0 2023-10-05T19:52:08.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.521+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.521+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.521+0000 7f6e6f723e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.521+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e296f50 con 0x55eb6e2904f0 2023-10-05T19:52:08.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.521+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.521+0000 7f6e6f723e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.521+0000 7f6e6f723e40 20 started sync module instance, tier type = 2023-10-05T19:52:08.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.521+0000 7f6e6f723e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:08.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.521+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e296610 con 0x55eb6e28b570 2023-10-05T19:52:08.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.525+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.525+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94469653874192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e296610 con 0x55eb6e28b570 2023-10-05T19:52:08.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.525+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e2977f0 con 0x55eb6e258e40 2023-10-05T19:52:08.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.525+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.525+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94469653874192] v32'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.525+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94469653885696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e296610 con 0x55eb6e258e40 2023-10-05T19:52:08.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.525+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e297df0 con 0x55eb6e28b570 2023-10-05T19:52:08.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.529+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94469653885696] v32'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.529+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.529+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94469653882672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e297db0 con 0x55eb6e28b570 2023-10-05T19:52:08.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.529+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e298690 con 0x7f6e6002d020 2023-10-05T19:52:08.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.529+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.529+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94469653882672] v32'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.529+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94469653887168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e298200 con 0x7f6e6002d020 2023-10-05T19:52:08.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.529+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e298f80 con 0x55eb6e28b570 2023-10-05T19:52:08.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.533+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94469653887168] v32'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.533+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.533+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94469653892288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e298200 con 0x55eb6e28b570 2023-10-05T19:52:08.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.533+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e2999e0 con 0x55eb6e2904f0 2023-10-05T19:52:08.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.533+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94469653892288] v32'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.533+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.533+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94469653888272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e298160 con 0x55eb6e2904f0 2023-10-05T19:52:08.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.533+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e29a770 con 0x55eb6e2904f0 2023-10-05T19:52:08.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94469653888272] v32'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94469653897152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e29b010 con 0x55eb6e2904f0 2023-10-05T19:52:08.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e29b8b0 con 0x7f6e6002d020 2023-10-05T19:52:08.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94469653897152] v32'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e58012450 con 0x55eb6e2904f0 2023-10-05T19:52:08.543 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'246 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94469653902272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e29bd00 con 0x7f6e6002d020 2023-10-05T19:52:08.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 20 add_watcher() i=0 2023-10-05T19:52:08.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 20 add_watcher() i=1 2023-10-05T19:52:08.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 20 add_watcher() i=2 2023-10-05T19:52:08.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 20 add_watcher() i=3 2023-10-05T19:52:08.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 20 add_watcher() i=4 2023-10-05T19:52:08.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 20 add_watcher() i=5 2023-10-05T19:52:08.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.537+0000 7f6e6f723e40 20 add_watcher() i=6 2023-10-05T19:52:08.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94469653902272] v32'247 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x7f6e6002d020 2023-10-05T19:52:08.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6f723e40 20 add_watcher() i=7 2023-10-05T19:52:08.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6f723e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:08.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e29eda0 con 0x55eb6e258e40 2023-10-05T19:52:08.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94469653903376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e29c150 con 0x55eb6e258e40 2023-10-05T19:52:08.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94469653903376] v32'234 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6e6800a5a0 con 0x55eb6e258e40 2023-10-05T19:52:08.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e3e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:08.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6f723e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:08.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6f723e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:08.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6f723e40 1 Processor -- start 2023-10-05T19:52:08.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.541+0000 7f6e6f723e40 1 -- start start 2023-10-05T19:52:08.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6e2a9f20 con 0x55eb6e2a9610 2023-10-05T19:52:08.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6ca57700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6ca57700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36516/0 (socket says 172.21.15.167:36516) 2023-10-05T19:52:08.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6ca57700 1 -- 172.21.15.167:0/1132143077 learned_addr learned my addr 172.21.15.167:0/1132143077 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6ca57700 1 -- 172.21.15.167:0/1132143077 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb6e2aa060 con 0x55eb6e2a9610 2023-10-05T19:52:08.550 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6ca57700 1 --2- 172.21.15.167:0/1132143077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2a99e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55eb6e2558e0 tx=0x7f6e58012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa52832394f8e5aa server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e3dfe3700 1 -- 172.21.15.167:0/1132143077 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e5802d040 con 0x55eb6e2a9610 2023-10-05T19:52:08.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e3dfe3700 1 -- 172.21.15.167:0/1132143077 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e58028890 con 0x55eb6e2a9610 2023-10-05T19:52:08.551 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e3dfe3700 1 -- 172.21.15.167:0/1132143077 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e58012940 con 0x55eb6e2a9610 2023-10-05T19:52:08.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1132143077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 msgr2=0x55eb6e2a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1132143077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2a99e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55eb6e2558e0 tx=0x7f6e58012000 comp rx=0 tx=0).stop 2023-10-05T19:52:08.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1132143077 shutdown_connections 2023-10-05T19:52:08.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1132143077 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2a99e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1132143077 >> 172.21.15.167:0/1132143077 conn(0x55eb6e2a49d0 msgr2=0x55eb6e2a2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1132143077 shutdown_connections 2023-10-05T19:52:08.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1132143077 wait complete. 2023-10-05T19:52:08.552 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 Processor -- start 2023-10-05T19:52:08.553 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.545+0000 7f6e6f723e40 1 -- start start 2023-10-05T19:52:08.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6f723e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6f723e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6e2b0090 con 0x55eb6e2a9610 2023-10-05T19:52:08.554 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6ca57700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6ca57700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36520/0 (socket says 172.21.15.167:36520) 2023-10-05T19:52:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6ca57700 1 -- 172.21.15.167:0/1528699099 learned_addr learned my addr 172.21.15.167:0/1528699099 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6ca57700 1 -- 172.21.15.167:0/1528699099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb6e255470 con 0x55eb6e2a9610 2023-10-05T19:52:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6ca57700 1 --2- 172.21.15.167:0/1528699099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2af090 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6e58008d10 tx=0x7f6e5802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6daffff700 1 -- 172.21.15.167:0/1528699099 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e58033920 con 0x55eb6e2a9610 2023-10-05T19:52:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6daffff700 1 -- 172.21.15.167:0/1528699099 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5803f070 con 0x55eb6e2a9610 2023-10-05T19:52:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1528699099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eb6e2af690 con 0x55eb6e2a9610 2023-10-05T19:52:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6daffff700 1 -- 172.21.15.167:0/1528699099 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e58033ae0 con 0x55eb6e2a9610 2023-10-05T19:52:08.555 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1528699099 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb6e2afad0 con 0x55eb6e2a9610 2023-10-05T19:52:08.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6daffff700 1 -- 172.21.15.167:0/1528699099 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f6e58033c40 con 0x55eb6e2a9610 2023-10-05T19:52:08.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6daffff700 1 --2- 172.21.15.167:0/1528699099 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6db4030c50 0x7f6db4033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6daffff700 1 -- 172.21.15.167:0/1528699099 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f6e58041070 con 0x55eb6e2a9610 2023-10-05T19:52:08.556 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6da59700 1 --2- 172.21.15.167:0/1528699099 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6db4030c50 0x7f6db4033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.549+0000 7f6e6f723e40 5 note: GC not initialized 2023-10-05T19:52:08.557 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6e6da59700 1 --2- 172.21.15.167:0/1528699099 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6db4030c50 0x7f6db4033100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55eb6e29ef00 tx=0x7f6e6800d5f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.558 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6dad7fa700 20 reqs_thread_entry: start 2023-10-05T19:52:08.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6e6f723e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:08.559 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6da6ffd700 20 reqs_thread_entry: start 2023-10-05T19:52:08.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6e6f723e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:08.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6da57fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:38 2023 2023-10-05T19:52:08.560 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:08.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6da4ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:08.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6e6f723e40 20 get_system_obj_state: rctx=0x7ffe1d9dd988 obj=default.rgw.meta:users.uid:fud state=0x55eb6e12f0b0 s->prefetch_data=0 2023-10-05T19:52:08.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6e6f723e40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T19:52:08.560 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e3178c0 con 0x7f6e6002d020 2023-10-05T19:52:08.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.553+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 fud [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f6e6803d050 con 0x7f6e6002d020 2023-10-05T19:52:08.561 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-10-05T19:52:08.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:52:08.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 20 get_system_obj_state: rctx=0x7ffe1d9dd678 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x55eb6e12f0b0 s->prefetch_data=0 2023-10-05T19:52:08.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-10-05T19:52:08.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:103 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e3178c0 con 0x55eb6e2904f0 2023-10-05T19:52:08.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(103 p5YnriCv1nAtykxBrupQ [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f6e58039020 con 0x55eb6e2904f0 2023-10-05T19:52:08.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-10-05T19:52:08.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:52:08.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 20 get_system_obj_state: rctx=0x7ffe1d9dcf18 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x55eb6e12f0b0 s->prefetch_data=0 2023-10-05T19:52:08.562 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T19:52:08.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 20 get_system_obj_state: rctx=0x7ffe1d9dd5b8 obj=default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ state=0x55eb6e12f0b0 s->prefetch_data=0 2023-10-05T19:52:08.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-10-05T19:52:08.563 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e319f20 con 0x7f6e6002d020 2023-10-05T19:52:08.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(104 fud [delete,create,call,writefull 0~346] v32'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f6e6803d050 con 0x7f6e6002d020 2023-10-05T19:52:08.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-10-05T19:52:08.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:52:08.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-10-05T19:52:08.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 7.3 7:c609908c:::notify.5:head [notify cookie 94469654411024 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e31abc0 con 0x55eb6e2904f0 2023-10-05T19:52:08.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== watch-notify(notify (1) cookie 94469653888272 notify 137438953494 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x55eb6e2afad0 con 0x55eb6e2904f0 2023-10-05T19:52:08.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e66ffd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94469653888272 notifier 4727 bl.length()=522 2023-10-05T19:52:08.564 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e66ffd700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-10-05T19:52:08.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e66ffd700 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:52:08.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(105 notify.5 [notify cookie 94469654411024 out=8b] v0'0 uv246 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6e58039020 con 0x55eb6e2904f0 2023-10-05T19:52:08.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.557+0000 7f6e66ffd700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6e4c003d90 con 0x55eb6e2904f0 2023-10-05T19:52:08.565 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(106 notify.5 [notify-ack] v0'0 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e58039020 con 0x55eb6e2904f0 2023-10-05T19:52:08.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== watch-notify(notify_complete (2) cookie 94469654411024 notify 137438953494 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eb6e2af690 con 0x55eb6e2904f0 2023-10-05T19:52:08.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e31abc0 con 0x55eb6e2904f0 2023-10-05T19:52:08.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(107 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f6e58039020 con 0x55eb6e2904f0 2023-10-05T19:52:08.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6f723e40 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T19:52:08.566 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6f723e40 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:52:08.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6f723e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T19:52:08.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94469654423056 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e31abc0 con 0x55eb6e28b570 2023-10-05T19:52:08.567 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94469653882672 notify 137438953511 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55eb6e26f2f0 con 0x55eb6e28b570 2023-10-05T19:52:08.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(108 notify.2 [notify cookie 94469654423056 out=8b] v0'0 uv246 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e667fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94469653882672 notifier 4727 bl.length()=177 2023-10-05T19:52:08.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e667fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-10-05T19:52:08.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e667fc700 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-10-05T19:52:08.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e667fc700 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6dbc003450 con 0x55eb6e28b570 2023-10-05T19:52:08.568 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.569 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.561+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94469654423056 notify 137438953511 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55eb6e270f30 con 0x55eb6e28b570 2023-10-05T19:52:08.569 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:08.569 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "fud", 2023-10-05T19:52:08.569 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Fud", 2023-10-05T19:52:08.569 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "", 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 4, 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "fud", 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "p5YnriCv1nAtykxBrupQ", 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh" 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:08.570 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [], 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:52:08.571 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:52:08.572 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:52:08.572 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:52:08.572 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:08.572 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:52:08.572 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:52:08.572 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:52:08.572 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:52:08.572 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:52:08.572 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:52:08.573 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:08.573 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:52:08.573 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:52:08.573 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:52:08.573 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:08.573 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:52:08.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.565+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94469653874192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e26a260 con 0x55eb6e28b570 2023-10-05T19:52:08.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.565+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94469653874192] v32'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.565+0000 7f6e6f723e40 20 remove_watcher() i=0 2023-10-05T19:52:08.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.565+0000 7f6e6f723e40 2 removed watcher, disabling cache 2023-10-05T19:52:08.575 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.565+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94469653885696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e26a260 con 0x55eb6e258e40 2023-10-05T19:52:08.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.569+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94469653885696] v32'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e6803d050 con 0x55eb6e258e40 2023-10-05T19:52:08.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.569+0000 7f6e6f723e40 20 remove_watcher() i=1 2023-10-05T19:52:08.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.569+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94469653882672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e26a260 con 0x55eb6e28b570 2023-10-05T19:52:08.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.569+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94469653882672] v32'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.569+0000 7f6e6f723e40 20 remove_watcher() i=2 2023-10-05T19:52:08.576 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.569+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94469653887168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e26a260 con 0x7f6e6002d020 2023-10-05T19:52:08.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.573+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94469653887168] v32'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e6803d050 con 0x7f6e6002d020 2023-10-05T19:52:08.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.573+0000 7f6e6f723e40 20 remove_watcher() i=3 2023-10-05T19:52:08.577 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.573+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94469653892288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e26a260 con 0x55eb6e28b570 2023-10-05T19:52:08.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.573+0000 7f6e6d258700 1 -- 172.21.15.167:0/901139019 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94469653892288] v32'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e60014070 con 0x55eb6e28b570 2023-10-05T19:52:08.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.573+0000 7f6e6f723e40 20 remove_watcher() i=4 2023-10-05T19:52:08.581 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.573+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94469653888272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e26a260 con 0x55eb6e2904f0 2023-10-05T19:52:08.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.577+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94469653888272] v32'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e58039020 con 0x55eb6e2904f0 2023-10-05T19:52:08.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.577+0000 7f6e6f723e40 20 remove_watcher() i=5 2023-10-05T19:52:08.582 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.577+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94469653897152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e26a260 con 0x55eb6e2904f0 2023-10-05T19:52:08.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.577+0000 7f6e6ca57700 1 -- 172.21.15.167:0/901139019 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94469653897152] v32'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e58039020 con 0x55eb6e2904f0 2023-10-05T19:52:08.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.577+0000 7f6e6f723e40 20 remove_watcher() i=6 2023-10-05T19:52:08.583 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.577+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94469653902272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e26a260 con 0x7f6e6002d020 2023-10-05T19:52:08.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.581+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94469653902272] v32'248 uv246 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6e6803d050 con 0x7f6e6002d020 2023-10-05T19:52:08.585 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.581+0000 7f6e6f723e40 20 remove_watcher() i=7 2023-10-05T19:52:08.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.581+0000 7f6e3e7e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:08.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.581+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94469653903376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb6e26a260 con 0x55eb6e258e40 2023-10-05T19:52:08.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94469653903376] v32'235 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6e6803d050 con 0x55eb6e258e40 2023-10-05T19:52:08.592 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55eb6e28b570 msgr2=0x55eb6e28d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55eb6e28b570 0x55eb6e28d950 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55eb6e258e40 msgr2=0x55eb6e289650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55eb6e258e40 0x55eb6e289650 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6e6002d020 msgr2=0x7f6e60017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f6e6002d020 0x7f6e60017430 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55eb6e2904f0 msgr2=0x55eb6e2928d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55eb6e2904f0 0x55eb6e2928d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c00 msgr2=0x7f6e500330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6e50030c00 0x7f6e500330b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6e58005a90 tx=0x7f6e58015000 comp rx=0 tx=0).stop 2023-10-05T19:52:08.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 msgr2=0x55eb6e2709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6da59700 1 -- 172.21.15.167:0/901139019 reap_dead start 2023-10-05T19:52:08.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e2709f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6e60001270 tx=0x7f6e60016000 comp rx=0 tx=0).stop 2023-10-05T19:52:08.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 shutdown_connections 2023-10-05T19:52:08.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/901139019 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e254860 0x55eb6e2709f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 >> 172.21.15.167:0/901139019 conn(0x55eb6e250280 msgr2=0x55eb6e26e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 shutdown_connections 2023-10-05T19:52:08.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/901139019 wait complete. 2023-10-05T19:52:08.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1528699099 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6db4030c50 msgr2=0x7f6db4033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1528699099 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6db4030c50 0x7f6db4033100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55eb6e29ef00 tx=0x7f6e6800d5f0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1528699099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 msgr2=0x55eb6e2af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1528699099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2af090 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6e58008d10 tx=0x7f6e5802c000 comp rx=0 tx=0).stop 2023-10-05T19:52:08.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1528699099 shutdown_connections 2023-10-05T19:52:08.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1528699099 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f6db4030c50 0x7f6db4033100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 --2- 172.21.15.167:0/1528699099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55eb6e2a9610 0x55eb6e2af090 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1528699099 >> 172.21.15.167:0/1528699099 conn(0x55eb6e2a49d0 msgr2=0x55eb6e2a2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1528699099 shutdown_connections 2023-10-05T19:52:08.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.585+0000 7f6e6f723e40 1 -- 172.21.15.167:0/1528699099 wait complete. 2023-10-05T19:52:08.597 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:08.615 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:52:08.625 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2023-10-05T19:52:08.625 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2023-10-05T19:52:08.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2023-10-05T19:52:08.626 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2023-10-05T19:52:08.669 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:08.669 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:08.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.661+0000 7fb2a6caee40 1 Processor -- start 2023-10-05T19:52:08.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.661+0000 7fb2a6caee40 1 -- start start 2023-10-05T19:52:08.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.661+0000 7fb2a6caee40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55cf03a60f10 0x55cf03a632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.661+0000 7fb2a6caee40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cf039a9bd0 con 0x55cf03a5c930 2023-10-05T19:52:08.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.661+0000 7fb2a6caee40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cf03966ee0 con 0x55cf03a60f10 2023-10-05T19:52:08.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.661+0000 7fb2a3fe2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55cf03a60f10 0x55cf03a632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.661+0000 7fb2a47e3700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55cf03a5c930 0x55cf03a5cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:34580/0 (socket says 172.21.15.167:34580) 2023-10-05T19:52:08.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.661+0000 7fb2a47e3700 1 -- 172.21.15.167:0/239940629 learned_addr learned my addr 172.21.15.167:0/239940629 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:08.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/239940629 >> v1:172.21.15.118:6789/0 conn(0x55cf03a5c930 legacy=0x55cf03a5cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/239940629 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf03a5d540 con 0x55cf03a60f10 2023-10-05T19:52:08.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a3fe2700 1 --2- 172.21.15.167:0/239940629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a60f10 0x55cf03a632f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb29400a5d0 tx=0x7fb294005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca4d370ffdc191 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a37e1700 1 -- 172.21.15.167:0/239940629 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2940086a0 con 0x55cf03a60f10 2023-10-05T19:52:08.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a37e1700 1 -- 172.21.15.167:0/239940629 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294008800 con 0x55cf03a60f10 2023-10-05T19:52:08.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a37e1700 1 -- 172.21.15.167:0/239940629 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb294008ad0 con 0x55cf03a60f10 2023-10-05T19:52:08.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 -- 172.21.15.167:0/239940629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a60f10 msgr2=0x55cf03a632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/239940629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a60f10 0x55cf03a632f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb29400a5d0 tx=0x7fb294005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:08.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 -- 172.21.15.167:0/239940629 shutdown_connections 2023-10-05T19:52:08.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/239940629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a60f10 0x55cf03a632f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 -- 172.21.15.167:0/239940629 >> 172.21.15.167:0/239940629 conn(0x55cf03a58350 msgr2=0x55cf03a5a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 -- 172.21.15.167:0/239940629 shutdown_connections 2023-10-05T19:52:08.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 -- 172.21.15.167:0/239940629 wait complete. 2023-10-05T19:52:08.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 Processor -- start 2023-10-05T19:52:08.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 -- start start 2023-10-05T19:52:08.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a7b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a6caee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf0392ae30 con 0x55cf03a5c930 2023-10-05T19:52:08.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a47e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a7b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a47e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a7b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36546/0 (socket says 172.21.15.167:36546) 2023-10-05T19:52:08.674 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.665+0000 7fb2a47e3700 1 -- 172.21.15.167:0/1513437871 learned_addr learned my addr 172.21.15.167:0/1513437871 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a47e3700 1 -- 172.21.15.167:0/1513437871 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb294005cf0 con 0x55cf03a5c930 2023-10-05T19:52:08.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a47e3700 1 --2- 172.21.15.167:0/1513437871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a7b9c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb28c006fa0 tx=0x7fb28c006b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb75d02959c8ec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a27df700 1 -- 172.21.15.167:0/1513437871 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb28c006110 con 0x55cf03a5c930 2023-10-05T19:52:08.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a27df700 1 -- 172.21.15.167:0/1513437871 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c006270 con 0x55cf03a5c930 2023-10-05T19:52:08.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a27df700 1 -- 172.21.15.167:0/1513437871 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb28c004520 con 0x55cf03a5c930 2023-10-05T19:52:08.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 -- 172.21.15.167:0/1513437871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 msgr2=0x55cf03a7b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/1513437871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a7b9c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb28c006fa0 tx=0x7fb28c006b50 comp rx=0 tx=0).stop 2023-10-05T19:52:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 -- 172.21.15.167:0/1513437871 shutdown_connections 2023-10-05T19:52:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/1513437871 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a7b9c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 -- 172.21.15.167:0/1513437871 >> 172.21.15.167:0/1513437871 conn(0x55cf03a58350 msgr2=0x55cf03a77580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 -- 172.21.15.167:0/1513437871 shutdown_connections 2023-10-05T19:52:08.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 -- 172.21.15.167:0/1513437871 wait complete. 2023-10-05T19:52:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 Processor -- start 2023-10-05T19:52:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 -- start start 2023-10-05T19:52:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a82790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a6caee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf038fded0 con 0x55cf03a5c930 2023-10-05T19:52:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a47e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a82790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a47e3700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a82790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36554/0 (socket says 172.21.15.167:36554) 2023-10-05T19:52:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 learned_addr learned my addr 172.21.15.167:0/3924443894 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf039a9bd0 con 0x55cf03a5c930 2023-10-05T19:52:08.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.669+0000 7fb2a47e3700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a82790 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb28c000f80 tx=0x7fb28c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a0fdc700 1 -- 172.21.15.167:0/3924443894 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb28c013420 con 0x55cf03a5c930 2023-10-05T19:52:08.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf03a82cd0 con 0x55cf03a5c930 2023-10-05T19:52:08.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a0fdc700 1 -- 172.21.15.167:0/3924443894 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c013580 con 0x55cf03a5c930 2023-10-05T19:52:08.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a0fdc700 1 -- 172.21.15.167:0/3924443894 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb28c013850 con 0x55cf03a5c930 2023-10-05T19:52:08.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf03a83110 con 0x55cf03a5c930 2023-10-05T19:52:08.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a0fdc700 1 -- 172.21.15.167:0/3924443894 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fb28c01a070 con 0x55cf03a5c930 2023-10-05T19:52:08.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a0fdc700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb284030c00 0x7fb2840330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a0fdc700 1 -- 172.21.15.167:0/3924443894 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7fb28c044ee0 con 0x55cf03a5c930 2023-10-05T19:52:08.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55cf03a60f10 0x55cf03a8e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a8e9b0 con 0x55cf03a60f10 2023-10-05T19:52:08.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a3fe2700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb284030c00 0x7fb2840330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a4fe4700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55cf03a60f10 0x55cf03a8e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.673+0000 7fb2a3fe2700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb284030c00 0x7fb2840330b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb294005a90 tx=0x7fb294015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a4fe4700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55cf03a60f10 0x55cf03a8e340 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb29c00a500 con 0x55cf03a60f10 2023-10-05T19:52:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 20 realm 2023-10-05T19:52:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a8b9a0 con 0x55cf03a60f10 2023-10-05T19:52:08.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb29c00a500 con 0x55cf03a60f10 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a8f490 con 0x55cf03a60f10 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb29c00a500 con 0x55cf03a60f10 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55cf03a902c0 0x55cf03a926a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a92be0 con 0x55cf03a902c0 2023-10-05T19:52:08.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a47e3700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55cf03a902c0 0x55cf03a926a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a47e3700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55cf03a902c0 0x55cf03a926a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.677+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a93480 con 0x55cf03a60f10 2023-10-05T19:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb29c00a500 con 0x55cf03a60f10 2023-10-05T19:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a6caee40 20 searching for the correct realm 2023-10-05T19:52:08.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55cf03a95240 0x55cf03a97620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a95240 2023-10-05T19:52:08.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a3fe2700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55cf03a95240 0x55cf03a97620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a3fe2700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55cf03a95240 0x55cf03a97620 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a902c0 2023-10-05T19:52:08.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a47e3700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb28c01ec10 0x7fb28c01fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x7fb28c01ec10 2023-10-05T19:52:08.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a4fe4700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb28c01ec10 0x7fb28c01fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.681+0000 7fb2a4fe4700 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb28c01ec10 0x7fb28c01fa80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x7fb28c01ec10 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a95240 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a902c0 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.685+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a902c0 2023-10-05T19:52:08.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x7fb28c01ec10 2023-10-05T19:52:08.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x7fb28c01ec10 2023-10-05T19:52:08.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x7fb28c01ec10 2023-10-05T19:52:08.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x7fb28c01ec10 2023-10-05T19:52:08.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a902c0 2023-10-05T19:52:08.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.689+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a95240 2023-10-05T19:52:08.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.697 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a902c0 2023-10-05T19:52:08.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a95240 2023-10-05T19:52:08.698 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.693+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a95240 2023-10-05T19:52:08.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x7fb28c01ec10 2023-10-05T19:52:08.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x7fb28c01ec10 2023-10-05T19:52:08.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a60f10 2023-10-05T19:52:08.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x7fb28c01ec10 2023-10-05T19:52:08.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x7fb28c01ec10 2023-10-05T19:52:08.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a95240 2023-10-05T19:52:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x7fb28c01ec10 2023-10-05T19:52:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x7fb28c01ec10 2023-10-05T19:52:08.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a902c0 2023-10-05T19:52:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.697+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a902c0 2023-10-05T19:52:08.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a95240 2023-10-05T19:52:08.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.705 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a902c0 2023-10-05T19:52:08.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.706 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97b60 con 0x55cf03a902c0 2023-10-05T19:52:08.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a6caee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:08.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a6caee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:08.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a6caee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:08.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a6caee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:08.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a93ff0 con 0x55cf03a60f10 2023-10-05T19:52:08.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.708 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.701+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a94940 con 0x55cf03a902c0 2023-10-05T19:52:08.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a97f10 con 0x55cf03a902c0 2023-10-05T19:52:08.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:08.710 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a982c0 con 0x55cf03a95240 2023-10-05T19:52:08.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a944e0 con 0x55cf03a902c0 2023-10-05T19:52:08.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a99f70 con 0x55cf03a95240 2023-10-05T19:52:08.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.705+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a99f70 con 0x55cf03a902c0 2023-10-05T19:52:08.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a99f70 con 0x7fb28c01ec10 2023-10-05T19:52:08.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x7fb28c01ec10 2023-10-05T19:52:08.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a95240 2023-10-05T19:52:08.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.715 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.709+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a902c0 2023-10-05T19:52:08.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a902c0 2023-10-05T19:52:08.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.717 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x7fb28c01ec10 2023-10-05T19:52:08.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x7fb28c01ec10 2023-10-05T19:52:08.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x7fb28c01ec10 2023-10-05T19:52:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x7fb28c01ec10 2023-10-05T19:52:08.719 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a902c0 2023-10-05T19:52:08.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.713+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a95240 2023-10-05T19:52:08.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.721 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a902c0 2023-10-05T19:52:08.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a95240 2023-10-05T19:52:08.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c014040 con 0x55cf03a60f10 2023-10-05T19:52:08.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.717+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a95240 2023-10-05T19:52:08.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.725 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x7fb28c01ec10 2023-10-05T19:52:08.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a60f10 2023-10-05T19:52:08.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x7fb28c01ec10 2023-10-05T19:52:08.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a95240 2023-10-05T19:52:08.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.721+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x7fb28c01ec10 2023-10-05T19:52:08.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a902c0 2023-10-05T19:52:08.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a902c0 2023-10-05T19:52:08.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a95240 2023-10-05T19:52:08.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a902c0 2023-10-05T19:52:08.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.731 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98670 con 0x55cf03a902c0 2023-10-05T19:52:08.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a6caee40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:08.732 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a6caee40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:08.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a6caee40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:08.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a6caee40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:08.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.733 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.725+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a98f60 con 0x55cf03a902c0 2023-10-05T19:52:08.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a99310 con 0x55cf03a60f10 2023-10-05T19:52:08.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:08.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.734 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a99bb0 con 0x55cf03a902c0 2023-10-05T19:52:08.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.735 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a99bb0 con 0x55cf03a902c0 2023-10-05T19:52:08.736 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.729+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a99bb0 con 0x7fb28c01ec10 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 zone default found 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 4 Realm: () 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 zonegroup default 2023-10-05T19:52:08.737 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.738 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a99bb0 con 0x7fb28c01ec10 2023-10-05T19:52:08.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9b530 con 0x55cf03a95240 2023-10-05T19:52:08.739 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9b8e0 con 0x55cf03a95240 2023-10-05T19:52:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 started sync module instance, tier type = 2023-10-05T19:52:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:08.740 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.733+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9ac40 con 0x55cf03a902c0 2023-10-05T19:52:08.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.737+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.737+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94347608041584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9bc90 con 0x55cf03a902c0 2023-10-05T19:52:08.741 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.737+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9c530 con 0x55cf03a60f10 2023-10-05T19:52:08.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.737+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.743 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.737+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94347608046736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9c5d0 con 0x55cf03a60f10 2023-10-05T19:52:08.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.737+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9d160 con 0x55cf03a902c0 2023-10-05T19:52:08.744 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.737+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94347608041584] v32'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.741+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94347608046736] v32'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.741+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.741+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94347608042688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9c0e0 con 0x55cf03a902c0 2023-10-05T19:52:08.746 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.741+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9da50 con 0x7fb28c01ec10 2023-10-05T19:52:08.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.741+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.741+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94347608053088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9c0e0 con 0x7fb28c01ec10 2023-10-05T19:52:08.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.741+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9e390 con 0x55cf03a902c0 2023-10-05T19:52:08.748 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.741+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94347608042688] v32'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.745+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94347608053088] v32'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.745+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.745+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94347608050736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9c0e0 con 0x55cf03a902c0 2023-10-05T19:52:08.750 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.745+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9e560 con 0x55cf03a95240 2023-10-05T19:52:08.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.745+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.745+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94347608055920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9ee50 con 0x55cf03a95240 2023-10-05T19:52:08.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.745+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9f8a0 con 0x55cf03a95240 2023-10-05T19:52:08.752 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94347608050736] v32'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v32'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94347608055920] v32'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94347608054192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9fca0 con 0x55cf03a95240 2023-10-05T19:52:08.754 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03aa0540 con 0x7fb28c01ec10 2023-10-05T19:52:08.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'249 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94347608064640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03aa0c40 con 0x7fb28c01ec10 2023-10-05T19:52:08.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 20 add_watcher() i=0 2023-10-05T19:52:08.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 20 add_watcher() i=1 2023-10-05T19:52:08.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 20 add_watcher() i=2 2023-10-05T19:52:08.756 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 20 add_watcher() i=3 2023-10-05T19:52:08.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 20 add_watcher() i=4 2023-10-05T19:52:08.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 20 add_watcher() i=5 2023-10-05T19:52:08.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94347608054192] v32'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb294012450 con 0x55cf03a95240 2023-10-05T19:52:08.757 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.749+0000 7fb2a6caee40 20 add_watcher() i=6 2023-10-05T19:52:08.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94347608064640] v32'250 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a6caee40 20 add_watcher() i=7 2023-10-05T19:52:08.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a6caee40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:08.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9e960 con 0x55cf03a60f10 2023-10-05T19:52:08.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.758 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94347608065808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03aa1130 con 0x55cf03a60f10 2023-10-05T19:52:08.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94347608065808] v32'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb275fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:08.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a6caee40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:08.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a6caee40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:08.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.753+0000 7fb2a6caee40 1 Processor -- start 2023-10-05T19:52:08.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 -- start start 2023-10-05T19:52:08.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf03ab0f40 con 0x55cf03ab0630 2023-10-05T19:52:08.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a3fe2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a3fe2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36564/0 (socket says 172.21.15.167:36564) 2023-10-05T19:52:08.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/2849054829 learned_addr learned my addr 172.21.15.167:0/2849054829 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/2849054829 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf03ab1080 con 0x55cf03ab0630 2023-10-05T19:52:08.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a3fe2700 1 --2- 172.21.15.167:0/2849054829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab0a00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x55cf03a5d9b0 tx=0x7fb294012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87074fbdc5ed5b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2757e2700 1 -- 172.21.15.167:0/2849054829 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb29402d040 con 0x55cf03ab0630 2023-10-05T19:52:08.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2757e2700 1 -- 172.21.15.167:0/2849054829 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294028890 con 0x55cf03ab0630 2023-10-05T19:52:08.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2757e2700 1 -- 172.21.15.167:0/2849054829 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb294012960 con 0x55cf03ab0630 2023-10-05T19:52:08.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 -- 172.21.15.167:0/2849054829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 msgr2=0x55cf03ab0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/2849054829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab0a00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x55cf03a5d9b0 tx=0x7fb294012000 comp rx=0 tx=0).stop 2023-10-05T19:52:08.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 -- 172.21.15.167:0/2849054829 shutdown_connections 2023-10-05T19:52:08.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/2849054829 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab0a00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 -- 172.21.15.167:0/2849054829 >> 172.21.15.167:0/2849054829 conn(0x55cf03aab9f0 msgr2=0x55cf03aa9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 -- 172.21.15.167:0/2849054829 shutdown_connections 2023-10-05T19:52:08.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 -- 172.21.15.167:0/2849054829 wait complete. 2023-10-05T19:52:08.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 Processor -- start 2023-10-05T19:52:08.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 -- start start 2023-10-05T19:52:08.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.757+0000 7fb2a6caee40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf03ab7040 con 0x55cf03ab0630 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a3fe2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a3fe2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36574/0 (socket says 172.21.15.167:36574) 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3139206801 learned_addr learned my addr 172.21.15.167:0/3139206801 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3139206801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf03a5d540 con 0x55cf03ab0630 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a3fe2700 1 --2- 172.21.15.167:0/3139206801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab6040 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55cf03aaa6b0 tx=0x7fb29402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb1ef7fe700 1 -- 172.21.15.167:0/3139206801 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb294033920 con 0x55cf03ab0630 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3139206801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cf03ab6640 con 0x55cf03ab0630 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3139206801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf03ab6a80 con 0x55cf03ab0630 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb1ef7fe700 1 -- 172.21.15.167:0/3139206801 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29403f070 con 0x55cf03ab0630 2023-10-05T19:52:08.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb1ef7fe700 1 -- 172.21.15.167:0/3139206801 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb294033a80 con 0x55cf03ab0630 2023-10-05T19:52:08.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb1ef7fe700 1 -- 172.21.15.167:0/3139206801 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fb294033be0 con 0x55cf03ab0630 2023-10-05T19:52:08.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb1ef7fe700 1 --2- 172.21.15.167:0/3139206801 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb1e4030c00 0x7fb1e40330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb1ef7fe700 1 -- 172.21.15.167:0/3139206801 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7fb294041070 con 0x55cf03ab0630 2023-10-05T19:52:08.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a4fe4700 1 --2- 172.21.15.167:0/3139206801 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb1e4030c00 0x7fb1e40330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a6caee40 5 note: GC not initialized 2023-10-05T19:52:08.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.761+0000 7fb2a4fe4700 1 --2- 172.21.15.167:0/3139206801 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb1e4030c00 0x7fb1e40330b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55cf03aa0ea0 tx=0x7fb29c00e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb1ecff9700 20 reqs_thread_entry: start 2023-10-05T19:52:08.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb1e27fc700 20 reqs_thread_entry: start 2023-10-05T19:52:08.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:08.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:08.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb1e0ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:38 2023 2023-10-05T19:52:08.770 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:08.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb1c7fff700 20 reqs_thread_entry: start 2023-10-05T19:52:08.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 20 get_system_obj_state: rctx=0x7ffc0841dd48 obj=default.rgw.meta:users.uid:bud state=0x55cf039360b0 s->prefetch_data=0 2023-10-05T19:52:08.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2023-10-05T19:52:08.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03b1e7d0 con 0x7fb28c01ec10 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 bud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x16 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 10 cache get: name=default.rgw.meta+users.uid+bud : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03b21260 con 0x7fb28c01ec10 2023-10-05T19:52:08.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 bud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T19:52:08.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2023-10-05T19:52:08.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T19:52:08.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:08.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.765+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03b228b0 con 0x7fb28c01ec10 2023-10-05T19:52:08.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.769+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(104 fud [create,call,writefull 0~181] v32'6 uv5 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.774 INFO:teuthology.orchestra.run.smithi167.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2023-10-05T19:52:08.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.769+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94347608041584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a722a0 con 0x55cf03a902c0 2023-10-05T19:52:08.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.769+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 94347608041584] v32'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.769+0000 7fb2a6caee40 20 remove_watcher() i=0 2023-10-05T19:52:08.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.769+0000 7fb2a6caee40 2 removed watcher, disabling cache 2023-10-05T19:52:08.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.769+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94347608046736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a722a0 con 0x55cf03a60f10 2023-10-05T19:52:08.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.773+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 94347608046736] v32'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.773+0000 7fb2a6caee40 20 remove_watcher() i=1 2023-10-05T19:52:08.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.773+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94347608042688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a722a0 con 0x55cf03a902c0 2023-10-05T19:52:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.777+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 94347608042688] v32'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.777+0000 7fb2a6caee40 20 remove_watcher() i=2 2023-10-05T19:52:08.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.777+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94347608053088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9ad60 con 0x7fb28c01ec10 2023-10-05T19:52:08.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.777+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 94347608053088] v32'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.777+0000 7fb2a6caee40 20 remove_watcher() i=3 2023-10-05T19:52:08.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.777+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94347608050736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9ad60 con 0x55cf03a902c0 2023-10-05T19:52:08.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.781+0000 7fb2a47e3700 1 -- 172.21.15.167:0/3924443894 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 94347608050736] v32'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb28c025020 con 0x55cf03a902c0 2023-10-05T19:52:08.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.781+0000 7fb2a6caee40 20 remove_watcher() i=4 2023-10-05T19:52:08.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.781+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94347608055920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9ad60 con 0x55cf03a95240 2023-10-05T19:52:08.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.781+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 94347608055920] v32'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb294039020 con 0x55cf03a95240 2023-10-05T19:52:08.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.781+0000 7fb2a6caee40 20 remove_watcher() i=5 2023-10-05T19:52:08.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.781+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94347608054192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9ad60 con 0x55cf03a95240 2023-10-05T19:52:08.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.781+0000 7fb2a3fe2700 1 -- 172.21.15.167:0/3924443894 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 94347608054192] v32'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb294039020 con 0x55cf03a95240 2023-10-05T19:52:08.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.785+0000 7fb2a6caee40 20 remove_watcher() i=6 2023-10-05T19:52:08.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.785+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94347608064640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9da50 con 0x7fb28c01ec10 2023-10-05T19:52:08.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.785+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 94347608064640] v32'251 uv249 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x7fb28c01ec10 2023-10-05T19:52:08.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.785+0000 7fb2a6caee40 20 remove_watcher() i=7 2023-10-05T19:52:08.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.785+0000 7fb275fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:08.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.785+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94347608065808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55cf03a9da50 con 0x55cf03a60f10 2023-10-05T19:52:08.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 94347608065808] v32'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb29c033040 con 0x55cf03a60f10 2023-10-05T19:52:08.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55cf03a902c0 msgr2=0x55cf03a926a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55cf03a902c0 0x55cf03a926a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55cf03a60f10 msgr2=0x55cf03a8e340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55cf03a60f10 0x55cf03a8e340 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb28c01ec10 msgr2=0x7fb28c01fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fb28c01ec10 0x7fb28c01fa80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55cf03a95240 msgr2=0x55cf03a97620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55cf03a95240 0x55cf03a97620 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb284030c00 msgr2=0x7fb2840330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb284030c00 0x7fb2840330b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb294005a90 tx=0x7fb294015000 comp rx=0 tx=0).stop 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 msgr2=0x55cf03a82790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a4fe4700 1 -- 172.21.15.167:0/3924443894 reap_dead start 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a82790 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb28c000f80 tx=0x7fb28c014000 comp rx=0 tx=0).stop 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 shutdown_connections 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3924443894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03a5c930 0x55cf03a82790 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 >> 172.21.15.167:0/3924443894 conn(0x55cf03a58350 msgr2=0x55cf03a76000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 shutdown_connections 2023-10-05T19:52:08.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3924443894 wait complete. 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3139206801 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb1e4030c00 msgr2=0x7fb1e40330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3139206801 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb1e4030c00 0x7fb1e40330b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55cf03aa0ea0 tx=0x7fb29c00e040 comp rx=0 tx=0).stop 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3139206801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 msgr2=0x55cf03ab6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3139206801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab6040 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55cf03aaa6b0 tx=0x7fb29402c000 comp rx=0 tx=0).stop 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3139206801 shutdown_connections 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3139206801 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fb1e4030c00 0x7fb1e40330b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 --2- 172.21.15.167:0/3139206801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55cf03ab0630 0x55cf03ab6040 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3139206801 >> 172.21.15.167:0/3139206801 conn(0x55cf03aab9f0 msgr2=0x55cf03aa9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3139206801 shutdown_connections 2023-10-05T19:52:08.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.789+0000 7fb2a6caee40 1 -- 172.21.15.167:0/3139206801 wait complete. 2023-10-05T19:52:08.800 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-10-05T19:52:08.850 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:52:08.851 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2023-10-05T19:52:08.859 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2023-10-05T19:52:08.859 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2023-10-05T19:52:08.859 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2023-10-05T19:52:08.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2023-10-05T19:52:08.860 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2023-10-05T19:52:08.898 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:08.898 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:08.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.893+0000 7f8937830e40 1 Processor -- start 2023-10-05T19:52:08.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.893+0000 7f8937830e40 1 -- start start 2023-10-05T19:52:08.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.893+0000 7f8937830e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56210bc5e930 0x56210bc5ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.893+0000 7f8937830e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56210bbabbd0 con 0x56210bc5f240 2023-10-05T19:52:08.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.893+0000 7f8937830e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x56210bb68ee0 con 0x56210bc5e930 2023-10-05T19:52:08.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.893+0000 7f8935365700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56210bc5e930 0x56210bc5ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.893+0000 7f892ffff700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x56210bc5f240 0x56210bc5fce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:34596/0 (socket says 172.21.15.167:34596) 2023-10-05T19:52:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.893+0000 7f8935365700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x56210bc5e930 0x56210bc5ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36576/0 (socket says 172.21.15.167:36576) 2023-10-05T19:52:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.893+0000 7f892ffff700 1 -- 172.21.15.167:0/3476588868 learned_addr learned my addr 172.21.15.167:0/3476588868 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8935365700 1 -- 172.21.15.167:0/3476588868 >> v1:172.21.15.118:6789/0 conn(0x56210bc5f240 legacy=0x56210bc5fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8935365700 1 -- 172.21.15.167:0/3476588868 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56210bc603f0 con 0x56210bc5e930 2023-10-05T19:52:08.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8935365700 1 --2- 172.21.15.167:0/3476588868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc5ed00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f892800a5d0 tx=0x7f8928005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14eb8cc69558836 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8934b64700 1 -- 172.21.15.167:0/3476588868 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89280086a0 con 0x56210bc5e930 2023-10-05T19:52:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8934b64700 1 -- 172.21.15.167:0/3476588868 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928008800 con 0x56210bc5e930 2023-10-05T19:52:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8934b64700 1 -- 172.21.15.167:0/3476588868 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8928008ad0 con 0x56210bc5e930 2023-10-05T19:52:08.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8937830e40 1 -- 172.21.15.167:0/3476588868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 msgr2=0x56210bc5ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8937830e40 1 --2- 172.21.15.167:0/3476588868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc5ed00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f892800a5d0 tx=0x7f8928005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8937830e40 1 -- 172.21.15.167:0/3476588868 shutdown_connections 2023-10-05T19:52:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8937830e40 1 --2- 172.21.15.167:0/3476588868 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc5ed00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8937830e40 1 -- 172.21.15.167:0/3476588868 >> 172.21.15.167:0/3476588868 conn(0x56210bc5a350 msgr2=0x56210bc5c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8937830e40 1 -- 172.21.15.167:0/3476588868 shutdown_connections 2023-10-05T19:52:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8937830e40 1 -- 172.21.15.167:0/3476588868 wait complete. 2023-10-05T19:52:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.897+0000 7f8937830e40 1 Processor -- start 2023-10-05T19:52:08.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 -- start start 2023-10-05T19:52:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc7d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56210bb2ce30 con 0x56210bc5e930 2023-10-05T19:52:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8935365700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc7d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8935365700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc7d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36584/0 (socket says 172.21.15.167:36584) 2023-10-05T19:52:08.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8935365700 1 -- 172.21.15.167:0/3077660390 learned_addr learned my addr 172.21.15.167:0/3077660390 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8935365700 1 -- 172.21.15.167:0/3077660390 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928005cf0 con 0x56210bc5e930 2023-10-05T19:52:08.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8935365700 1 --2- 172.21.15.167:0/3077660390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc7d970 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f892800a520 tx=0x7f8928015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2113dd2cbdee5d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f892effd700 1 -- 172.21.15.167:0/3077660390 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8928008970 con 0x56210bc5e930 2023-10-05T19:52:08.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f892effd700 1 -- 172.21.15.167:0/3077660390 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928008ad0 con 0x56210bc5e930 2023-10-05T19:52:08.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f892effd700 1 -- 172.21.15.167:0/3077660390 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8928008dc0 con 0x56210bc5e930 2023-10-05T19:52:08.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 -- 172.21.15.167:0/3077660390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 msgr2=0x56210bc7d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 --2- 172.21.15.167:0/3077660390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc7d970 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f892800a520 tx=0x7f8928015000 comp rx=0 tx=0).stop 2023-10-05T19:52:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 -- 172.21.15.167:0/3077660390 shutdown_connections 2023-10-05T19:52:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 --2- 172.21.15.167:0/3077660390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc7d970 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 -- 172.21.15.167:0/3077660390 >> 172.21.15.167:0/3077660390 conn(0x56210bc5a350 msgr2=0x56210bc79530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 -- 172.21.15.167:0/3077660390 shutdown_connections 2023-10-05T19:52:08.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 -- 172.21.15.167:0/3077660390 wait complete. 2023-10-05T19:52:08.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 Processor -- start 2023-10-05T19:52:08.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.901+0000 7f8937830e40 1 -- start start 2023-10-05T19:52:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8937830e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc84580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8937830e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56210baffed0 con 0x56210bc5e930 2023-10-05T19:52:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8935365700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc84580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8935365700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc84580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36594/0 (socket says 172.21.15.167:36594) 2023-10-05T19:52:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 learned_addr learned my addr 172.21.15.167:0/700134766 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56210bc603f0 con 0x56210bc5e930 2023-10-05T19:52:08.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8935365700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc84580 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8928005540 tx=0x7f8928003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f892d7fa700 1 -- 172.21.15.167:0/700134766 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8928012bf0 con 0x56210bc5e930 2023-10-05T19:52:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f892d7fa700 1 -- 172.21.15.167:0/700134766 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892802a070 con 0x56210bc5e930 2023-10-05T19:52:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56210bc84ac0 con 0x56210bc5e930 2023-10-05T19:52:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f892d7fa700 1 -- 172.21.15.167:0/700134766 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8928012e90 con 0x56210bc5e930 2023-10-05T19:52:08.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56210bc84f60 con 0x56210bc5e930 2023-10-05T19:52:08.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.905+0000 7f892d7fa700 1 -- 172.21.15.167:0/700134766 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f8928019070 con 0x56210bc5e930 2023-10-05T19:52:08.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f892d7fa700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8918030c50 0x7f8918033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f892d7fa700 1 -- 172.21.15.167:0/700134766 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f892802c070 con 0x56210bc5e930 2023-10-05T19:52:08.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f892ffff700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8918030c50 0x7f8918033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bc5f240 0x56210bc900a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc90710 con 0x56210bc5f240 2023-10-05T19:52:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8935b66700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bc5f240 0x56210bc900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f892ffff700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8918030c50 0x7f8918033100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8920004170 tx=0x7f8920001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8935b66700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bc5f240 0x56210bc900a0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 20 realm 2023-10-05T19:52:08.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc8d700 con 0x56210bc5f240 2023-10-05T19:52:08.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc911f0 con 0x56210bc5f240 2023-10-05T19:52:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bc92020 0x56210bc94400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc94940 con 0x56210bc92020 2023-10-05T19:52:08.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.909+0000 7f8935365700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bc92020 0x56210bc94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8935365700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bc92020 0x56210bc94400 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc951e0 con 0x56210bc5f240 2023-10-05T19:52:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:08.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8937830e40 20 searching for the correct realm 2023-10-05T19:52:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bc96fa0 0x56210bc99380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc96fa0 2023-10-05T19:52:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f892ffff700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bc96fa0 0x56210bc99380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f892ffff700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bc96fa0 0x56210bc99380 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920006070 con 0x56210bc96fa0 2023-10-05T19:52:08.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.913+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc92020 2023-10-05T19:52:08.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.921 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935365700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8928007030 0x7f8928001620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x7f8928007030 2023-10-05T19:52:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8928007030 0x7f8928001620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:08.922 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8928007030 0x7f8928001620 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:08.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.923 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc96fa0 2023-10-05T19:52:08.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920006070 con 0x56210bc96fa0 2023-10-05T19:52:08.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.924 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.917+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc92020 2023-10-05T19:52:08.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc92020 2023-10-05T19:52:08.925 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.926 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x7f8928007030 2023-10-05T19:52:08.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.927 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x7f8928007030 2023-10-05T19:52:08.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.928 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.921+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc92020 2023-10-05T19:52:08.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc96fa0 2023-10-05T19:52:08.929 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920006070 con 0x56210bc96fa0 2023-10-05T19:52:08.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.930 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc92020 2023-10-05T19:52:08.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc96fa0 2023-10-05T19:52:08.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920006070 con 0x56210bc96fa0 2023-10-05T19:52:08.931 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.925+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.932 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.933 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc96fa0 2023-10-05T19:52:08.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920006070 con 0x56210bc96fa0 2023-10-05T19:52:08.934 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x7f8928007030 2023-10-05T19:52:08.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc5f240 2023-10-05T19:52:08.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.935 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x7f8928007030 2023-10-05T19:52:08.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.929+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc96fa0 2023-10-05T19:52:08.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920006070 con 0x56210bc96fa0 2023-10-05T19:52:08.936 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x7f8928007030 2023-10-05T19:52:08.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.937 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc92020 2023-10-05T19:52:08.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc92020 2023-10-05T19:52:08.938 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc96fa0 2023-10-05T19:52:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920006070 con 0x56210bc96fa0 2023-10-05T19:52:08.939 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.933+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc92020 2023-10-05T19:52:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.940 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc998c0 con 0x56210bc92020 2023-10-05T19:52:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:08.941 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:08.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:08.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc95d50 con 0x56210bc5f240 2023-10-05T19:52:08.942 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.943 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc966a0 con 0x56210bc92020 2023-10-05T19:52:08.944 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc92020 2023-10-05T19:52:08.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:08.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.945 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.937+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9a020 con 0x56210bc96fa0 2023-10-05T19:52:08.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f8920006070 con 0x56210bc96fa0 2023-10-05T19:52:08.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.948 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9a3d0 con 0x56210bc5f240 2023-10-05T19:52:08.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc96240 con 0x56210bc92020 2023-10-05T19:52:08.949 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc96210 con 0x56210bc96fa0 2023-10-05T19:52:08.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.950 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.941+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc96210 con 0x56210bc92020 2023-10-05T19:52:08.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x7f8928007030 2023-10-05T19:52:08.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc5f240 2023-10-05T19:52:08.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc5f240 2023-10-05T19:52:08.952 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc96fa0 2023-10-05T19:52:08.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc5f240 2023-10-05T19:52:08.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.953 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.945+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc92020 2023-10-05T19:52:08.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc92020 2023-10-05T19:52:08.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc5f240 2023-10-05T19:52:08.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.954 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x7f8928007030 2023-10-05T19:52:08.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.955 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc5f240 2023-10-05T19:52:08.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.949+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x7f8928007030 2023-10-05T19:52:08.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.956 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc92020 2023-10-05T19:52:08.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.957 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc99c70 con 0x56210bc96fa0 2023-10-05T19:52:08.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc5f240 2023-10-05T19:52:08.958 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc92020 2023-10-05T19:52:08.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.959 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc96fa0 2023-10-05T19:52:08.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.953+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.960 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc5f240 2023-10-05T19:52:08.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc5f240 2023-10-05T19:52:08.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.961 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc5f240 2023-10-05T19:52:08.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc96fa0 2023-10-05T19:52:08.962 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x7f8928007030 2023-10-05T19:52:08.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc5f240 2023-10-05T19:52:08.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.957+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x7f8928007030 2023-10-05T19:52:08.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc96fa0 2023-10-05T19:52:08.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x7f8928007030 2023-10-05T19:52:08.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc92020 2023-10-05T19:52:08.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc92020 2023-10-05T19:52:08.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc96fa0 2023-10-05T19:52:08.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.961+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc92020 2023-10-05T19:52:08.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8920028040 con 0x56210bc92020 2023-10-05T19:52:08.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:08.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:08.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:08.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:08.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc96210 con 0x56210bc92020 2023-10-05T19:52:08.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc96210 con 0x56210bc5f240 2023-10-05T19:52:08.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.965+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:08.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9b1b0 con 0x56210bc92020 2023-10-05T19:52:08.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:08.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9b1b0 con 0x56210bc92020 2023-10-05T19:52:08.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:08.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9b2b0 con 0x7f8928007030 2023-10-05T19:52:08.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 zone default found 2023-10-05T19:52:08.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 4 Realm: () 2023-10-05T19:52:08.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:08.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:08.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:08.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 zonegroup default 2023-10-05T19:52:08.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9b2b0 con 0x7f8928007030 2023-10-05T19:52:08.980 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.969+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9cc30 con 0x56210bc96fa0 2023-10-05T19:52:08.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.973+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.973+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.973+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:08.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.973+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9cfe0 con 0x56210bc96fa0 2023-10-05T19:52:08.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.973+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.973+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:08.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.973+0000 7f8937830e40 20 started sync module instance, tier type = 2023-10-05T19:52:08.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.973+0000 7f8937830e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:08.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.973+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9c2f0 con 0x56210bc92020 2023-10-05T19:52:08.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.977+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.986 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.977+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94699931680256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9c810 con 0x56210bc92020 2023-10-05T19:52:08.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.977+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9c250 con 0x56210bc5f240 2023-10-05T19:52:08.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.977+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.977+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94699931687040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9c810 con 0x56210bc5f240 2023-10-05T19:52:08.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.977+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94699931680256] v32'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.977+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9e6b0 con 0x56210bc92020 2023-10-05T19:52:08.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.981+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94699931687040] v32'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:08.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.981+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.981+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94699931688144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9c810 con 0x56210bc92020 2023-10-05T19:52:08.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.981+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9eb00 con 0x7f8928007030 2023-10-05T19:52:08.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.981+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.981+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94699931688144] v32'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.981+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94699931690512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9ef50 con 0x7f8928007030 2023-10-05T19:52:08.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.981+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9f470 con 0x56210bc92020 2023-10-05T19:52:08.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.985+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94699931690512] v32'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.985+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.985+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94699931691616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9eeb0 con 0x56210bc92020 2023-10-05T19:52:08.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.985+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc9fe50 con 0x56210bc96fa0 2023-10-05T19:52:08.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.985+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.985+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94699931691616] v32'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:08.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.985+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94699931695456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bca0200 con 0x56210bc96fa0 2023-10-05T19:52:08.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.985+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bca0aa0 con 0x56210bc96fa0 2023-10-05T19:52:08.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94699931695456] v32'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94699931694192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bca1390 con 0x56210bc96fa0 2023-10-05T19:52:08.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bca1da0 con 0x7f8928007030 2023-10-05T19:52:08.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94699931694192] v32'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:08.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'252 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94699931701456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bca1da0 con 0x7f8928007030 2023-10-05T19:52:08.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 20 add_watcher() i=0 2023-10-05T19:52:08.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 20 add_watcher() i=1 2023-10-05T19:52:08.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 20 add_watcher() i=2 2023-10-05T19:52:08.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 20 add_watcher() i=3 2023-10-05T19:52:08.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 20 add_watcher() i=4 2023-10-05T19:52:08.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 20 add_watcher() i=5 2023-10-05T19:52:08.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.989+0000 7f8937830e40 20 add_watcher() i=6 2023-10-05T19:52:08.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94699931701456] v32'253 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:08.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 20 add_watcher() i=7 2023-10-05T19:52:08.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:08.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bca4f40 con 0x56210bc5f240 2023-10-05T19:52:09.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94699931703840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bca24b0 con 0x56210bc5f240 2023-10-05T19:52:09.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94699931703840] v32'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f89067e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:09.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:09.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:09.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 1 Processor -- start 2023-10-05T19:52:09.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 1 -- start start 2023-10-05T19:52:09.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcafae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.993+0000 7f8937830e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56210bcb0020 con 0x56210bcaf710 2023-10-05T19:52:09.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f892ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcafae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f892ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcafae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36606/0 (socket says 172.21.15.167:36606) 2023-10-05T19:52:09.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f892ffff700 1 -- 172.21.15.167:0/282857219 learned_addr learned my addr 172.21.15.167:0/282857219 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:09.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f892ffff700 1 -- 172.21.15.167:0/282857219 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56210bcb0160 con 0x56210bcaf710 2023-10-05T19:52:09.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f892ffff700 1 --2- 172.21.15.167:0/282857219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcafae0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x56210bc918f0 tx=0x7f8920010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508020c2d5ce9a8a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8905fe3700 1 -- 172.21.15.167:0/282857219 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f892003b070 con 0x56210bcaf710 2023-10-05T19:52:09.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8905fe3700 1 -- 172.21.15.167:0/282857219 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8920022040 con 0x56210bcaf710 2023-10-05T19:52:09.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8905fe3700 1 -- 172.21.15.167:0/282857219 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8920021040 con 0x56210bcaf710 2023-10-05T19:52:09.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 -- 172.21.15.167:0/282857219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 msgr2=0x56210bcafae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 --2- 172.21.15.167:0/282857219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcafae0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x56210bc918f0 tx=0x7f8920010000 comp rx=0 tx=0).stop 2023-10-05T19:52:09.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 -- 172.21.15.167:0/282857219 shutdown_connections 2023-10-05T19:52:09.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 --2- 172.21.15.167:0/282857219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcafae0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 -- 172.21.15.167:0/282857219 >> 172.21.15.167:0/282857219 conn(0x56210bcaaad0 msgr2=0x56210bca8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:09.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 -- 172.21.15.167:0/282857219 shutdown_connections 2023-10-05T19:52:09.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 -- 172.21.15.167:0/282857219 wait complete. 2023-10-05T19:52:09.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 Processor -- start 2023-10-05T19:52:09.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 -- start start 2023-10-05T19:52:09.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcb5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:08.997+0000 7f8937830e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x56210bcb6170 con 0x56210bcaf710 2023-10-05T19:52:09.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f892ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcb5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f892ffff700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcb5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36610/0 (socket says 172.21.15.167:36610) 2023-10-05T19:52:09.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f892ffff700 1 -- 172.21.15.167:0/2737648425 learned_addr learned my addr 172.21.15.167:0/2737648425 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:09.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f892ffff700 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56210bbabbd0 con 0x56210bcaf710 2023-10-05T19:52:09.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f892ffff700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcb5170 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8920000c00 tx=0x7f8920037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8877fff700 1 -- 172.21.15.167:0/2737648425 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8920021070 con 0x56210bcaf710 2023-10-05T19:52:09.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56210bcb5770 con 0x56210bcaf710 2023-10-05T19:52:09.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8877fff700 1 -- 172.21.15.167:0/2737648425 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8920034e20 con 0x56210bcaf710 2023-10-05T19:52:09.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8877fff700 1 -- 172.21.15.167:0/2737648425 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8920046070 con 0x56210bcaf710 2023-10-05T19:52:09.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56210bcb5bb0 con 0x56210bcaf710 2023-10-05T19:52:09.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8877fff700 1 -- 172.21.15.167:0/2737648425 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f892003e020 con 0x56210bcaf710 2023-10-05T19:52:09.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8877fff700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f887c030c50 0x7f887c033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8877fff700 1 -- 172.21.15.167:0/2737648425 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f892002e040 con 0x56210bcaf710 2023-10-05T19:52:09.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8935b66700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f887c030c50 0x7f887c033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bcbfd60 0x56210bcc2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.001+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcc27c0 con 0x56210bcbfd60 2023-10-05T19:52:09.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.005+0000 7f8935365700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bcbfd60 0x56210bcc2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.005+0000 7f8935b66700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f887c030c50 0x7f887c033100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56210bca2410 tx=0x7f893000ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.005+0000 7f8935365700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bcbfd60 0x56210bcc2170 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.005+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'33 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.005+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56210bcc3490 0x56210bcc5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.005+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcc5fa0 con 0x56210bcc3490 2023-10-05T19:52:09.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.005+0000 7f892ffff700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56210bcc3490 0x56210bcc5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.005+0000 7f892ffff700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56210bcc3490 0x56210bcc5870 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.009+0000 7f892ffff700 1 -- 172.21.15.167:0/2737648425 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8920024040 con 0x56210bcc3490 2023-10-05T19:52:09.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.009+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bcc6c70 0x56210bcc9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.009+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcc97b0 con 0x56210bcc6c70 2023-10-05T19:52:09.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.009+0000 7f8935b66700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bcc6c70 0x56210bcc9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.009+0000 7f8935b66700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bcc6c70 0x56210bcc9080 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.009+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.013+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bcca480 0x56210bccc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.013+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcccfc0 con 0x56210bcca480 2023-10-05T19:52:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.013+0000 7f8935365700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bcca480 0x56210bccc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.013+0000 7f8935365700 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bcca480 0x56210bccc890 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.013+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'239 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.013+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bccd610 con 0x56210bcca480 2023-10-05T19:52:09.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.017+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'71 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.017+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bccdc30 con 0x56210bcc6c70 2023-10-05T19:52:09.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.017+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'48 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.017+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcce120 con 0x56210bcbfd60 2023-10-05T19:52:09.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.021+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.021+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcca480 2023-10-05T19:52:09.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.021+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'46 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.021+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.025+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.025+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.025+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.025+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcca480 2023-10-05T19:52:09.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.029+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'72 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.029+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcc6c70 2023-10-05T19:52:09.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.029+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.029+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.033+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.033+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcca480 2023-10-05T19:52:09.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.033+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'65 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.033+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcca480 2023-10-05T19:52:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.037+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'240 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.037+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.041+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'68 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.041+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcca480 2023-10-05T19:52:09.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.041+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'73 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.041+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcc6c70 2023-10-05T19:52:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.045+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.045+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.045+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.045+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcca480 2023-10-05T19:52:09.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.049+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'241 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.049+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.049+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'69 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.049+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.053+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'39 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.053+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcc6c70 2023-10-05T19:52:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.057+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.057+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.057+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'35 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.057+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcc6c70 2023-10-05T19:52:09.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.061+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'25 uv20 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.061+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcc6c70 2023-10-05T19:52:09.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.061+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'49 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.061+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcc6c70 2023-10-05T19:52:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.065+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'31 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.065+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.069+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'41 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.069+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcca480 2023-10-05T19:52:09.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.069+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'47 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.069+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcbfd60 2023-10-05T19:52:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.073+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'70 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcbfd60 2023-10-05T19:52:09.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.073+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcca480 2023-10-05T19:52:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.073+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'66 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bcca480 2023-10-05T19:52:09.079 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.073+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bcbb6b0 con 0x56210bcc3490 2023-10-05T19:52:09.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.077+0000 7f892ffff700 1 -- 172.21.15.167:0/2737648425 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8920024040 con 0x56210bcc3490 2023-10-05T19:52:09.084 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.077+0000 7f88757fa700 20 reqs_thread_entry: start 2023-10-05T19:52:09.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:09.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f886effd700 20 reqs_thread_entry: start 2023-10-05T19:52:09.085 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:09.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f886d7fa700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:39 2023 2023-10-05T19:52:09.086 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:09.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f886cff9700 20 reqs_thread_entry: start 2023-10-05T19:52:09.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 20 get_system_obj_state: rctx=0x7fff0340e638 obj=default.rgw.meta:users.uid:bud state=0x56210bb380b0 s->prefetch_data=0 2023-10-05T19:52:09.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2023-10-05T19:52:09.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd2d660 con 0x7f8928007030 2023-10-05T19:52:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 bud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x16 2023-10-05T19:52:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T19:52:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 10 cache get: name=default.rgw.meta+users.uid+bud : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:09.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd300f0 con 0x7f8928007030 2023-10-05T19:52:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 bud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T19:52:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2023-10-05T19:52:09.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2023-10-05T19:52:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.081+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:104 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd300f0 con 0x56210bc92020 2023-10-05T19:52:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(104 bud.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 20 get_system_obj_state: rctx=0x7fff0340e2e0 obj=default.rgw.meta:root:.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 state=0x56210bb380b0 s->prefetch_data=0 2023-10-05T19:52:09.089 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 : miss 2023-10-05T19:52:09.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 8.17 8:eb04119c:root::.bucket.meta.myfoo6%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd2f900 con 0x56210bc92020 2023-10-05T19:52:09.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 .bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 [call out=48b,getxattrs out=212b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 291+0+276 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 info.flags=0x16 2023-10-05T19:52:09.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 to cache LRU end 2023-10-05T19:52:09.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T19:52:09.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:09.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 20 Read xattr: user.rgw.acl 2023-10-05T19:52:09.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:09.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:09.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.091 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 8.17 8:eb04119c:root::.bucket.meta.myfoo6%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd31fa0 con 0x56210bc92020 2023-10-05T19:52:09.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 .bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 [call,call out=48b,read 0~353 out=353b,getxattrs out=212b] v0'0 uv2 ondisk = 0) v8 ==== 333+0+613 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 20 rados_obj.operate() r=0 bl.length=353 2023-10-05T19:52:09.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 info.flags=0x13 2023-10-05T19:52:09.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 to cache LRU end 2023-10-05T19:52:09.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T19:52:09.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 2023-10-05T19:52:09.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T19:52:09.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.085+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 4.28 4:14e4fd64:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x7f8928007030 2023-10-05T19:52:09.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.089+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(107 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.093 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.089+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 4.1f 4:f94fa9d5:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x56210bc92020 2023-10-05T19:52:09.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.089+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(108 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.089+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 4.10 4:0a81f3bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x56210bc96fa0 2023-10-05T19:52:09.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.089+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(109 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8920024040 con 0x56210bc96fa0 2023-10-05T19:52:09.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.089+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 4.31 4:8ca52ea4:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x56210bc92020 2023-10-05T19:52:09.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.089+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(110 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.089+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 4.8 4:10af645e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x56210bc96fa0 2023-10-05T19:52:09.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.093+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(111 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.097 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.093+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 4.39 4:9dfe1dca:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x56210bc96fa0 2023-10-05T19:52:09.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.093+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(112 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.093+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:113 4.1a 4:5bc2cca0:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x56210bc92020 2023-10-05T19:52:09.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.093+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(113 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.093+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:114 4.1c 4:3ac9a2dc:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x7f8928007030 2023-10-05T19:52:09.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.097+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(114 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.097+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:115 4.24 4:26f3e49f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x56210bc5f240 2023-10-05T19:52:09.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.097+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(115 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.097+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 4.3a 4:5d1a43ff:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x56210bc96fa0 2023-10-05T19:52:09.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.097+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(116 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 [call out=289b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+289 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.097+0000 7f8937830e40 10 cls_bucket_list_unordered: got thirteen 2023-10-05T19:52:09.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.097+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:117 4.20 4:07d1f63a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bdad3b0 con 0x56210bc92020 2023-10-05T19:52:09.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.097+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(117 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.097+0000 7f8937830e40 20 get_obj_state: rctx=0x7fff0340e300 obj=myfoo6:thirteen state=0x56210bd2f668 s->prefetch_data=0 2023-10-05T19:52:09.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.101+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:118 3.16s0 3:6a48f971:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd306a0 con 0x56210bc92020 2023-10-05T19:52:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.101+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(118 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 238+0+836 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.101+0000 7f8937830e40 10 manifest: total_size = 8 2023-10-05T19:52:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.101+0000 7f8937830e40 20 get_obj_state: setting s->obj_tag to _NPHSRQpJM3Cu45Eho5vsujSpZHmLOFB 2023-10-05T19:52:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.101+0000 7f8937830e40 20 get_obj_state: rctx=0x7fff0340e300 obj=myfoo6:thirteen state=0x56210bd2f668 s->prefetch_data=0 2023-10-05T19:52:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.101+0000 7f8937830e40 20 prepare_atomic_modification: state is not atomic. state=0x56210bd2f668 2023-10-05T19:52:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.101+0000 7f8937830e40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 2023-10-05T19:52:09.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.101+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:119 4.3a 4:5d1a43ff:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd36790 con 0x56210bc96fa0 2023-10-05T19:52:09.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.101+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(119 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 [stat,call,call] v32'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.105+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:120 3.16s0 3:6a48f971:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd34770 con 0x56210bc92020 2023-10-05T19:52:09.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.105+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(120 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7_thirteen [call] v32'3 uv3 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.105+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:121 4.3a 4:5d1a43ff:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd36df0 con 0x56210bc96fa0 2023-10-05T19:52:09.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo6 : miss 2023-10-05T19:52:09.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:122 6.9 6:936e6ff6:::bucket.sync-source-hints.myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd39a90 con 0x56210bc96fa0 2023-10-05T19:52:09.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(122 bucket.sync-source-hints.myfoo6 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo6 info.flags=0x0 2023-10-05T19:52:09.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 10 adding default.rgw.log++bucket.sync-source-hints.myfoo6 to cache LRU end 2023-10-05T19:52:09.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo6 : miss 2023-10-05T19:52:09.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:123 6.19 6:9e3df8ab:::bucket.sync-target-hints.myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd39a60 con 0x56210bc92020 2023-10-05T19:52:09.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(123 bucket.sync-target-hints.myfoo6 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo6 info.flags=0x0 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 10 adding default.rgw.log++bucket.sync-target-hints.myfoo6 to cache LRU end 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 10 chain_cache_entry: cache_locator= 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 20 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): starting attempt 1 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): :myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]) start_after="_multipart_", prefix="_multipart_, delimiter="", shard_id=-1", num_entries=1001, list_versions=0, expansion_factor=1, force_check_filter is unset 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T19:52:09.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:124 4.28 4:14e4fd64:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd377d0 con 0x7f8928007030 2023-10-05T19:52:09.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:125 4.1f 4:f94fa9d5:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd37d10 con 0x56210bc92020 2023-10-05T19:52:09.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:126 4.10 4:0a81f3bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd3ef00 con 0x56210bc96fa0 2023-10-05T19:52:09.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:127 4.31 4:8ca52ea4:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd37d10 con 0x56210bc92020 2023-10-05T19:52:09.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:128 4.8 4:10af645e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd3ef00 con 0x56210bc96fa0 2023-10-05T19:52:09.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:129 4.39 4:9dfe1dca:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd465b0 con 0x56210bc96fa0 2023-10-05T19:52:09.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:130 4.1a 4:5bc2cca0:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd493d0 con 0x56210bc92020 2023-10-05T19:52:09.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:131 4.1c 4:3ac9a2dc:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4c270 con 0x7f8928007030 2023-10-05T19:52:09.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:132 4.24 4:26f3e49f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4f140 con 0x56210bc5f240 2023-10-05T19:52:09.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:133 4.3a 4:5d1a43ff:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd51c00 con 0x56210bc96fa0 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.109+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:134 4.20 4:07d1f63a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd54540 con 0x56210bc92020 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(121 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 [stat,call,call] v32'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f892e7fc700 20 handle_completion(): completion ok for obj=thirteen 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(124 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(126 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(125 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(127 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(128 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(132 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(129 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(130 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(134 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(133 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f892005c040 con 0x56210bc96fa0 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(131 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, count=0, is_truncated=0 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, last_entry NOT SET 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7])"; uploads.size()=0; is_truncated=0 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]) 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 20 lifecycle: get_system_obj_state: rctx=0x7fff0340dd98 obj=default.rgw.meta:root:myfoo6 state=0x56210bb380b0 s->prefetch_data=0 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo6 : miss 2023-10-05T19:52:09.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd51c00 con 0x56210bc5f240 2023-10-05T19:52:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(135 myfoo6 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x16 2023-10-05T19:52:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 lifecycle: adding default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T19:52:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 20 lifecycle: get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 20 lifecycle: Read xattr: user.rgw.idtag 2023-10-05T19:52:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo6 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 20 lifecycle: rados->read ofs=0 len=0 2023-10-05T19:52:09.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd51c00 con 0x56210bc5f240 2023-10-05T19:52:09.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(136 myfoo6 [call,call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 276+0+289 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 20 lifecycle: rados_obj.operate() r=0 bl.length=166 2023-10-05T19:52:09.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2023-10-05T19:52:09.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 lifecycle: moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.113+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:137 8.17 8:eb04119c:root::.bucket.meta.myfoo6%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd30e60 con 0x56210bc92020 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 46 ==== osd_op_reply(137 .bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 [delete,create,call,call,writefull 0~353,setxattr (117)] v32'3 uv3 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 info.flags=0x17 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 to cache LRU end 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 10 lifecycle: distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7, ofs0, ns] 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:138 7.15 7:a93a5511:::notify.2:head [notify cookie 94699932324896 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd30e60 con 0x56210bc92020 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 47 ==== watch-notify(notify (1) cookie 94699931688144 notify 137438953513 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x7f892808e040 con 0x56210bc92020 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f892e7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94699931688144 notifier 4739 bl.length()=721 2023-10-05T19:52:09.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f892e7fc700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 info.flags=0x17 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 48 ==== osd_op_reply(138 notify.2 [notify cookie 94699932324896 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f892e7fc700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 to cache LRU end 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f892e7fc700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f892e7fc700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:139 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8914003d90 con 0x56210bc92020 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 49 ==== osd_op_reply(139 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 50 ==== watch-notify(notify_complete (2) cookie 94699932324896 notify 137438953513 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56210bc84f60 con 0x56210bc92020 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 20 lifecycle: handle_bi_update(): bucket=:myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]): orig_sources= new_sources= 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 20 lifecycle: handle_bi_update(): bucket=:myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]): potential sources added=[] removed=[] 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 20 lifecycle: handle_bi_update(): bucket=:myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]): orig_dests= new_dests= 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 20 lifecycle: handle_bi_update(): bucket=:myfoo6[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7]): potential dests added=[] removed=[] 2023-10-05T19:52:09.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.117+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:33 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd30e60 con 0x56210bcc6c70 2023-10-05T19:52:09.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.121+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(33 lc.20 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.121+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:34 6.16 6:6b0d4d95:lc::lc.20:head [call rgw.lc_rm_entry in=93b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd30e60 con 0x56210bcc6c70 2023-10-05T19:52:09.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.121+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(34 lc.20 [call] v32'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.121+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd30e60 con 0x56210bcc6c70 2023-10-05T19:52:09.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.121+0000 7f8935b66700 1 -- 172.21.15.167:0/2737648425 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(35 lc.20 [call] v32'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bcc6c70 2023-10-05T19:52:09.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.121+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:140 4.28 4:14e4fd64:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd39560 con 0x7f8928007030 2023-10-05T19:52:09.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.121+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:141 4.1f 4:f94fa9d5:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x56210bc92020 2023-10-05T19:52:09.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.121+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:142 4.10 4:0a81f3bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd39560 con 0x56210bc96fa0 2023-10-05T19:52:09.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.121+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:143 4.31 4:8ca52ea4:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd49270 con 0x56210bc92020 2023-10-05T19:52:09.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:144 4.8 4:10af645e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x56210bc96fa0 2023-10-05T19:52:09.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:145 4.39 4:9dfe1dca:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd39560 con 0x56210bc96fa0 2023-10-05T19:52:09.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:146 4.1a 4:5bc2cca0:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd49270 con 0x56210bc92020 2023-10-05T19:52:09.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:147 4.1c 4:3ac9a2dc:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x7f8928007030 2023-10-05T19:52:09.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:148 4.24 4:26f3e49f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd39560 con 0x56210bc5f240 2023-10-05T19:52:09.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:149 4.3a 4:5d1a43ff:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd49270 con 0x56210bc96fa0 2023-10-05T19:52:09.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:150 4.20 4:07d1f63a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd43680 con 0x56210bc92020 2023-10-05T19:52:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 51 ==== osd_op_reply(141 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 52 ==== osd_op_reply(146 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(148 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 53 ==== osd_op_reply(143 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(140 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(147 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 54 ==== osd_op_reply(150 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== osd_op_reply(142 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== osd_op_reply(144 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 35 ==== osd_op_reply(145 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 36 ==== osd_op_reply(149 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:151 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x56210bc92020 2023-10-05T19:52:09.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 55 ==== osd_op_reply(151 bud.buckets [call] v32'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 20 get_system_obj_state: rctx=0x7fff0340d818 obj=default.rgw.meta:root:myfoo6 state=0x56210bb380b0 s->prefetch_data=0 2023-10-05T19:52:09.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 10 cache get: name=default.rgw.meta+root+myfoo6 : type miss (requested=0x16, cached=0x13) 2023-10-05T19:52:09.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.125+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:152 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x56210bc5f240 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(152 myfoo6 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x16 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 10 moving default.rgw.meta+root+myfoo6 to cache LRU end 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 10 cache get: name=default.rgw.meta+root+myfoo6 : hit (requested=0x11, cached=0x17) 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 10 removing default.rgw.meta+root+myfoo6 from cache 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:153 7.e 7:7759931f:::notify.3:head [notify cookie 94699932376896 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x7f8928007030 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== watch-notify(notify (1) cookie 94699931690512 notify 137438953501 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x7f8930055060 con 0x7f8928007030 2023-10-05T19:52:09.134 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f892effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94699931690512 notifier 4739 bl.length()=150 2023-10-05T19:52:09.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 28 ==== osd_op_reply(153 notify.3 [notify cookie 94699932376896 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f892effd700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8884003270 con 0x7f8928007030 2023-10-05T19:52:09.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 29 ==== watch-notify(notify_complete (2) cookie 94699932376896 notify 137438953501 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8930061020 con 0x7f8928007030 2023-10-05T19:52:09.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 30 ==== osd_op_reply(154 notify.3 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:155 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x56210bc5f240 2023-10-05T19:52:09.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(155 myfoo6 [call,call,delete] v32'19 uv19 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 from cache 2023-10-05T19:52:09.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7, ofs0, ns] 2023-10-05T19:52:09.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:156 7.15 7:a93a5511:::notify.2:head [notify cookie 94699932376896 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x56210bc92020 2023-10-05T19:52:09.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 56 ==== watch-notify(notify (1) cookie 94699931688144 notify 137438953514 ret 0) v3 ==== 249+0+0 (crc 0 0 0) 0x56210bc84f60 con 0x56210bc92020 2023-10-05T19:52:09.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f892effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94699931688144 notifier 4739 bl.length()=207 2023-10-05T19:52:09.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 57 ==== osd_op_reply(156 notify.2 [notify cookie 94699932376896 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.129+0000 7f892effd700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f88840032c0 con 0x56210bc92020 2023-10-05T19:52:09.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 58 ==== osd_op_reply(157 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 59 ==== watch-notify(notify_complete (2) cookie 94699932376896 notify 137438953514 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56210bc84ac0 con 0x56210bc92020 2023-10-05T19:52:09.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:158 8.17 8:eb04119c:root::.bucket.meta.myfoo6%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x56210bc92020 2023-10-05T19:52:09.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 60 ==== osd_op_reply(158 .bucket.meta.myfoo6:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 [call,call,delete] v32'4 uv4 ondisk = 0) v8 ==== 291+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:159 4.28 4:14e4fd64:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x7f8928007030 2023-10-05T19:52:09.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:160 4.1f 4:f94fa9d5:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd30e60 con 0x56210bc92020 2023-10-05T19:52:09.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:161 4.10 4:0a81f3bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd49270 con 0x56210bc96fa0 2023-10-05T19:52:09.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:162 4.31 4:8ca52ea4:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd386f0 con 0x56210bc92020 2023-10-05T19:52:09.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:163 4.8 4:10af645e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x56210bc96fa0 2023-10-05T19:52:09.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:164 4.39 4:9dfe1dca:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd49270 con 0x56210bc96fa0 2023-10-05T19:52:09.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:165 4.1a 4:5bc2cca0:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd386f0 con 0x56210bc92020 2023-10-05T19:52:09.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:166 4.1c 4:3ac9a2dc:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x7f8928007030 2023-10-05T19:52:09.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:167 4.24 4:26f3e49f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd49270 con 0x56210bc5f240 2023-10-05T19:52:09.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:168 4.3a 4:5d1a43ff:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd2f830 con 0x56210bc96fa0 2023-10-05T19:52:09.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.133+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:169 4.20 4:07d1f63a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd46fa0 con 0x56210bc92020 2023-10-05T19:52:09.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 61 ==== osd_op_reply(162 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.3 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 37 ==== osd_op_reply(164 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.5 [delete] v32'3 uv3 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 38 ==== osd_op_reply(168 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.9 [delete] v32'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 62 ==== osd_op_reply(160 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.1 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 31 ==== osd_op_reply(159 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.0 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 32 ==== osd_op_reply(166 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.7 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(167 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.8 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 63 ==== osd_op_reply(169 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.10 [delete] v32'5 uv5 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 64 ==== osd_op_reply(165 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.6 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 39 ==== osd_op_reply(163 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.4 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 40 ==== osd_op_reply(161 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7.2 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:170 6.2 6:41fbcdf4:::pubsub..bucket.myfoo6%2fe814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd4eab0 con 0x56210bc96fa0 2023-10-05T19:52:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.137+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 41 ==== osd_op_reply(170 pubsub..bucket.myfoo6/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 251+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f8937830e40 10 removing default.rgw.log++pubsub..bucket.myfoo6/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 from cache 2023-10-05T19:52:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f8937830e40 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo6/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7, ofs0, ns] 2023-10-05T19:52:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:171 7.0 7:05bf5b68:::notify.1:head [notify cookie 94699932412592 in=216b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd45f40 con 0x56210bc5f240 2023-10-05T19:52:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== watch-notify(notify (1) cookie 94699931687040 notify 137438953475 ret 0) v3 ==== 246+0+0 (crc 0 0 0) 0x7f8930061020 con 0x56210bc5f240 2023-10-05T19:52:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f892effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94699931687040 notifier 4739 bl.length()=204 2023-10-05T19:52:09.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(171 notify.1 [notify cookie 94699932412592 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f892effd700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f88840032c0 con 0x56210bc5f240 2023-10-05T19:52:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(172 notify.1 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 43 ==== watch-notify(notify_complete (2) cookie 94699932412592 notify 137438953475 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f893005b4b0 con 0x56210bc5f240 2023-10-05T19:52:09.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:173 6.2 6:41fbcdf4:::pubsub..bucket.myfoo6%2fe814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd45f40 con 0x56210bc96fa0 2023-10-05T19:52:09.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 42 ==== osd_op_reply(173 pubsub..bucket.myfoo6/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.7 [delete] v32'15 uv14 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.141+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:174 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd45f40 con 0x56210bc92020 2023-10-05T19:52:09.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 65 ==== osd_op_reply(174 bud.buckets [call] v32'5 uv5 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8937830e40 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2023-10-05T19:52:09.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8937830e40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-10-05T19:52:09.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:175 7.3 7:c609908c:::notify.5:head [notify cookie 94699932376896 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd30e60 con 0x56210bc96fa0 2023-10-05T19:52:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 43 ==== watch-notify(notify (1) cookie 94699931695456 notify 137438953495 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x56210bcb5bb0 con 0x56210bc96fa0 2023-10-05T19:52:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f892e7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94699931695456 notifier 4739 bl.length()=170 2023-10-05T19:52:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 44 ==== osd_op_reply(175 notify.5 [notify cookie 94699932376896 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f892e7fc700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8914003d90 con 0x56210bc96fa0 2023-10-05T19:52:09.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 45 ==== osd_op_reply(176 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 46 ==== watch-notify(notify_complete (2) cookie 94699932376896 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56210bcb5770 con 0x56210bc96fa0 2023-10-05T19:52:09.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:177 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd31f10 con 0x56210bc5f240 2023-10-05T19:52:09.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 44 ==== osd_op_reply(177 NX5QOQKC6BH2IDN8HC7A [delete] v32'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8937830e40 10 removing email index: 2023-10-05T19:52:09.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8937830e40 10 removing user buckets index 2023-10-05T19:52:09.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8937830e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2023-10-05T19:52:09.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.145+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:178 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94699932376896 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd30e60 con 0x56210bc96fa0 2023-10-05T19:52:09.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 47 ==== watch-notify(notify (1) cookie 94699931694192 notify 137438953496 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x56210bcb5770 con 0x56210bc96fa0 2023-10-05T19:52:09.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892effd700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94699931694192 notifier 4739 bl.length()=160 2023-10-05T19:52:09.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892effd700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f88840032c0 con 0x56210bc96fa0 2023-10-05T19:52:09.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 48 ==== osd_op_reply(178 notify.6 [notify cookie 94699932376896 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 49 ==== watch-notify(notify_complete (2) cookie 94699932376896 notify 137438953496 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56210bbabbd0 con 0x56210bc96fa0 2023-10-05T19:52:09.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 50 ==== osd_op_reply(179 notify.6 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:180 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd31f10 con 0x56210bc92020 2023-10-05T19:52:09.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 66 ==== osd_op_reply(180 bud.buckets [delete] v32'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f8937830e40 10 removing user index: bud 2023-10-05T19:52:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f8937830e40 10 removing default.rgw.meta+users.uid+bud from cache 2023-10-05T19:52:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f8937830e40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2023-10-05T19:52:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:181 7.3 7:c609908c:::notify.5:head [notify cookie 94699932376896 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd30e60 con 0x56210bc96fa0 2023-10-05T19:52:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 51 ==== watch-notify(notify (1) cookie 94699931695456 notify 137438953497 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x56210bbabbd0 con 0x56210bc96fa0 2023-10-05T19:52:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892e7fc700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94699931695456 notifier 4739 bl.length()=152 2023-10-05T19:52:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892e7fc700 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:182 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8914003d90 con 0x56210bc96fa0 2023-10-05T19:52:09.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 52 ==== osd_op_reply(181 notify.5 [notify cookie 94699932376896 out=8b] v0'0 uv252 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 53 ==== watch-notify(notify_complete (2) cookie 94699932376896 notify 137438953497 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56210bcb0160 con 0x56210bc96fa0 2023-10-05T19:52:09.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.149+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 54 ==== osd_op_reply(182 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.153+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:183 8.4 8:267425a8:users.uid::bud:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bd31f10 con 0x7f8928007030 2023-10-05T19:52:09.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.153+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 33 ==== osd_op_reply(183 bud [call,delete] v32'3 uv3 ondisk = 0) v8 ==== 189+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.153+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:184 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94699931680256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc74210 con 0x56210bc92020 2023-10-05T19:52:09.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 67 ==== osd_op_reply(184 notify.0 [watch unwatch cookie 94699931680256] v32'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8937830e40 20 remove_watcher() i=0 2023-10-05T19:52:09.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8937830e40 2 removed watcher, disabling cache 2023-10-05T19:52:09.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:185 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94699931687040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc74210 con 0x56210bc5f240 2023-10-05T19:52:09.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 45 ==== osd_op_reply(185 notify.1 [watch unwatch cookie 94699931687040] v32'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8937830e40 20 remove_watcher() i=1 2023-10-05T19:52:09.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:186 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94699931688144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc74210 con 0x56210bc92020 2023-10-05T19:52:09.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 68 ==== osd_op_reply(186 notify.2 [watch unwatch cookie 94699931688144] v32'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8937830e40 20 remove_watcher() i=2 2023-10-05T19:52:09.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.157+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:187 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94699931690512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc74210 con 0x7f8928007030 2023-10-05T19:52:09.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.161+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 34 ==== osd_op_reply(187 notify.3 [watch unwatch cookie 94699931690512] v32'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.161+0000 7f8937830e40 20 remove_watcher() i=3 2023-10-05T19:52:09.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.161+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:188 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94699931691616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc74210 con 0x56210bc92020 2023-10-05T19:52:09.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.161+0000 7f8935365700 1 -- 172.21.15.167:0/700134766 <== osd.0 v2:172.21.15.118:6800/26580 69 ==== osd_op_reply(188 notify.4 [watch unwatch cookie 94699931691616] v32'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8928022020 con 0x56210bc92020 2023-10-05T19:52:09.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.161+0000 7f8937830e40 20 remove_watcher() i=4 2023-10-05T19:52:09.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.161+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:189 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94699931695456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc74210 con 0x56210bc96fa0 2023-10-05T19:52:09.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.165+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 55 ==== osd_op_reply(189 notify.5 [watch unwatch cookie 94699931695456] v32'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.165+0000 7f8937830e40 20 remove_watcher() i=5 2023-10-05T19:52:09.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.165+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:190 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94699931694192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc74210 con 0x56210bc96fa0 2023-10-05T19:52:09.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.165+0000 7f892ffff700 1 -- 172.21.15.167:0/700134766 <== osd.3 v2:172.21.15.167:6800/26773 56 ==== osd_op_reply(190 notify.6 [watch unwatch cookie 94699931694192] v32'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f892006e060 con 0x56210bc96fa0 2023-10-05T19:52:09.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.165+0000 7f8937830e40 20 remove_watcher() i=6 2023-10-05T19:52:09.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.165+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:191 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94699931701456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc74210 con 0x7f8928007030 2023-10-05T19:52:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.169+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.2 v2:172.21.15.167:6816/26774 35 ==== osd_op_reply(191 notify.7 [watch unwatch cookie 94699931701456] v32'254 uv252 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x7f8928007030 2023-10-05T19:52:09.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.169+0000 7f8937830e40 20 remove_watcher() i=7 2023-10-05T19:52:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.169+0000 7f89067e4700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:09.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.169+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:192 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94699931703840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56210bc74210 con 0x56210bc5f240 2023-10-05T19:52:09.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 <== osd.1 v2:172.21.15.167:6808/26775 46 ==== osd_op_reply(192 data_loggenerations_metadata [watch unwatch cookie 94699931703840] v32'242 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f893000a5a0 con 0x56210bc5f240 2023-10-05T19:52:09.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bc92020 msgr2=0x56210bc94400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bc92020 0x56210bc94400 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bc5f240 msgr2=0x56210bc900a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bc5f240 0x56210bc900a0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8928007030 msgr2=0x7f8928001620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8928007030 0x7f8928001620 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bc96fa0 msgr2=0x56210bc99380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bc96fa0 0x56210bc99380 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8918030c50 msgr2=0x7f8918033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8918030c50 0x7f8918033100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8920004170 tx=0x7f8920001380 comp rx=0 tx=0).stop 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8935b66700 1 -- 172.21.15.167:0/700134766 reap_dead start 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 msgr2=0x56210bc84580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc84580 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8928005540 tx=0x7f8928003050 comp rx=0 tx=0).stop 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 shutdown_connections 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/700134766 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bc5e930 0x56210bc84580 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 >> 172.21.15.167:0/700134766 conn(0x56210bc5a350 msgr2=0x56210bc77fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 shutdown_connections 2023-10-05T19:52:09.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/700134766 wait complete. 2023-10-05T19:52:09.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bcbfd60 msgr2=0x56210bcc2170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x56210bcbfd60 0x56210bcc2170 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bcca480 msgr2=0x56210bccc890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x56210bcca480 0x56210bccc890 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56210bcc3490 msgr2=0x56210bcc5870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x56210bcc3490 0x56210bcc5870 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bcc6c70 msgr2=0x56210bcc9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x56210bcc6c70 0x56210bcc9080 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f887c030c50 msgr2=0x7f887c033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f887c030c50 0x7f887c033100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x56210bca2410 tx=0x7f893000ae50 comp rx=0 tx=0).stop 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 msgr2=0x56210bcb5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8935365700 1 -- 172.21.15.167:0/2737648425 reap_dead start 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcb5170 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8920000c00 tx=0x7f8920037000 comp rx=0 tx=0).stop 2023-10-05T19:52:09.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 shutdown_connections 2023-10-05T19:52:09.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 --2- 172.21.15.167:0/2737648425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x56210bcaf710 0x56210bcb5170 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 >> 172.21.15.167:0/2737648425 conn(0x56210bcaaad0 msgr2=0x56210bca8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:09.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 shutdown_connections 2023-10-05T19:52:09.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.173+0000 7f8937830e40 1 -- 172.21.15.167:0/2737648425 wait complete. 2023-10-05T19:52:09.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2023-10-05T19:52:09.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2023-10-05T19:52:09.185 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2023-10-05T19:52:09.270 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:09.270 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:09.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ed2a02e40 1 Processor -- start 2023-10-05T19:52:09.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ed2a02e40 1 -- start start 2023-10-05T19:52:09.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ed2a02e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557b85c72e50 0x557b85c73220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ed2a02e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557b85bc1bd0 con 0x557b85c73760 2023-10-05T19:52:09.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ed2a02e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x557b85b7eee0 con 0x557b85c72e50 2023-10-05T19:52:09.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ed0537700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x557b85c72e50 0x557b85c73220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ecfd36700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x557b85c73760 0x557b85c73b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:34612/0 (socket says 172.21.15.167:34612) 2023-10-05T19:52:09.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ecfd36700 1 -- 172.21.15.167:0/3158059083 learned_addr learned my addr 172.21.15.167:0/3158059083 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:09.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ed0537700 1 -- 172.21.15.167:0/3158059083 >> v1:172.21.15.118:6789/0 conn(0x557b85c73760 legacy=0x557b85c73b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.265+0000 7f3ed0537700 1 -- 172.21.15.167:0/3158059083 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b85c79ec0 con 0x557b85c72e50 2023-10-05T19:52:09.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed0537700 1 --2- 172.21.15.167:0/3158059083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85c73220 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800a520 tx=0x7f3eb8005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37caa1e0516968ec server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ecf535700 1 -- 172.21.15.167:0/3158059083 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3eb800f590 con 0x557b85c72e50 2023-10-05T19:52:09.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ecf535700 1 -- 172.21.15.167:0/3158059083 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb800f6f0 con 0x557b85c72e50 2023-10-05T19:52:09.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ecf535700 1 -- 172.21.15.167:0/3158059083 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3eb800f880 con 0x557b85c72e50 2023-10-05T19:52:09.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3158059083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 msgr2=0x557b85c73220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/3158059083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85c73220 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800a520 tx=0x7f3eb8005d40 comp rx=0 tx=0).stop 2023-10-05T19:52:09.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3158059083 shutdown_connections 2023-10-05T19:52:09.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/3158059083 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85c73220 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3158059083 >> 172.21.15.167:0/3158059083 conn(0x557b85c6e9d0 msgr2=0x557b85c70de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:09.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3158059083 shutdown_connections 2023-10-05T19:52:09.275 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3158059083 wait complete. 2023-10-05T19:52:09.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 Processor -- start 2023-10-05T19:52:09.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 -- start start 2023-10-05T19:52:09.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85c99f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed2a02e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b85b42e30 con 0x557b85c72e50 2023-10-05T19:52:09.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed0537700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85c99f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed0537700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85c99f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36640/0 (socket says 172.21.15.167:36640) 2023-10-05T19:52:09.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed0537700 1 -- 172.21.15.167:0/1357057036 learned_addr learned my addr 172.21.15.167:0/1357057036 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:09.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.269+0000 7f3ed0537700 1 -- 172.21.15.167:0/1357057036 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb800a0e0 con 0x557b85c72e50 2023-10-05T19:52:09.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed0537700 1 --2- 172.21.15.167:0/1357057036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85c99f60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8005d80 tx=0x7f3eb8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a8cf6a44f2f059 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ece533700 1 -- 172.21.15.167:0/1357057036 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3eb800f860 con 0x557b85c72e50 2023-10-05T19:52:09.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ece533700 1 -- 172.21.15.167:0/1357057036 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb800f9c0 con 0x557b85c72e50 2023-10-05T19:52:09.277 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ece533700 1 -- 172.21.15.167:0/1357057036 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3eb800fb70 con 0x557b85c72e50 2023-10-05T19:52:09.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1357057036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 msgr2=0x557b85c99f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1357057036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85c99f60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8005d80 tx=0x7f3eb8014000 comp rx=0 tx=0).stop 2023-10-05T19:52:09.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1357057036 shutdown_connections 2023-10-05T19:52:09.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1357057036 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85c99f60 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1357057036 >> 172.21.15.167:0/1357057036 conn(0x557b85c6e9d0 msgr2=0x557b85c95b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:09.278 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1357057036 shutdown_connections 2023-10-05T19:52:09.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1357057036 wait complete. 2023-10-05T19:52:09.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 Processor -- start 2023-10-05T19:52:09.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 -- start start 2023-10-05T19:52:09.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85ca0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed2a02e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b85b15ed0 con 0x557b85c72e50 2023-10-05T19:52:09.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed0537700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85ca0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed0537700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85ca0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36654/0 (socket says 172.21.15.167:36654) 2023-10-05T19:52:09.280 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.273+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 learned_addr learned my addr 172.21.15.167:0/1410898567 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:09.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b85c79ec0 con 0x557b85c72e50 2023-10-05T19:52:09.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3ed0537700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85ca0bc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800a520 tx=0x7f3eb801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3eccd30700 1 -- 172.21.15.167:0/1410898567 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3eb802f430 con 0x557b85c72e50 2023-10-05T19:52:09.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3eccd30700 1 -- 172.21.15.167:0/1410898567 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb802f590 con 0x557b85c72e50 2023-10-05T19:52:09.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b85ca1100 con 0x557b85c72e50 2023-10-05T19:52:09.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3eccd30700 1 -- 172.21.15.167:0/1410898567 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3eb802f700 con 0x557b85c72e50 2023-10-05T19:52:09.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b85ca1540 con 0x557b85c72e50 2023-10-05T19:52:09.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3eccd30700 1 -- 172.21.15.167:0/1410898567 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3eb8038450 con 0x557b85c72e50 2023-10-05T19:52:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3eccd30700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3eb0030c50 0x7f3eb0033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.277+0000 7f3eccd30700 1 -- 172.21.15.167:0/1410898567 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f3eb802b070 con 0x557b85c72e50 2023-10-05T19:52:09.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ecfd36700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3eb0030c50 0x7f3eb0033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85c73760 0x557b85cac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85caccf0 con 0x557b85c73760 2023-10-05T19:52:09.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed0d38700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85c73760 0x557b85cac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.285 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ecfd36700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3eb0030c50 0x7f3eb0033100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0001e90 tx=0x7f3ec00013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed0d38700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85c73760 0x557b85cac680 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ec800a500 con 0x557b85c73760 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 20 realm 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ca9ce0 con 0x557b85c73760 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ec800a500 con 0x557b85c73760 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:09.287 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cad7d0 con 0x557b85c73760 2023-10-05T19:52:09.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ec800a500 con 0x557b85c73760 2023-10-05T19:52:09.288 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cae600 0x557b85cb09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb0f20 con 0x557b85cae600 2023-10-05T19:52:09.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.281+0000 7f3ed0537700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cae600 0x557b85cb09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.289 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed0537700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cae600 0x557b85cb09e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3eb8035070 con 0x557b85cae600 2023-10-05T19:52:09.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:09.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.290 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb17c0 con 0x557b85c73760 2023-10-05T19:52:09.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3ec800a500 con 0x557b85c73760 2023-10-05T19:52:09.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:09.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed2a02e40 20 searching for the correct realm 2023-10-05T19:52:09.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85cb3580 0x557b85cb5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cb3580 2023-10-05T19:52:09.291 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ecfd36700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85cb3580 0x557b85cb5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.292 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ecfd36700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85cb3580 0x557b85cb5960 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0006070 con 0x557b85cb3580 2023-10-05T19:52:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cae600 2023-10-05T19:52:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb8035070 con 0x557b85cae600 2023-10-05T19:52:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed0537700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3eb801bbe0 0x7f3eb80079b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.293 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.285+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3eb801bbe0 0x7f3eb80079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.294 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3eb801bbe0 0x7f3eb80079b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.295 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cb3580 2023-10-05T19:52:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0006070 con 0x557b85cb3580 2023-10-05T19:52:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.296 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.289+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cae600 2023-10-05T19:52:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb8035070 con 0x557b85cae600 2023-10-05T19:52:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cae600 2023-10-05T19:52:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb8035070 con 0x557b85cae600 2023-10-05T19:52:09.297 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.298 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.299 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cae600 2023-10-05T19:52:09.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.293+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb8035070 con 0x557b85cae600 2023-10-05T19:52:09.300 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cb3580 2023-10-05T19:52:09.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0006070 con 0x557b85cb3580 2023-10-05T19:52:09.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.301 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cae600 2023-10-05T19:52:09.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb8035070 con 0x557b85cae600 2023-10-05T19:52:09.302 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cb3580 2023-10-05T19:52:09.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0006070 con 0x557b85cb3580 2023-10-05T19:52:09.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.303 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.297+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.304 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cb3580 2023-10-05T19:52:09.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0006070 con 0x557b85cb3580 2023-10-05T19:52:09.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.305 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85c73760 2023-10-05T19:52:09.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.306 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cb3580 2023-10-05T19:52:09.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0006070 con 0x557b85cb3580 2023-10-05T19:52:09.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.307 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.301+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cae600 2023-10-05T19:52:09.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb8035070 con 0x557b85cae600 2023-10-05T19:52:09.308 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cae600 2023-10-05T19:52:09.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb8035070 con 0x557b85cae600 2023-10-05T19:52:09.309 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cb3580 2023-10-05T19:52:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0006070 con 0x557b85cb3580 2023-10-05T19:52:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cae600 2023-10-05T19:52:09.310 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3eb8035070 con 0x557b85cae600 2023-10-05T19:52:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb5ea0 con 0x557b85cae600 2023-10-05T19:52:09.311 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed2a02e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed2a02e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed2a02e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed2a02e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.312 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb2330 con 0x557b85c73760 2023-10-05T19:52:09.313 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.305+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb2c80 con 0x557b85cae600 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb62e0 con 0x557b85cae600 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:09.314 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6690 con 0x557b85cb3580 2023-10-05T19:52:09.315 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f3ec0006070 con 0x557b85cb3580 2023-10-05T19:52:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85c73760 2023-10-05T19:52:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.316 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6e50 con 0x557b85cae600 2023-10-05T19:52:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.309+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb8290 con 0x557b85cb3580 2023-10-05T19:52:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb8290 con 0x557b85cae600 2023-10-05T19:52:09.317 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6e50 con 0x7f3eb801bbe0 2023-10-05T19:52:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.318 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85c73760 2023-10-05T19:52:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85c73760 2023-10-05T19:52:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.319 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85cb3580 2023-10-05T19:52:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.320 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.313+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85c73760 2023-10-05T19:52:09.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85cae600 2023-10-05T19:52:09.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.321 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85cae600 2023-10-05T19:52:09.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.322 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85c73760 2023-10-05T19:52:09.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x7f3eb801bbe0 2023-10-05T19:52:09.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.323 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85c73760 2023-10-05T19:52:09.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.317+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x7f3eb801bbe0 2023-10-05T19:52:09.324 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85cae600 2023-10-05T19:52:09.325 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6a40 con 0x557b85cb3580 2023-10-05T19:52:09.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85c73760 2023-10-05T19:52:09.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85cae600 2023-10-05T19:52:09.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.321+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85cb3580 2023-10-05T19:52:09.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85c73760 2023-10-05T19:52:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8014040 con 0x557b85c73760 2023-10-05T19:52:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85c73760 2023-10-05T19:52:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85c73760 2023-10-05T19:52:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85cb3580 2023-10-05T19:52:09.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.331 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85c73760 2023-10-05T19:52:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.325+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85cb3580 2023-10-05T19:52:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85cae600 2023-10-05T19:52:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85cae600 2023-10-05T19:52:09.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.329+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85cb3580 2023-10-05T19:52:09.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85cae600 2023-10-05T19:52:09.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3ec0028040 con 0x557b85cae600 2023-10-05T19:52:09.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:09.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:09.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:09.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:09.338 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6e20 con 0x557b85cae600 2023-10-05T19:52:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb6df0 con 0x557b85c73760 2023-10-05T19:52:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb7770 con 0x557b85cae600 2023-10-05T19:52:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.333+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:09.341 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb7770 con 0x557b85cae600 2023-10-05T19:52:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.342 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb7870 con 0x7f3eb801bbe0 2023-10-05T19:52:09.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 zone default found 2023-10-05T19:52:09.343 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 4 Realm: () 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 zonegroup default 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb7870 con 0x7f3eb801bbe0 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb91f0 con 0x557b85cb3580 2023-10-05T19:52:09.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb95a0 con 0x557b85cb3580 2023-10-05T19:52:09.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 started sync module instance, tier type = 2023-10-05T19:52:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:09.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.337+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb88b0 con 0x557b85cae600 2023-10-05T19:52:09.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.341+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.341+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93989014045632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb8dd0 con 0x557b85cae600 2023-10-05T19:52:09.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.341+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cba330 con 0x557b85c73760 2023-10-05T19:52:09.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.345+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.345+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93989014052416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb8dd0 con 0x557b85c73760 2023-10-05T19:52:09.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.345+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93989014045632] v32'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.349 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.345+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cb9950 con 0x557b85cae600 2023-10-05T19:52:09.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.345+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93989014052416] v32'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.345+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.345+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93989014053520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cba8f0 con 0x557b85cae600 2023-10-05T19:52:09.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.345+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbb190 con 0x7f3eb801bbe0 2023-10-05T19:52:09.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.349+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.349+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93989014055440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbb350 con 0x7f3eb801bbe0 2023-10-05T19:52:09.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.349+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbbed0 con 0x557b85cae600 2023-10-05T19:52:09.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.349+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93989014053520] v32'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.349+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93989014055440] v32'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.353+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.353+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93989014059488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbb350 con 0x557b85cae600 2023-10-05T19:52:09.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.353+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbbe30 con 0x557b85cb3580 2023-10-05T19:52:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.353+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.353+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93989014061776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbcc10 con 0x557b85cb3580 2023-10-05T19:52:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.353+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbd6f0 con 0x557b85cb3580 2023-10-05T19:52:09.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.353+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93989014059488] v32'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cae600 2023-10-05T19:52:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v32'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 93989014061776] v32'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93989014056544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbdaf0 con 0x557b85cb3580 2023-10-05T19:52:09.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbe390 con 0x7f3eb801bbe0 2023-10-05T19:52:09.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93989014056544] v32'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'255 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93989014067952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbe430 con 0x7f3eb801bbe0 2023-10-05T19:52:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 20 add_watcher() i=0 2023-10-05T19:52:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 20 add_watcher() i=1 2023-10-05T19:52:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 20 add_watcher() i=2 2023-10-05T19:52:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 20 add_watcher() i=3 2023-10-05T19:52:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 20 add_watcher() i=4 2023-10-05T19:52:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 20 add_watcher() i=5 2023-10-05T19:52:09.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 20 add_watcher() i=6 2023-10-05T19:52:09.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93989014067952] v32'256 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 20 add_watcher() i=7 2023-10-05T19:52:09.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:09.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.357+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cc1460 con 0x557b85c73760 2023-10-05T19:52:09.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93989014069056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cbea20 con 0x557b85c73760 2023-10-05T19:52:09.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93989014069056] v32'243 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ea1fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:09.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ed2a02e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:09.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ed2a02e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:09.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ed2a02e40 1 Processor -- start 2023-10-05T19:52:09.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ed2a02e40 1 -- start start 2023-10-05T19:52:09.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ed2a02e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85ccc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.368 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.361+0000 7f3ed2a02e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b85ccc5e0 con 0x557b85ccbcd0 2023-10-05T19:52:09.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ecfd36700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85ccc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ecfd36700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85ccc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36656/0 (socket says 172.21.15.167:36656) 2023-10-05T19:52:09.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ecfd36700 1 -- 172.21.15.167:0/3750563989 learned_addr learned my addr 172.21.15.167:0/3750563989 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:09.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ecfd36700 1 -- 172.21.15.167:0/3750563989 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b85ccc720 con 0x557b85ccbcd0 2023-10-05T19:52:09.369 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ecfd36700 1 --2- 172.21.15.167:0/3750563989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85ccc0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x557b85cb2280 tx=0x7f3ec0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3691d63066c376cb server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ea17e2700 1 -- 172.21.15.167:0/3750563989 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ec003b070 con 0x557b85ccbcd0 2023-10-05T19:52:09.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ea17e2700 1 -- 172.21.15.167:0/3750563989 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0022040 con 0x557b85ccbcd0 2023-10-05T19:52:09.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ea17e2700 1 -- 172.21.15.167:0/3750563989 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ec0021040 con 0x557b85ccbcd0 2023-10-05T19:52:09.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3750563989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 msgr2=0x557b85ccc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/3750563989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85ccc0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x557b85cb2280 tx=0x7f3ec0010000 comp rx=0 tx=0).stop 2023-10-05T19:52:09.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3750563989 shutdown_connections 2023-10-05T19:52:09.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/3750563989 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85ccc0a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3750563989 >> 172.21.15.167:0/3750563989 conn(0x557b85cc7090 msgr2=0x557b85cc51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:09.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3750563989 shutdown_connections 2023-10-05T19:52:09.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/3750563989 wait complete. 2023-10-05T19:52:09.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 Processor -- start 2023-10-05T19:52:09.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 -- start start 2023-10-05T19:52:09.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85cd17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.365+0000 7f3ed2a02e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b85cd27a0 con 0x557b85ccbcd0 2023-10-05T19:52:09.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3ecfd36700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85cd17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3ecfd36700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85cd17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:36664/0 (socket says 172.21.15.167:36664) 2023-10-05T19:52:09.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3ecfd36700 1 -- 172.21.15.167:0/69142109 learned_addr learned my addr 172.21.15.167:0/69142109 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:09.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3ecfd36700 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b85bc1bd0 con 0x557b85ccbcd0 2023-10-05T19:52:09.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3ecfd36700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85cd17a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3eb802f000 tx=0x7f3ec0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3e1b7fe700 1 -- 172.21.15.167:0/69142109 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ec0021070 con 0x557b85ccbcd0 2023-10-05T19:52:09.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3e1b7fe700 1 -- 172.21.15.167:0/69142109 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0041630 con 0x557b85ccbcd0 2023-10-05T19:52:09.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b85cd1da0 con 0x557b85ccbcd0 2023-10-05T19:52:09.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3e1b7fe700 1 -- 172.21.15.167:0/69142109 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ec0046070 con 0x557b85ccbcd0 2023-10-05T19:52:09.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.369+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b85cd2240 con 0x557b85ccbcd0 2023-10-05T19:52:09.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.373+0000 7f3e1b7fe700 1 -- 172.21.15.167:0/69142109 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3ec003e020 con 0x557b85ccbcd0 2023-10-05T19:52:09.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.373+0000 7f3e1b7fe700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3e10030c50 0x7f3e10033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.373+0000 7f3e1b7fe700 1 -- 172.21.15.167:0/69142109 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f3ec002e040 con 0x557b85ccbcd0 2023-10-05T19:52:09.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.373+0000 7f3ed0d38700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3e10030c50 0x7f3e10033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.373+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cdc3f0 0x557b85cde800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.373+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdeea0 con 0x557b85cdc3f0 2023-10-05T19:52:09.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.373+0000 7f3ed0537700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cdc3f0 0x557b85cde800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.373+0000 7f3ed0d38700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3e10030c50 0x7f3e10033100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x557b85cbe980 tx=0x7f3ec800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.373+0000 7f3ed0537700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cdc3f0 0x557b85cde800 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'34 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3eb804e040 con 0x557b85cdc3f0 2023-10-05T19:52:09.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557b85cdfb70 0x557b85ce1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ce2680 con 0x557b85cdfb70 2023-10-05T19:52:09.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ecfd36700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557b85cdfb70 0x557b85ce1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ecfd36700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557b85cdfb70 0x557b85ce1f50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ecfd36700 1 -- 172.21.15.167:0/69142109 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cdfb70 2023-10-05T19:52:09.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85ce3350 0x557b85ce5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ce5e90 con 0x557b85ce3350 2023-10-05T19:52:09.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ed0d38700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85ce3350 0x557b85ce5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.377+0000 7f3ed0d38700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85ce3350 0x557b85ce5760 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.381+0000 7f3ed0d38700 1 -- 172.21.15.167:0/69142109 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85ce3350 2023-10-05T19:52:09.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.381+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85ce6b60 0x557b85ce8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:09.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.381+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ce96a0 con 0x557b85ce6b60 2023-10-05T19:52:09.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.381+0000 7f3ed0537700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85ce6b60 0x557b85ce8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:09.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.381+0000 7f3ed0537700 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85ce6b60 0x557b85ce8f70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:09.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.385+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'244 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.385+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ce9cf0 con 0x557b85ce6b60 2023-10-05T19:52:09.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.385+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'74 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.385+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cea310 con 0x557b85ce3350 2023-10-05T19:52:09.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.389+0000 7f3ed0d38700 1 -- 172.21.15.167:0/69142109 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'50 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85ce3350 2023-10-05T19:52:09.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.389+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cea930 con 0x557b85cdc3f0 2023-10-05T19:52:09.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.389+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.389+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ceae20 con 0x557b85ce6b60 2023-10-05T19:52:09.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.393+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'48 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.393+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ceae20 con 0x557b85cdc3f0 2023-10-05T19:52:09.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.393+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.393+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb060 con 0x557b85cdc3f0 2023-10-05T19:52:09.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.397+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.397+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb060 con 0x557b85ce6b60 2023-10-05T19:52:09.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.397+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'75 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.397+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb000 con 0x557b85ce3350 2023-10-05T19:52:09.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.401+0000 7f3ed0d38700 1 -- 172.21.15.167:0/69142109 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'32 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85ce3350 2023-10-05T19:52:09.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.401+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb620 con 0x557b85cdc3f0 2023-10-05T19:52:09.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.401+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.401+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb620 con 0x557b85ce6b60 2023-10-05T19:52:09.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.405+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'67 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.410 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.405+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdaf70 con 0x557b85ce6b60 2023-10-05T19:52:09.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.409+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'245 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.412 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.409+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdaf70 con 0x557b85cdc3f0 2023-10-05T19:52:09.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.409+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'71 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.409+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdaf70 con 0x557b85ce6b60 2023-10-05T19:52:09.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.413+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'76 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.413+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdaee0 con 0x557b85ce3350 2023-10-05T19:52:09.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.413+0000 7f3ed0d38700 1 -- 172.21.15.167:0/69142109 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85ce3350 2023-10-05T19:52:09.419 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.413+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb150 con 0x557b85cdc3f0 2023-10-05T19:52:09.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.417+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.417+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb150 con 0x557b85ce6b60 2023-10-05T19:52:09.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.417+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'246 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.417+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb150 con 0x557b85cdc3f0 2023-10-05T19:52:09.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.421+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'72 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.421+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb150 con 0x557b85cdc3f0 2023-10-05T19:52:09.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.425+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'40 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.429 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.425+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb150 con 0x557b85ce3350 2023-10-05T19:52:09.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.425+0000 7f3ed0d38700 1 -- 172.21.15.167:0/69142109 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85ce3350 2023-10-05T19:52:09.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.425+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb150 con 0x557b85cdc3f0 2023-10-05T19:52:09.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.429+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'36 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.429+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb150 con 0x557b85ce3350 2023-10-05T19:52:09.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.429+0000 7f3ed0d38700 1 -- 172.21.15.167:0/69142109 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'26 uv20 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85ce3350 2023-10-05T19:52:09.436 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.433+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85cdb150 con 0x557b85ce3350 2023-10-05T19:52:09.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.433+0000 7f3ed0d38700 1 -- 172.21.15.167:0/69142109 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'51 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85ce3350 2023-10-05T19:52:09.438 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.433+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ceb940 con 0x557b85ce3350 2023-10-05T19:52:09.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.437+0000 7f3ed0d38700 1 -- 172.21.15.167:0/69142109 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'32 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85ce3350 2023-10-05T19:52:09.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.437+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ceb940 con 0x557b85cdc3f0 2023-10-05T19:52:09.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.437+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'42 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.437+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ceb940 con 0x557b85ce6b60 2023-10-05T19:52:09.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.441+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'49 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.441+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ceb940 con 0x557b85cdc3f0 2023-10-05T19:52:09.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.441+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'73 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cdc3f0 2023-10-05T19:52:09.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.441+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ceb940 con 0x557b85ce6b60 2023-10-05T19:52:09.449 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.445+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'68 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.450 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.445+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ceb940 con 0x557b85cdfb70 2023-10-05T19:52:09.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.445+0000 7f3ecfd36700 1 -- 172.21.15.167:0/69142109 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cdfb70 2023-10-05T19:52:09.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.449+0000 7f3e18ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:09.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.449+0000 7f3ed2a02e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:09.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.449+0000 7f3ed2a02e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:09.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.449+0000 7f3e0cff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:52:39 2023 2023-10-05T19:52:09.456 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:09.456 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3dfbfff700 20 reqs_thread_entry: start 2023-10-05T19:52:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 20 get_system_obj_state: rctx=0x7ffec380de58 obj=default.rgw.meta:users.uid:fud state=0x557b85b4e0b0 s->prefetch_data=0 2023-10-05T19:52:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-10-05T19:52:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4a640 con 0x7f3eb801bbe0 2023-10-05T19:52:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3e0e7fc700 20 reqs_thread_entry: start 2023-10-05T19:52:09.457 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(102 fud [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x16 2023-10-05T19:52:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:52:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 10 cache get: name=default.rgw.meta+users.uid+fud : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:09.458 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:103 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4d0d0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.459 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(103 fud [call,call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 273+0+469 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=346 2023-10-05T19:52:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-10-05T19:52:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-10-05T19:52:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4d0d0 con 0x557b85c73760 2023-10-05T19:52:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(104 fud.buckets [call out=184b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 20 get_system_obj_state: rctx=0x7ffec380db00 obj=default.rgw.meta:root:.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 state=0x557b85b4e0b0 s->prefetch_data=0 2023-10-05T19:52:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 : miss 2023-10-05T19:52:09.460 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.453+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 8.15 8:ab014446:root::.bucket.meta.myfoo7%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4c8e0 con 0x557b85cb3580 2023-10-05T19:52:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(105 .bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 291+0+282 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 info.flags=0x16 2023-10-05T19:52:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 to cache LRU end 2023-10-05T19:52:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:09.462 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 20 Read xattr: user.rgw.acl 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:106 8.15 8:ab014446:root::.bucket.meta.myfoo7%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4f370 con 0x557b85cb3580 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(106 .bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 [call,call out=48b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv6 ondisk = 0) v8 ==== 333+0+619 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 20 rados_obj.operate() r=0 bl.length=353 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 info.flags=0x13 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 to cache LRU end 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.463 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 2023-10-05T19:52:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo7[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T19:52:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:107 4.11 4:8809f84b:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4ed60 con 0x557b85cb3580 2023-10-05T19:52:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(107 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.464 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 4.39 4:9e36b86f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4ed60 con 0x557b85cb3580 2023-10-05T19:52:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(108 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.1 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.457+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 4.f 4:f18abf2e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4ed60 con 0x7f3eb801bbe0 2023-10-05T19:52:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.461+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(109 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.465 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.461+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 4.2b 4:d7201848:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4ed60 con 0x7f3eb801bbe0 2023-10-05T19:52:09.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.461+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(110 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.466 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.461+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 4.3e 4:7c7c0661:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4e880 con 0x557b85cae600 2023-10-05T19:52:09.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.461+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(111 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.468 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.461+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 4.1 4:81fa68bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4e880 con 0x7f3eb801bbe0 2023-10-05T19:52:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.465+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(112 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5 [call out=376b] v0'0 uv17 ondisk = 0) v8 ==== 194+0+376 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.465+0000 7f3ed2a02e40 10 cls_bucket_list_unordered: got fourteen 2023-10-05T19:52:09.469 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.465+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 4.1c 4:3af7383c:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4e880 con 0x7f3eb801bbe0 2023-10-05T19:52:09.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.465+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(113 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.470 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.465+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:114 4.2f 4:f7276528:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4e880 con 0x557b85c73760 2023-10-05T19:52:09.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.465+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(114 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.471 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.465+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 4.11 4:88e3337e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4e8c0 con 0x557b85cb3580 2023-10-05T19:52:09.472 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.469+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(115 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.8 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.473 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.469+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 4.38 4:1d572ab0:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4e8c0 con 0x557b85cae600 2023-10-05T19:52:09.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.469+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(116 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.474 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.469+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:117 4.12 4:4bbcb4a7:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4e8c0 con 0x557b85c73760 2023-10-05T19:52:09.475 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.469+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(117 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.469+0000 7f3ed2a02e40 20 get_obj_state: rctx=0x7ffec380db20 obj=myfoo7:fourteen state=0x557b85d4d908 s->prefetch_data=0 2023-10-05T19:52:09.476 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.469+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:118 3.11s0 3:895b77e7:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4e8c0 con 0x557b85cae600 2023-10-05T19:52:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.473+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(118 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8_fourteen [getxattrs out=852b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 238+0+868 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.473+0000 7f3ed2a02e40 10 manifest: total_size = 8 2023-10-05T19:52:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.473+0000 7f3ed2a02e40 20 get_obj_state: setting s->obj_tag to e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.662086886005588885 2023-10-05T19:52:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.473+0000 7f3ed2a02e40 20 get_obj_state: rctx=0x7ffec380db20 obj=myfoo7:fourteen state=0x557b85d4d908 s->prefetch_data=0 2023-10-05T19:52:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.473+0000 7f3ed2a02e40 20 prepare_atomic_modification: state is not atomic. state=0x557b85d4d908 2023-10-05T19:52:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.473+0000 7f3ed2a02e40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5 2023-10-05T19:52:09.477 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.473+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:119 4.1 4:81fa68bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d53a10 con 0x7f3eb801bbe0 2023-10-05T19:52:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.473+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(119 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5 [stat,call,call] v32'18 uv18 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.479 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.473+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:120 3.11s0 3:895b77e7:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d519b0 con 0x557b85cae600 2023-10-05T19:52:09.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(120 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8_fourteen [call] v32'4 uv4 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:121 4.1 4:81fa68bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d54560 con 0x7f3eb801bbe0 2023-10-05T19:52:09.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo7 : miss 2023-10-05T19:52:09.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.483 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:122 6.11 6:8826b99d:::bucket.sync-source-hints.myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d56de0 con 0x557b85cb3580 2023-10-05T19:52:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(122 bucket.sync-source-hints.myfoo7 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo7 info.flags=0x0 2023-10-05T19:52:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 10 adding default.rgw.log++bucket.sync-source-hints.myfoo7 to cache LRU end 2023-10-05T19:52:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo7 : miss 2023-10-05T19:52:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:09.484 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.477+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:123 6.17 6:e82d5341:::bucket.sync-target-hints.myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d54560 con 0x557b85c73760 2023-10-05T19:52:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(123 bucket.sync-target-hints.myfoo7 [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 217+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo7 info.flags=0x0 2023-10-05T19:52:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 10 adding default.rgw.log++bucket.sync-target-hints.myfoo7 to cache LRU end 2023-10-05T19:52:09.486 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 10 chain_cache_entry: cache_locator= 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 20 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): starting attempt 1 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): :myfoo7[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8]) start_after="_multipart_", prefix="_multipart_, delimiter="", shard_id=-1", num_entries=1001, list_versions=0, expansion_factor=1, force_check_filter is unset 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:124 4.11 4:8809f84b:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d56db0 con 0x557b85cb3580 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:125 4.39 4:9e36b86f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4d6e0 con 0x557b85cb3580 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:126 4.f 4:f18abf2e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85dd3480 con 0x7f3eb801bbe0 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:127 4.2b 4:d7201848:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85dd5e00 con 0x7f3eb801bbe0 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:128 4.3e 4:7c7c0661:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85dd8770 con 0x557b85cae600 2023-10-05T19:52:09.487 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:129 4.1 4:81fa68bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ddb0b0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:130 4.1c 4:3af7383c:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ddda40 con 0x7f3eb801bbe0 2023-10-05T19:52:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:131 4.2f 4:f7276528:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de0900 con 0x557b85c73760 2023-10-05T19:52:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:132 4.11 4:88e3337e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de37b0 con 0x557b85cb3580 2023-10-05T19:52:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:133 4.38 4:1d572ab0:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de66b0 con 0x557b85cae600 2023-10-05T19:52:09.488 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:134 4.12 4:4bbcb4a7:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85c73760 2023-10-05T19:52:09.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(121 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5 [stat,call,call] v32'19 uv19 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ece533700 20 handle_completion(): completion ok for obj=fourteen 2023-10-05T19:52:09.490 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== osd_op_reply(126 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 28 ==== osd_op_reply(127 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(124 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(128 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(133 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 29 ==== osd_op_reply(129 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5 [call out=124b] v0'0 uv19 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.481+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(131 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 30 ==== osd_op_reply(130 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(125 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.1 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(134 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.491 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(132 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.8 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, count=0, is_truncated=0 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, last_entry NOT SET 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8])"; uploads.size()=0; is_truncated=0 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo7[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8]) 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 20 lifecycle: get_system_obj_state: rctx=0x7ffec380d5b8 obj=default.rgw.meta:root:myfoo7 state=0x557b85b4e0b0 s->prefetch_data=0 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo7 : miss 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d56db0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 31 ==== osd_op_reply(135 myfoo7 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv42 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.492 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x16 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: adding default.rgw.meta+root+myfoo7 to cache LRU end 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 20 lifecycle: get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 20 lifecycle: Read xattr: user.rgw.idtag 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo7 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 20 lifecycle: rados->read ofs=0 len=0 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de37b0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 32 ==== osd_op_reply(136 myfoo7 [call,call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv42 ondisk = 0) v8 ==== 276+0+289 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 20 lifecycle: rados_obj.operate() r=0 bl.length=166 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x13 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: moving default.rgw.meta+root+myfoo7 to cache LRU end 2023-10-05T19:52:09.493 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.494 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:137 8.15 8:ab014446:root::.bucket.meta.myfoo7%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85cb3580 2023-10-05T19:52:09.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(137 .bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 [delete,create,call,call,writefull 0~353,setxattr (123)] v32'7 uv7 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 info.flags=0x17 2023-10-05T19:52:09.495 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 to cache LRU end 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 10 lifecycle: distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8, ofs0, ns] 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:138 7.15 7:a93a5511:::notify.2:head [notify cookie 93989015295280 in=739b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d53ff0 con 0x557b85cae600 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.485+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== watch-notify(notify (1) cookie 93989014053520 notify 137438953515 ret 0) v3 ==== 769+0+0 (crc 0 0 0) 0x7f3eb8080040 con 0x557b85cae600 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ecdd32700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 93989014053520 notifier 4745 bl.length()=727 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ecdd32700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 info.flags=0x17 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ecdd32700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 to cache LRU end 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ecdd32700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ecdd32700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:139 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e20003480 con 0x557b85cae600 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(138 notify.2 [notify cookie 93989015295280 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.496 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(139 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== watch-notify(notify_complete (2) cookie 93989015295280 notify 137438953515 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557b85ca1540 con 0x557b85cae600 2023-10-05T19:52:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed2a02e40 20 lifecycle: handle_bi_update(): bucket=:myfoo7[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8]): orig_sources= new_sources= 2023-10-05T19:52:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed2a02e40 20 lifecycle: handle_bi_update(): bucket=:myfoo7[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8]): potential sources added=[] removed=[] 2023-10-05T19:52:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed2a02e40 20 lifecycle: handle_bi_update(): bucket=:myfoo7[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8]): orig_dests= new_dests= 2023-10-05T19:52:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed2a02e40 20 lifecycle: handle_bi_update(): bucket=:myfoo7[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8]): potential dests added=[] removed=[] 2023-10-05T19:52:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:33 6.0 6:05588ce8:lc::lc.6:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85ce6b60 2023-10-05T19:52:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(33 lc.6 [call] v32'69 uv69 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.497 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:34 6.0 6:05588ce8:lc::lc.6:head [call rgw.lc_rm_entry in=93b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85ce6b60 2023-10-05T19:52:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(34 lc.6 [call] v32'70 uv70 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.489+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:35 6.0 6:05588ce8:lc::lc.6:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85ce6b60 2023-10-05T19:52:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(35 lc.6 [call] v32'71 uv71 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85ce6b60 2023-10-05T19:52:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:140 4.11 4:8809f84b:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85cb3580 2023-10-05T19:52:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:141 4.39 4:9e36b86f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cb3580 2023-10-05T19:52:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:142 4.f 4:f18abf2e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de0270 con 0x7f3eb801bbe0 2023-10-05T19:52:09.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:143 4.2b 4:d7201848:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x7f3eb801bbe0 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:144 4.3e 4:7c7c0661:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85cae600 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:145 4.1 4:81fa68bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de0270 con 0x7f3eb801bbe0 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:146 4.1c 4:3af7383c:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x7f3eb801bbe0 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:147 4.2f 4:f7276528:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ddd530 con 0x557b85c73760 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:148 4.11 4:88e3337e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85cb3580 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:149 4.38 4:1d572ab0:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ddadc0 con 0x557b85cae600 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:150 4.12 4:4bbcb4a7:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85c73760 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 33 ==== osd_op_reply(142 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 34 ==== osd_op_reply(143 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.3 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 35 ==== osd_op_reply(145 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5 [call out=124b] v0'0 uv19 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.500 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(140 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 36 ==== osd_op_reply(146 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== osd_op_reply(141 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.1 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== osd_op_reply(148 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.8 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(144 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(150 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(149 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(147 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:151 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85c73760 2023-10-05T19:52:09.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(151 fud.buckets [call] v32'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 20 get_system_obj_state: rctx=0x7ffec380d038 obj=default.rgw.meta:root:myfoo7 state=0x557b85b4e0b0 s->prefetch_data=0 2023-10-05T19:52:09.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 10 cache get: name=default.rgw.meta+root+myfoo7 : type miss (requested=0x16, cached=0x13) 2023-10-05T19:52:09.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.493+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:152 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x7f3eb801bbe0 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 37 ==== osd_op_reply(152 myfoo7 [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv42 ondisk = 0) v8 ==== 234+0+139 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x16 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 10 moving default.rgw.meta+root+myfoo7 to cache LRU end 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 10 cache get: name=default.rgw.meta+root+myfoo7 : hit (requested=0x11, cached=0x17) 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 10 removing default.rgw.meta+root+myfoo7 from cache 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:153 7.e 7:7759931f:::notify.3:head [notify cookie 93989014683632 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x7f3eb801bbe0 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 38 ==== watch-notify(notify (1) cookie 93989014055440 notify 137438953502 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x7f3ec806e130 con 0x7f3eb801bbe0 2023-10-05T19:52:09.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ece533700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 93989014055440 notifier 4745 bl.length()=150 2023-10-05T19:52:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 39 ==== osd_op_reply(153 notify.3 [notify cookie 93989014683632 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ece533700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3eb4003c50 con 0x7f3eb801bbe0 2023-10-05T19:52:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 40 ==== osd_op_reply(154 notify.3 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 41 ==== watch-notify(notify_complete (2) cookie 93989014683632 notify 137438953502 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3ec803cb70 con 0x7f3eb801bbe0 2023-10-05T19:52:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:155 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x7f3eb801bbe0 2023-10-05T19:52:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 42 ==== osd_op_reply(155 myfoo7 [call,call,delete] v32'43 uv43 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 from cache 2023-10-05T19:52:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8, ofs0, ns] 2023-10-05T19:52:09.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:156 7.15 7:a93a5511:::notify.2:head [notify cookie 93989014683632 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cae600 2023-10-05T19:52:09.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== watch-notify(notify (1) cookie 93989014053520 notify 137438953516 ret 0) v3 ==== 249+0+0 (crc 0 0 0) 0x557b85ca1540 con 0x557b85cae600 2023-10-05T19:52:09.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ece533700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953516 cookie 93989014053520 notifier 4745 bl.length()=207 2023-10-05T19:52:09.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(156 notify.2 [notify cookie 93989014683632 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.497+0000 7f3ece533700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3eb4003c50 con 0x557b85cae600 2023-10-05T19:52:09.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 46 ==== osd_op_reply(157 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 47 ==== watch-notify(notify_complete (2) cookie 93989014683632 notify 137438953516 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557b85ca1100 con 0x557b85cae600 2023-10-05T19:52:09.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:158 8.15 8:ab014446:root::.bucket.meta.myfoo7%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85cb3580 2023-10-05T19:52:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 35 ==== osd_op_reply(158 .bucket.meta.myfoo7:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 [call,call,delete] v32'8 uv8 ondisk = 0) v8 ==== 291+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:159 4.11 4:8809f84b:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cb3580 2023-10-05T19:52:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:160 4.39 4:9e36b86f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85cb3580 2023-10-05T19:52:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:161 4.f 4:f18abf2e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de0270 con 0x7f3eb801bbe0 2023-10-05T19:52:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:162 4.2b 4:d7201848:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d55a20 con 0x7f3eb801bbe0 2023-10-05T19:52:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:163 4.3e 4:7c7c0661:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cae600 2023-10-05T19:52:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:164 4.1 4:81fa68bf:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4b8d0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:165 4.1c 4:3af7383c:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ddf0a0 con 0x7f3eb801bbe0 2023-10-05T19:52:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:166 4.2f 4:f7276528:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de9530 con 0x557b85c73760 2023-10-05T19:52:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:167 4.11 4:88e3337e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de0270 con 0x557b85cb3580 2023-10-05T19:52:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:168 4.38 4:1d572ab0:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d55a20 con 0x557b85cae600 2023-10-05T19:52:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.501+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:169 4.12 4:4bbcb4a7:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85d4b8d0 con 0x557b85c73760 2023-10-05T19:52:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 36 ==== osd_op_reply(159 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.0 [delete] v32'7 uv7 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(169 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.10 [delete] v32'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(166 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.7 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 48 ==== osd_op_reply(168 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.9 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 37 ==== osd_op_reply(160 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.1 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 43 ==== osd_op_reply(162 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.3 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 44 ==== osd_op_reply(165 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.6 [delete] v32'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 49 ==== osd_op_reply(163 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.4 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 45 ==== osd_op_reply(164 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.5 [delete] v32'20 uv20 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 46 ==== osd_op_reply(161 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.2 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 38 ==== osd_op_reply(167 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8.8 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.512 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:170 6.d 6:b68664e4:::pubsub..bucket.myfoo7%2fe814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85ddf0a0 con 0x557b85cae600 2023-10-05T19:52:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 50 ==== osd_op_reply(170 pubsub..bucket.myfoo7/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 251+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed2a02e40 10 removing default.rgw.log++pubsub..bucket.myfoo7/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 from cache 2023-10-05T19:52:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed2a02e40 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8, ofs0, ns] 2023-10-05T19:52:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:171 7.0 7:05bf5b68:::notify.1:head [notify cookie 93989015295152 in=216b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85c73760 2023-10-05T19:52:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 43 ==== watch-notify(notify (1) cookie 93989014052416 notify 137438953476 ret 0) v3 ==== 246+0+0 (crc 0 0 0) 0x7f3ec803cb70 con 0x557b85c73760 2023-10-05T19:52:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ece533700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93989014052416 notifier 4745 bl.length()=204 2023-10-05T19:52:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.505+0000 7f3ece533700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3eb4003c50 con 0x557b85c73760 2023-10-05T19:52:09.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.509+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 44 ==== osd_op_reply(171 notify.1 [notify cookie 93989015295152 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.509+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 45 ==== osd_op_reply(172 notify.1 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.509+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 46 ==== watch-notify(notify_complete (2) cookie 93989015295152 notify 137438953476 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3ec803ce30 con 0x557b85c73760 2023-10-05T19:52:09.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.509+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:173 6.d 6:b68664e4:::pubsub..bucket.myfoo7%2fe814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de0270 con 0x557b85cae600 2023-10-05T19:52:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.509+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 51 ==== osd_op_reply(173 pubsub..bucket.myfoo7/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.8 [delete] v32'36 uv29 ondisk = -2 ((2) No such file or directory)) v8 ==== 209+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.509+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:174 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85c73760 2023-10-05T19:52:09.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.509+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 47 ==== osd_op_reply(174 fud.buckets [call] v32'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed2a02e40 10 removing key index: p5YnriCv1nAtykxBrupQ 2023-10-05T19:52:09.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed2a02e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-10-05T19:52:09.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [notify cookie 93989015295152 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de0270 con 0x557b85cae600 2023-10-05T19:52:09.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 52 ==== watch-notify(notify (1) cookie 93989014053520 notify 137438953517 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x557b85ca1100 con 0x557b85cae600 2023-10-05T19:52:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ecdd32700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953517 cookie 93989014053520 notifier 4745 bl.length()=170 2023-10-05T19:52:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 53 ==== osd_op_reply(175 notify.2 [notify cookie 93989015295152 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ecdd32700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:176 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e20003460 con 0x557b85cae600 2023-10-05T19:52:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 54 ==== osd_op_reply(176 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 55 ==== watch-notify(notify_complete (2) cookie 93989015295152 notify 137438953517 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557b85c79ec0 con 0x557b85cae600 2023-10-05T19:52:09.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:177 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cb3580 2023-10-05T19:52:09.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 39 ==== osd_op_reply(177 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed2a02e40 10 removing email index: 2023-10-05T19:52:09.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed2a02e40 10 removing user buckets index 2023-10-05T19:52:09.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed2a02e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2023-10-05T19:52:09.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:178 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93989015295152 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de0270 con 0x557b85cb3580 2023-10-05T19:52:09.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 40 ==== watch-notify(notify (1) cookie 93989014056544 notify 137438953498 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f3ec0061040 con 0x557b85cb3580 2023-10-05T19:52:09.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ece533700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 93989014056544 notifier 4745 bl.length()=160 2023-10-05T19:52:09.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ece533700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3eb4003c50 con 0x557b85cb3580 2023-10-05T19:52:09.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 41 ==== osd_op_reply(178 notify.6 [notify cookie 93989015295152 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 42 ==== osd_op_reply(179 notify.6 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 43 ==== watch-notify(notify_complete (2) cookie 93989015295152 notify 137438953498 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557b85cd2240 con 0x557b85cb3580 2023-10-05T19:52:09.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.513+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:180 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85c73760 2023-10-05T19:52:09.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 48 ==== osd_op_reply(180 fud.buckets [delete] v32'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ed2a02e40 10 removing user index: fud 2023-10-05T19:52:09.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ed2a02e40 10 removing default.rgw.meta+users.uid+fud from cache 2023-10-05T19:52:09.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ed2a02e40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-10-05T19:52:09.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:181 7.3 7:c609908c:::notify.5:head [notify cookie 93989015295152 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de0270 con 0x557b85cb3580 2023-10-05T19:52:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 44 ==== watch-notify(notify (1) cookie 93989014061776 notify 137438953499 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x557b85cd2240 con 0x557b85cb3580 2023-10-05T19:52:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ecdd32700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 93989014061776 notifier 4745 bl.length()=152 2023-10-05T19:52:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ecdd32700 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:182 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3e20003460 con 0x557b85cb3580 2023-10-05T19:52:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 45 ==== osd_op_reply(181 notify.5 [notify cookie 93989015295152 out=8b] v0'0 uv255 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 46 ==== osd_op_reply(182 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 47 ==== watch-notify(notify_complete (2) cookie 93989015295152 notify 137438953499 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557b85cd1da0 con 0x557b85cb3580 2023-10-05T19:52:09.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:183 8.e 8:75f48285:users.uid::fud:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x7f3eb801bbe0 2023-10-05T19:52:09.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.517+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 47 ==== osd_op_reply(183 fud [call,delete] v32'7 uv7 ondisk = 0) v8 ==== 189+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.521+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:184 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93989014045632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cae600 2023-10-05T19:52:09.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.521+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 56 ==== osd_op_reply(184 notify.0 [watch unwatch cookie 93989014045632] v32'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.521+0000 7f3ed2a02e40 20 remove_watcher() i=0 2023-10-05T19:52:09.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.521+0000 7f3ed2a02e40 2 removed watcher, disabling cache 2023-10-05T19:52:09.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.521+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:185 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93989014052416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85c73760 2023-10-05T19:52:09.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.521+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 49 ==== osd_op_reply(185 notify.1 [watch unwatch cookie 93989014052416] v32'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.525+0000 7f3ed2a02e40 20 remove_watcher() i=1 2023-10-05T19:52:09.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.525+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:186 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93989014053520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cae600 2023-10-05T19:52:09.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.525+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 57 ==== osd_op_reply(186 notify.2 [watch unwatch cookie 93989014053520] v32'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.525+0000 7f3ed2a02e40 20 remove_watcher() i=2 2023-10-05T19:52:09.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.525+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:187 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93989014055440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x7f3eb801bbe0 2023-10-05T19:52:09.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.525+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 48 ==== osd_op_reply(187 notify.3 [watch unwatch cookie 93989014055440] v32'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.525+0000 7f3ed2a02e40 20 remove_watcher() i=3 2023-10-05T19:52:09.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.529+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:188 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93989014059488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cae600 2023-10-05T19:52:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.529+0000 7f3ed0537700 1 -- 172.21.15.167:0/1410898567 <== osd.0 v2:172.21.15.118:6800/26580 58 ==== osd_op_reply(188 notify.4 [watch unwatch cookie 93989014059488] v32'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3eb8077040 con 0x557b85cae600 2023-10-05T19:52:09.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.529+0000 7f3ed2a02e40 20 remove_watcher() i=4 2023-10-05T19:52:09.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.529+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:189 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93989014061776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cb3580 2023-10-05T19:52:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.533+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 48 ==== osd_op_reply(189 notify.5 [watch unwatch cookie 93989014061776] v32'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.533+0000 7f3ed2a02e40 20 remove_watcher() i=5 2023-10-05T19:52:09.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.533+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:190 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93989014056544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85cb3580 2023-10-05T19:52:09.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.533+0000 7f3ecfd36700 1 -- 172.21.15.167:0/1410898567 <== osd.3 v2:172.21.15.167:6800/26773 49 ==== osd_op_reply(190 notify.6 [watch unwatch cookie 93989014056544] v32'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec0024040 con 0x557b85cb3580 2023-10-05T19:52:09.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.533+0000 7f3ed2a02e40 20 remove_watcher() i=6 2023-10-05T19:52:09.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.533+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:191 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93989014067952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x7f3eb801bbe0 2023-10-05T19:52:09.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.533+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.2 v2:172.21.15.167:6816/26774 49 ==== osd_op_reply(191 notify.7 [watch unwatch cookie 93989014067952] v32'257 uv255 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x7f3eb801bbe0 2023-10-05T19:52:09.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.533+0000 7f3ed2a02e40 20 remove_watcher() i=7 2023-10-05T19:52:09.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ea1fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:09.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:192 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93989014069056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x557b85de6020 con 0x557b85c73760 2023-10-05T19:52:09.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 <== osd.1 v2:172.21.15.167:6808/26775 50 ==== osd_op_reply(192 data_loggenerations_metadata [watch unwatch cookie 93989014069056] v32'247 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3ec8033040 con 0x557b85c73760 2023-10-05T19:52:09.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cae600 msgr2=0x557b85cb09e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cae600 0x557b85cb09e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85c73760 msgr2=0x557b85cac680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85c73760 0x557b85cac680 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3eb801bbe0 msgr2=0x7f3eb80079b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3eb801bbe0 0x7f3eb80079b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85cb3580 msgr2=0x557b85cb5960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85cb3580 0x557b85cb5960 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3eb0030c50 msgr2=0x7f3eb0033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3eb0030c50 0x7f3eb0033100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0001e90 tx=0x7f3ec00013b0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed0d38700 1 -- 172.21.15.167:0/1410898567 reap_dead start 2023-10-05T19:52:09.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 msgr2=0x557b85ca0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.537+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85ca0bc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800a520 tx=0x7f3eb801d000 comp rx=0 tx=0).stop 2023-10-05T19:52:09.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 shutdown_connections 2023-10-05T19:52:09.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/1410898567 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85c72e50 0x557b85ca0bc0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 >> 172.21.15.167:0/1410898567 conn(0x557b85c6e9d0 msgr2=0x557b85c945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:09.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 shutdown_connections 2023-10-05T19:52:09.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/1410898567 wait complete. 2023-10-05T19:52:09.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cdc3f0 msgr2=0x557b85cde800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x557b85cdc3f0 0x557b85cde800 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85ce6b60 msgr2=0x557b85ce8f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x557b85ce6b60 0x557b85ce8f70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557b85cdfb70 msgr2=0x557b85ce1f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x557b85cdfb70 0x557b85ce1f50 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85ce3350 msgr2=0x557b85ce5760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x557b85ce3350 0x557b85ce5760 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3e10030c50 msgr2=0x7f3e10033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3e10030c50 0x7f3e10033100 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x557b85cbe980 tx=0x7f3ec800e040 comp rx=0 tx=0).stop 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 msgr2=0x557b85cd17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 --2- 172.21.15.167:0/69142109 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x557b85ccbcd0 0x557b85cd17a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3eb802f000 tx=0x7f3ec0037000 comp rx=0 tx=0).stop 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 reap_dead start 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed0537700 1 -- 172.21.15.167:0/69142109 reap_dead start 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 shutdown_connections 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 >> 172.21.15.167:0/69142109 conn(0x557b85cc7090 msgr2=0x557b85cc5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:09.548 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 shutdown_connections 2023-10-05T19:52:09.549 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:09.541+0000 7f3ed2a02e40 1 -- 172.21.15.167:0/69142109 wait complete. 2023-10-05T19:52:49.552 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2023-10-05T19:52:49.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2023-10-05T19:52:49.553 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2023-10-05T19:52:49.593 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:49.594 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:49.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.589+0000 7f7ae4d82e40 1 Processor -- start 2023-10-05T19:52:49.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.589+0000 7f7ae4d82e40 1 -- start start 2023-10-05T19:52:49.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.589+0000 7f7ae4d82e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x561b57d71820 0x561b57d71bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.589+0000 7f7ae4d82e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561b57cbfbd0 con 0x561b57d72130 2023-10-05T19:52:49.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.589+0000 7f7ae4d82e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x561b57c7cee0 con 0x561b57d71820 2023-10-05T19:52:49.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.589+0000 7f7ae28b7700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x561b57d71820 0x561b57d71bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.589+0000 7f7ae20b6700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x561b57d72130 0x561b57d72bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60346/0 (socket says 172.21.15.167:60346) 2023-10-05T19:52:49.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.589+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1794489230 learned_addr learned my addr 172.21.15.167:0/1794489230 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:49.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae18b5700 1 -- 172.21.15.167:0/1794489230 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144563331 0 0) 0x561b57cbfbd0 con 0x561b57d72130 2023-10-05T19:52:49.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae18b5700 1 -- 172.21.15.167:0/1794489230 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad0001e10 con 0x561b57d72130 2023-10-05T19:52:49.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1794489230 >> v1:172.21.15.118:6789/0 conn(0x561b57d72130 legacy=0x561b57d72bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1794489230 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b57d732e0 con 0x561b57d71820 2023-10-05T19:52:49.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae28b7700 1 --2- 172.21.15.167:0/1794489230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d71bf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00a5d0 tx=0x7f7acc005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d2f54ace81b5ac server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae18b5700 1 -- 172.21.15.167:0/1794489230 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc007610 con 0x561b57d71820 2023-10-05T19:52:49.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae18b5700 1 -- 172.21.15.167:0/1794489230 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc007770 con 0x561b57d71820 2023-10-05T19:52:49.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae18b5700 1 -- 172.21.15.167:0/1794489230 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc007a40 con 0x561b57d71820 2023-10-05T19:52:49.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1794489230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 msgr2=0x561b57d71bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1794489230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d71bf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00a5d0 tx=0x7f7acc005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:49.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1794489230 shutdown_connections 2023-10-05T19:52:49.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1794489230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d71bf0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1794489230 >> 172.21.15.167:0/1794489230 conn(0x561b57d6d240 msgr2=0x561b57d6f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1794489230 shutdown_connections 2023-10-05T19:52:49.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1794489230 wait complete. 2023-10-05T19:52:49.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 Processor -- start 2023-10-05T19:52:49.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 -- start start 2023-10-05T19:52:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d96360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae4d82e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b57c40e30 con 0x561b57d71820 2023-10-05T19:52:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.593+0000 7f7ae28b7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d96360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae28b7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d96360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47974/0 (socket says 172.21.15.167:47974) 2023-10-05T19:52:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae28b7700 1 -- 172.21.15.167:0/2643965936 learned_addr learned my addr 172.21.15.167:0/2643965936 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:49.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae28b7700 1 -- 172.21.15.167:0/2643965936 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc005cf0 con 0x561b57d71820 2023-10-05T19:52:49.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae28b7700 1 --2- 172.21.15.167:0/2643965936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d96360 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35cb44ea912fef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae08b3700 1 -- 172.21.15.167:0/2643965936 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc007a00 con 0x561b57d71820 2023-10-05T19:52:49.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae08b3700 1 -- 172.21.15.167:0/2643965936 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc007b60 con 0x561b57d71820 2023-10-05T19:52:49.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae08b3700 1 -- 172.21.15.167:0/2643965936 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc007d10 con 0x561b57d71820 2023-10-05T19:52:49.603 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/2643965936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 msgr2=0x561b57d96360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/2643965936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d96360 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc014000 comp rx=0 tx=0).stop 2023-10-05T19:52:49.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/2643965936 shutdown_connections 2023-10-05T19:52:49.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/2643965936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d96360 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.597+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/2643965936 >> 172.21.15.167:0/2643965936 conn(0x561b57d6d240 msgr2=0x561b57ce6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/2643965936 shutdown_connections 2023-10-05T19:52:49.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/2643965936 wait complete. 2023-10-05T19:52:49.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae4d82e40 1 Processor -- start 2023-10-05T19:52:49.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae4d82e40 1 -- start start 2023-10-05T19:52:49.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae4d82e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d9a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae4d82e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b57c13ed0 con 0x561b57d71820 2023-10-05T19:52:49.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae28b7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d9a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae28b7700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d9a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47978/0 (socket says 172.21.15.167:47978) 2023-10-05T19:52:49.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 learned_addr learned my addr 172.21.15.167:0/1309734748 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:49.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b57d732e0 con 0x561b57d71820 2023-10-05T19:52:49.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae28b7700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d9a660 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00afd0 tx=0x7f7acc01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7adaffd700 1 -- 172.21.15.167:0/1309734748 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc02f400 con 0x561b57d71820 2023-10-05T19:52:49.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7adaffd700 1 -- 172.21.15.167:0/1309734748 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc029070 con 0x561b57d71820 2023-10-05T19:52:49.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b57d9aba0 con 0x561b57d71820 2023-10-05T19:52:49.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7adaffd700 1 -- 172.21.15.167:0/1309734748 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc02f5c0 con 0x561b57d71820 2023-10-05T19:52:49.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.601+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b57d9af80 con 0x561b57d71820 2023-10-05T19:52:49.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7adaffd700 1 -- 172.21.15.167:0/1309734748 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7acc012400 con 0x561b57d71820 2023-10-05T19:52:49.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7adaffd700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7ac4030c00 0x7f7ac40330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7adaffd700 1 -- 172.21.15.167:0/1309734748 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f7acc0464f0 con 0x561b57d71820 2023-10-05T19:52:49.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae20b6700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7ac4030c00 0x7f7ac40330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b57d72130 0x561b57da6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57da67d0 con 0x561b57d72130 2023-10-05T19:52:49.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae30b8700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b57d72130 0x561b57da6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae20b6700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7ac4030c00 0x7f7ac40330b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0044f0 tx=0x7f7adc006690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae30b8700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b57d72130 0x561b57da6120 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ad400a500 con 0x561b57d72130 2023-10-05T19:52:49.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 20 realm 2023-10-05T19:52:49.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57da3780 con 0x561b57d72130 2023-10-05T19:52:49.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ad400a500 con 0x561b57d72130 2023-10-05T19:52:49.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:49.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57da72b0 con 0x561b57d72130 2023-10-05T19:52:49.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ad400a500 con 0x561b57d72130 2023-10-05T19:52:49.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b57da80e0 0x561b57daa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daaa00 con 0x561b57da80e0 2023-10-05T19:52:49.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.605+0000 7f7ae28b7700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b57da80e0 0x561b57daa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae28b7700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b57da80e0 0x561b57daa4c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57dab2a0 con 0x561b57d72130 2023-10-05T19:52:49.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7ad400a500 con 0x561b57d72130 2023-10-05T19:52:49.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:49.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae4d82e40 20 searching for the correct realm 2023-10-05T19:52:49.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b57dad060 0x561b57daf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57dad060 2023-10-05T19:52:49.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae20b6700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b57dad060 0x561b57daf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae20b6700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b57dad060 0x561b57daf440 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc004520 con 0x561b57dad060 2023-10-05T19:52:49.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57da80e0 2023-10-05T19:52:49.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae28b7700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7acc007030 0x7f7acc01c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x7f7acc007030 2023-10-05T19:52:49.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.609+0000 7f7ae30b8700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7acc007030 0x7f7acc01c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae30b8700 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7acc007030 0x7f7acc01c3d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x7f7acc007030 2023-10-05T19:52:49.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57dad060 2023-10-05T19:52:49.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc004520 con 0x561b57dad060 2023-10-05T19:52:49.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57da80e0 2023-10-05T19:52:49.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57da80e0 2023-10-05T19:52:49.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.613+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x7f7acc007030 2023-10-05T19:52:49.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x7f7acc007030 2023-10-05T19:52:49.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x7f7acc007030 2023-10-05T19:52:49.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x7f7acc007030 2023-10-05T19:52:49.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57da80e0 2023-10-05T19:52:49.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57dad060 2023-10-05T19:52:49.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc004520 con 0x561b57dad060 2023-10-05T19:52:49.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.617+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57da80e0 2023-10-05T19:52:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57dad060 2023-10-05T19:52:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57dad060 2023-10-05T19:52:49.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x7f7acc007030 2023-10-05T19:52:49.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x7f7acc007030 2023-10-05T19:52:49.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57d72130 2023-10-05T19:52:49.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x7f7acc007030 2023-10-05T19:52:49.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x7f7acc007030 2023-10-05T19:52:49.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.621+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57dad060 2023-10-05T19:52:49.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x7f7acc007030 2023-10-05T19:52:49.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x7f7acc007030 2023-10-05T19:52:49.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57da80e0 2023-10-05T19:52:49.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57da80e0 2023-10-05T19:52:49.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57dad060 2023-10-05T19:52:49.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57da80e0 2023-10-05T19:52:49.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.625+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57daf980 con 0x561b57da80e0 2023-10-05T19:52:49.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:49.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:49.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:49.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:49.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57dabe10 con 0x561b57d72130 2023-10-05T19:52:49.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57dac760 con 0x561b57da80e0 2023-10-05T19:52:49.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57dafd30 con 0x561b57da80e0 2023-10-05T19:52:49.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:49.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db00e0 con 0x561b57dad060 2023-10-05T19:52:49.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.629+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57dac330 con 0x561b57da80e0 2023-10-05T19:52:49.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db1dc0 con 0x561b57dad060 2023-10-05T19:52:49.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db1dc0 con 0x561b57da80e0 2023-10-05T19:52:49.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db1dc0 con 0x7f7acc007030 2023-10-05T19:52:49.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x7f7acc007030 2023-10-05T19:52:49.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.633+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57dad060 2023-10-05T19:52:49.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57da80e0 2023-10-05T19:52:49.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57da80e0 2023-10-05T19:52:49.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.637+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x7f7acc007030 2023-10-05T19:52:49.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x7f7acc007030 2023-10-05T19:52:49.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x7f7acc007030 2023-10-05T19:52:49.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x7f7acc007030 2023-10-05T19:52:49.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57da80e0 2023-10-05T19:52:49.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57dad060 2023-10-05T19:52:49.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.641+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57da80e0 2023-10-05T19:52:49.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57dad060 2023-10-05T19:52:49.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4014040 con 0x561b57d72130 2023-10-05T19:52:49.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57dad060 2023-10-05T19:52:49.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x7f7acc007030 2023-10-05T19:52:49.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.645+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57d72130 2023-10-05T19:52:49.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x7f7acc007030 2023-10-05T19:52:49.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57dad060 2023-10-05T19:52:49.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x7f7acc007030 2023-10-05T19:52:49.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57da80e0 2023-10-05T19:52:49.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57da80e0 2023-10-05T19:52:49.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.649+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57dad060 2023-10-05T19:52:49.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57da80e0 2023-10-05T19:52:49.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0490 con 0x561b57da80e0 2023-10-05T19:52:49.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae4d82e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:49.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae4d82e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:49.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae4d82e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:49.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae4d82e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:49.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db0db0 con 0x561b57da80e0 2023-10-05T19:52:49.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.653+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db1160 con 0x561b57d72130 2023-10-05T19:52:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:49.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db1a00 con 0x561b57da80e0 2023-10-05T19:52:49.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.661 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db1a00 con 0x561b57da80e0 2023-10-05T19:52:49.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:49.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db1b00 con 0x7f7acc007030 2023-10-05T19:52:49.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.663 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 zone default found 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 4 Realm: () 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 zonegroup default 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db1b00 con 0x7f7acc007030 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.665 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.657+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db3480 con 0x561b57dad060 2023-10-05T19:52:49.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.661+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.661+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.661+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.661+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db3830 con 0x561b57dad060 2023-10-05T19:52:49.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.661+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.661+0000 7f7ae4d82e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.661+0000 7f7ae4d82e40 20 started sync module instance, tier type = 2023-10-05T19:52:49.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.661+0000 7f7ae4d82e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:49.666 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.661+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db2b40 con 0x561b57da80e0 2023-10-05T19:52:49.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.665+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.665+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94675438085712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db3060 con 0x561b57da80e0 2023-10-05T19:52:49.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.665+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db45c0 con 0x561b57d72130 2023-10-05T19:52:49.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.665+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.665+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94675438085712] v32'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.665+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94675438092496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db3060 con 0x561b57d72130 2023-10-05T19:52:49.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.665+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db4f00 con 0x561b57da80e0 2023-10-05T19:52:49.672 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.669+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94675438092496] v32'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.669+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.669+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94675438093600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db3060 con 0x561b57da80e0 2023-10-05T19:52:49.673 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.669+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db5350 con 0x7f7acc007030 2023-10-05T19:52:49.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.669+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.669+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94675438095968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db52b0 con 0x7f7acc007030 2023-10-05T19:52:49.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.669+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db62a0 con 0x561b57da80e0 2023-10-05T19:52:49.675 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.669+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94675438093600] v32'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.673+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94675438095968] v32'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.677 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.673+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.673+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94675438098256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db5db0 con 0x561b57da80e0 2023-10-05T19:52:49.678 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.673+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db6650 con 0x561b57dad060 2023-10-05T19:52:49.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.673+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.673+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94675438100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db6ef0 con 0x561b57dad060 2023-10-05T19:52:49.679 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.673+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db7970 con 0x561b57dad060 2023-10-05T19:52:49.680 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94675438098256] v32'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94675438100448] v32'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94675438094704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db7d70 con 0x561b57dad060 2023-10-05T19:52:49.681 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db8610 con 0x7f7acc007030 2023-10-05T19:52:49.682 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94675438094704] v32'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'258 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94675438108960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db8a60 con 0x7f7acc007030 2023-10-05T19:52:49.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 20 add_watcher() i=0 2023-10-05T19:52:49.683 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 20 add_watcher() i=1 2023-10-05T19:52:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 20 add_watcher() i=2 2023-10-05T19:52:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 20 add_watcher() i=3 2023-10-05T19:52:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 20 add_watcher() i=4 2023-10-05T19:52:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 20 add_watcher() i=5 2023-10-05T19:52:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.677+0000 7f7ae4d82e40 20 add_watcher() i=6 2023-10-05T19:52:49.684 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.681+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94675438108960] v32'259 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.681+0000 7f7ae4d82e40 20 add_watcher() i=7 2023-10-05T19:52:49.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.681+0000 7f7ae4d82e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:49.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.681+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57dbbb70 con 0x561b57d72130 2023-10-05T19:52:49.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.681+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.685 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.681+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94675438110064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db8eb0 con 0x561b57d72130 2023-10-05T19:52:49.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.681+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94675438110064] v32'248 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.681+0000 7f7a2ffff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:49.687 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:49.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:49.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 Processor -- start 2023-10-05T19:52:49.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 -- start start 2023-10-05T19:52:49.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dc6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.688 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b57dc6ca0 con 0x561b57dc6390 2023-10-05T19:52:49.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae20b6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dc6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae20b6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dc6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47990/0 (socket says 172.21.15.167:47990) 2023-10-05T19:52:49.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae20b6700 1 -- 172.21.15.167:0/3739542153 learned_addr learned my addr 172.21.15.167:0/3739542153 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:49.689 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae20b6700 1 -- 172.21.15.167:0/3739542153 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b57dc6de0 con 0x561b57dc6390 2023-10-05T19:52:49.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae20b6700 1 --2- 172.21.15.167:0/3739542153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dc6760 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x561b57da6e50 tx=0x7f7adc006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b139e9e25d6f45f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7a2f7fe700 1 -- 172.21.15.167:0/3739542153 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc01a040 con 0x561b57dc6390 2023-10-05T19:52:49.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7a2f7fe700 1 -- 172.21.15.167:0/3739542153 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc01b040 con 0x561b57dc6390 2023-10-05T19:52:49.690 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7a2f7fe700 1 -- 172.21.15.167:0/3739542153 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc0049b0 con 0x561b57dc6390 2023-10-05T19:52:49.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/3739542153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 msgr2=0x561b57dc6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/3739542153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dc6760 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x561b57da6e50 tx=0x7f7adc006000 comp rx=0 tx=0).stop 2023-10-05T19:52:49.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/3739542153 shutdown_connections 2023-10-05T19:52:49.691 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/3739542153 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dc6760 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/3739542153 >> 172.21.15.167:0/3739542153 conn(0x561b57dc1750 msgr2=0x561b57dbf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/3739542153 shutdown_connections 2023-10-05T19:52:49.692 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.685+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/3739542153 wait complete. 2023-10-05T19:52:49.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae4d82e40 1 Processor -- start 2023-10-05T19:52:49.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae4d82e40 1 -- start start 2023-10-05T19:52:49.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae4d82e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dcbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae4d82e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b57dcce50 con 0x561b57dc6390 2023-10-05T19:52:49.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae20b6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dcbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae20b6700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dcbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:47998/0 (socket says 172.21.15.167:47998) 2023-10-05T19:52:49.693 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae20b6700 1 -- 172.21.15.167:0/622315176 learned_addr learned my addr 172.21.15.167:0/622315176 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:49.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae20b6700 1 -- 172.21.15.167:0/622315176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad0001e10 con 0x561b57dc6390 2023-10-05T19:52:49.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae20b6700 1 --2- 172.21.15.167:0/622315176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dcbe50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7adc03a040 tx=0x7f7adc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7a2dffb700 1 -- 172.21.15.167:0/622315176 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc01a040 con 0x561b57dc6390 2023-10-05T19:52:49.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/622315176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b57dcc450 con 0x561b57dc6390 2023-10-05T19:52:49.694 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7a2dffb700 1 -- 172.21.15.167:0/622315176 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc004260 con 0x561b57dc6390 2023-10-05T19:52:49.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7a2dffb700 1 -- 172.21.15.167:0/622315176 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc02c940 con 0x561b57dc6390 2023-10-05T19:52:49.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/622315176 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b57dcc890 con 0x561b57dc6390 2023-10-05T19:52:49.695 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.689+0000 7f7a2dffb700 1 -- 172.21.15.167:0/622315176 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7adc02cb70 con 0x561b57dc6390 2023-10-05T19:52:49.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7a2dffb700 1 --2- 172.21.15.167:0/622315176 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a20030c00 0x7f7a200330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7a2dffb700 1 -- 172.21.15.167:0/622315176 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f7adc027040 con 0x561b57dc6390 2023-10-05T19:52:49.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae30b8700 1 --2- 172.21.15.167:0/622315176 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a20030c00 0x7f7a200330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 5 note: GC not initialized 2023-10-05T19:52:49.696 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae30b8700 1 --2- 172.21.15.167:0/622315176 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a20030c00 0x7f7a200330b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x561b57dbbc30 tx=0x7f7ad400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7a24ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:49.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:49.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:49.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7a1affd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:53:20 2023 2023-10-05T19:52:49.699 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:49.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7a1a7fc700 20 reqs_thread_entry: start 2023-10-05T19:52:49.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 20 get_system_obj_state: rctx=0x7ffeb1673c28 obj=default.rgw.meta:users.uid:foo state=0x561b57c4c0b0 s->prefetch_data=0 2023-10-05T19:52:49.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:52:49.699 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57e346e0 con 0x561b57d72130 2023-10-05T19:52:49.700 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7a26ffd700 20 reqs_thread_entry: start 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.693+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57e37170 con 0x561b57d72130 2023-10-05T19:52:49.701 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.697+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.697+0000 7f7ae4d82e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:52:49.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.697+0000 7f7ae4d82e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:52:49.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.697+0000 7f7ae4d82e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:52:49.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.697+0000 7f7ae4d82e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:49.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.697+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57e37170 con 0x561b57dad060 2023-10-05T19:52:49.702 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.697+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 usage.10 [call] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.703 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.697+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57e37170 con 0x561b57dad060 2023-10-05T19:52:49.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.701+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(105 usage.10 [call] v32'34 uv33 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.704 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.701+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94675438085712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57df2ad0 con 0x561b57da80e0 2023-10-05T19:52:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.701+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94675438085712] v32'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.701+0000 7f7ae4d82e40 20 remove_watcher() i=0 2023-10-05T19:52:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.701+0000 7f7ae4d82e40 2 removed watcher, disabling cache 2023-10-05T19:52:49.707 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.701+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94675438092496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db2650 con 0x561b57d72130 2023-10-05T19:52:49.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.705+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94675438092496] v32'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.705+0000 7f7ae4d82e40 20 remove_watcher() i=1 2023-10-05T19:52:49.709 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.705+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94675438093600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db2650 con 0x561b57da80e0 2023-10-05T19:52:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.705+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94675438093600] v32'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.711 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.705+0000 7f7ae4d82e40 20 remove_watcher() i=2 2023-10-05T19:52:49.712 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.705+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94675438095968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db45c0 con 0x7f7acc007030 2023-10-05T19:52:49.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.709+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94675438095968] v32'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.713 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.709+0000 7f7ae4d82e40 20 remove_watcher() i=3 2023-10-05T19:52:49.714 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.709+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94675438098256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db45c0 con 0x561b57da80e0 2023-10-05T19:52:49.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.713+0000 7f7ae28b7700 1 -- 172.21.15.167:0/1309734748 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94675438098256] v32'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7acc035070 con 0x561b57da80e0 2023-10-05T19:52:49.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.713+0000 7f7ae4d82e40 20 remove_watcher() i=4 2023-10-05T19:52:49.716 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.713+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94675438100448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db45c0 con 0x561b57dad060 2023-10-05T19:52:49.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.713+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94675438100448] v32'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.713+0000 7f7ae4d82e40 20 remove_watcher() i=5 2023-10-05T19:52:49.718 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.713+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94675438094704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db45c0 con 0x561b57dad060 2023-10-05T19:52:49.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.717+0000 7f7ae20b6700 1 -- 172.21.15.167:0/1309734748 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94675438094704] v32'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc01d040 con 0x561b57dad060 2023-10-05T19:52:49.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.717+0000 7f7ae4d82e40 20 remove_watcher() i=6 2023-10-05T19:52:49.720 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.717+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94675438108960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db4e60 con 0x7f7acc007030 2023-10-05T19:52:49.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.717+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94675438108960] v32'260 uv258 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x7f7acc007030 2023-10-05T19:52:49.722 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.717+0000 7f7ae4d82e40 20 remove_watcher() i=7 2023-10-05T19:52:49.723 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.717+0000 7f7a2ffff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:49.724 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.717+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:114 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94675438110064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561b57db4e60 con 0x561b57d72130 2023-10-05T19:52:49.726 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(114 data_loggenerations_metadata [watch unwatch cookie 94675438110064] v32'249 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ad4033040 con 0x561b57d72130 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b57da80e0 msgr2=0x561b57daa4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x561b57da80e0 0x561b57daa4c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b57d72130 msgr2=0x561b57da6120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x561b57d72130 0x561b57da6120 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7acc007030 msgr2=0x7f7acc01c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7acc007030 0x7f7acc01c3d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b57dad060 msgr2=0x561b57daf440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x561b57dad060 0x561b57daf440 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7ac4030c00 msgr2=0x7f7ac40330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.727 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7ac4030c00 0x7f7ac40330b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0044f0 tx=0x7f7adc006690 comp rx=0 tx=0).stop 2023-10-05T19:52:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 msgr2=0x561b57d9a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae30b8700 1 -- 172.21.15.167:0/1309734748 reap_dead start 2023-10-05T19:52:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d9a660 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00afd0 tx=0x7f7acc01c000 comp rx=0 tx=0).stop 2023-10-05T19:52:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 shutdown_connections 2023-10-05T19:52:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/1309734748 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57d71820 0x561b57d9a660 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 >> 172.21.15.167:0/1309734748 conn(0x561b57d6d240 msgr2=0x561b57d8ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 shutdown_connections 2023-10-05T19:52:49.728 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/1309734748 wait complete. 2023-10-05T19:52:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/622315176 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a20030c00 msgr2=0x7f7a200330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/622315176 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a20030c00 0x7f7a200330b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x561b57dbbc30 tx=0x7f7ad400e040 comp rx=0 tx=0).stop 2023-10-05T19:52:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/622315176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 msgr2=0x561b57dcbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/622315176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dcbe50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7adc03a040 tx=0x7f7adc030000 comp rx=0 tx=0).stop 2023-10-05T19:52:49.729 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/622315176 shutdown_connections 2023-10-05T19:52:49.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/622315176 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a20030c00 0x7f7a200330b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.721+0000 7f7ae4d82e40 1 --2- 172.21.15.167:0/622315176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x561b57dc6390 0x561b57dcbe50 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.725+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/622315176 >> 172.21.15.167:0/622315176 conn(0x561b57dc1750 msgr2=0x561b57dbf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.725+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/622315176 shutdown_connections 2023-10-05T19:52:49.730 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.725+0000 7f7ae4d82e40 1 -- 172.21.15.167:0/622315176 wait complete. 2023-10-05T19:52:49.733 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2023-10-05T19:52:49.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2023-10-05T19:52:49.733 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2023-10-05T19:52:49.773 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:49.773 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:49.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f828aa33e40 1 Processor -- start 2023-10-05T19:52:49.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f828aa33e40 1 -- start start 2023-10-05T19:52:49.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f828aa33e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x555c62ebcb50 0x555c62ebcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f828aa33e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555c62e07bd0 con 0x555c62ebd460 2023-10-05T19:52:49.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f828aa33e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x555c62dc4ee0 con 0x555c62ebcb50 2023-10-05T19:52:49.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f8288568700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x555c62ebcb50 0x555c62ebcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f8287d67700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x555c62ebd460 0x555c62ebdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60360/0 (socket says 172.21.15.167:60360) 2023-10-05T19:52:49.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f8288568700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x555c62ebcb50 0x555c62ebcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48004/0 (socket says 172.21.15.167:48004) 2023-10-05T19:52:49.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f8287d67700 1 -- 172.21.15.167:0/1680963481 learned_addr learned my addr 172.21.15.167:0/1680963481 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:49.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f8288568700 1 -- 172.21.15.167:0/1680963481 >> v1:172.21.15.118:6789/0 conn(0x555c62ebd460 legacy=0x555c62ebdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.769+0000 7f8288568700 1 -- 172.21.15.167:0/1680963481 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c62ebe600 con 0x555c62ebcb50 2023-10-05T19:52:49.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f8288568700 1 --2- 172.21.15.167:0/1680963481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62ebcf20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f828000a5d0 tx=0x7f8280005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ed488ae0b7dd77 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.776 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f8287566700 1 -- 172.21.15.167:0/1680963481 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f82800086a0 con 0x555c62ebcb50 2023-10-05T19:52:49.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f8287566700 1 -- 172.21.15.167:0/1680963481 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280008800 con 0x555c62ebcb50 2023-10-05T19:52:49.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f8287566700 1 -- 172.21.15.167:0/1680963481 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8280008ad0 con 0x555c62ebcb50 2023-10-05T19:52:49.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f828aa33e40 1 -- 172.21.15.167:0/1680963481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 msgr2=0x555c62ebcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1680963481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62ebcf20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f828000a5d0 tx=0x7f8280005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:49.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f828aa33e40 1 -- 172.21.15.167:0/1680963481 shutdown_connections 2023-10-05T19:52:49.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1680963481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62ebcf20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f828aa33e40 1 -- 172.21.15.167:0/1680963481 >> 172.21.15.167:0/1680963481 conn(0x555c62e305c0 msgr2=0x555c62e309c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f828aa33e40 1 -- 172.21.15.167:0/1680963481 shutdown_connections 2023-10-05T19:52:49.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f828aa33e40 1 -- 172.21.15.167:0/1680963481 wait complete. 2023-10-05T19:52:49.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.773+0000 7f828aa33e40 1 Processor -- start 2023-10-05T19:52:49.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 -- start start 2023-10-05T19:52:49.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62edbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c62d88e30 con 0x555c62ebcb50 2023-10-05T19:52:49.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f8288568700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62edbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f8288568700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62edbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48006/0 (socket says 172.21.15.167:48006) 2023-10-05T19:52:49.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f8288568700 1 -- 172.21.15.167:0/361224511 learned_addr learned my addr 172.21.15.167:0/361224511 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:49.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f8288568700 1 -- 172.21.15.167:0/361224511 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280005cf0 con 0x555c62ebcb50 2023-10-05T19:52:49.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f8288568700 1 --2- 172.21.15.167:0/361224511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62edbb60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f828000a520 tx=0x7f8280015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f48f3b0bfceb19 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f8286564700 1 -- 172.21.15.167:0/361224511 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8280008970 con 0x555c62ebcb50 2023-10-05T19:52:49.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f8286564700 1 -- 172.21.15.167:0/361224511 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280008ad0 con 0x555c62ebcb50 2023-10-05T19:52:49.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f8286564700 1 -- 172.21.15.167:0/361224511 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8280008dc0 con 0x555c62ebcb50 2023-10-05T19:52:49.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 -- 172.21.15.167:0/361224511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 msgr2=0x555c62edbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 --2- 172.21.15.167:0/361224511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62edbb60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f828000a520 tx=0x7f8280015000 comp rx=0 tx=0).stop 2023-10-05T19:52:49.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 -- 172.21.15.167:0/361224511 shutdown_connections 2023-10-05T19:52:49.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 --2- 172.21.15.167:0/361224511 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62edbb60 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 -- 172.21.15.167:0/361224511 >> 172.21.15.167:0/361224511 conn(0x555c62e305c0 msgr2=0x555c62ed7720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 -- 172.21.15.167:0/361224511 shutdown_connections 2023-10-05T19:52:49.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.777+0000 7f828aa33e40 1 -- 172.21.15.167:0/361224511 wait complete. 2023-10-05T19:52:49.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f828aa33e40 1 Processor -- start 2023-10-05T19:52:49.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f828aa33e40 1 -- start start 2023-10-05T19:52:49.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f828aa33e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62ee27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f828aa33e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c62d5bed0 con 0x555c62ebcb50 2023-10-05T19:52:49.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f8288568700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62ee27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f8288568700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62ee27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48012/0 (socket says 172.21.15.167:48012) 2023-10-05T19:52:49.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 learned_addr learned my addr 172.21.15.167:0/1042101649 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:49.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c62ebe600 con 0x555c62ebcb50 2023-10-05T19:52:49.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f8288568700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62ee27c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f828001e040 tx=0x7f8280003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f8284d61700 1 -- 172.21.15.167:0/1042101649 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8280012bb0 con 0x555c62ebcb50 2023-10-05T19:52:49.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f8284d61700 1 -- 172.21.15.167:0/1042101649 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828002a070 con 0x555c62ebcb50 2023-10-05T19:52:49.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f8284d61700 1 -- 172.21.15.167:0/1042101649 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8280012e90 con 0x555c62ebcb50 2023-10-05T19:52:49.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c62ee2d00 con 0x555c62ebcb50 2023-10-05T19:52:49.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.781+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c62ee31a0 con 0x555c62ebcb50 2023-10-05T19:52:49.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f8284d61700 1 -- 172.21.15.167:0/1042101649 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f8280019070 con 0x555c62ebcb50 2023-10-05T19:52:49.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f8284d61700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8268030c50 0x7f8268033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f8284d61700 1 -- 172.21.15.167:0/1042101649 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f828002c070 con 0x555c62ebcb50 2023-10-05T19:52:49.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f8287d67700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8268030c50 0x7f8268033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555c62ebd460 0x555c62eee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62eee920 con 0x555c62ebd460 2023-10-05T19:52:49.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f8288d69700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555c62ebd460 0x555c62eee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f8287d67700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8268030c50 0x7f8268033100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8270004170 tx=0x7f8270001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.785+0000 7f8288d69700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555c62ebd460 0x555c62eee2b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 20 realm 2023-10-05T19:52:49.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62eeb910 con 0x555c62ebd460 2023-10-05T19:52:49.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:49.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62eef400 con 0x555c62ebd460 2023-10-05T19:52:49.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555c62eef030 0x555c62ef2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef29a0 con 0x555c62eef030 2023-10-05T19:52:49.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f8288568700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555c62eef030 0x555c62ef2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f8288568700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555c62eef030 0x555c62ef2270 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.789+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef3270 con 0x555c62ebd460 2023-10-05T19:52:49.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:49.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f828aa33e40 20 searching for the correct realm 2023-10-05T19:52:49.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555c62ef2de0 0x555c62ef7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ef2de0 2023-10-05T19:52:49.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8287d67700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555c62ef2de0 0x555c62ef7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8287d67700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555c62ef2de0 0x555c62ef7040 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270006070 con 0x555c62ef2de0 2023-10-05T19:52:49.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62eef030 2023-10-05T19:52:49.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8288568700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8280007030 0x7f82800119f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x7f8280007030 2023-10-05T19:52:49.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8288d69700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8280007030 0x7f82800119f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.793+0000 7f8288d69700 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8280007030 0x7f82800119f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ef2de0 2023-10-05T19:52:49.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270006070 con 0x555c62ef2de0 2023-10-05T19:52:49.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62eef030 2023-10-05T19:52:49.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62eef030 2023-10-05T19:52:49.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.797+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x7f8280007030 2023-10-05T19:52:49.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x7f8280007030 2023-10-05T19:52:49.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62eef030 2023-10-05T19:52:49.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ef2de0 2023-10-05T19:52:49.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270006070 con 0x555c62ef2de0 2023-10-05T19:52:49.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.801+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62eef030 2023-10-05T19:52:49.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ef2de0 2023-10-05T19:52:49.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270006070 con 0x555c62ef2de0 2023-10-05T19:52:49.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ef2de0 2023-10-05T19:52:49.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270006070 con 0x555c62ef2de0 2023-10-05T19:52:49.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.805+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x7f8280007030 2023-10-05T19:52:49.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ebd460 2023-10-05T19:52:49.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x7f8280007030 2023-10-05T19:52:49.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ef2de0 2023-10-05T19:52:49.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270006070 con 0x555c62ef2de0 2023-10-05T19:52:49.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x7f8280007030 2023-10-05T19:52:49.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62eef030 2023-10-05T19:52:49.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.809+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62eef030 2023-10-05T19:52:49.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.815 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62ef2de0 2023-10-05T19:52:49.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270006070 con 0x555c62ef2de0 2023-10-05T19:52:49.816 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62eef030 2023-10-05T19:52:49.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.817 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7620 con 0x555c62eef030 2023-10-05T19:52:49.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f828aa33e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:49.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f828aa33e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:49.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f828aa33e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:49.818 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f828aa33e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:49.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef3de0 con 0x555c62ebd460 2023-10-05T19:52:49.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.819 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.813+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef4270 con 0x555c62eef030 2023-10-05T19:52:49.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.820 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62eef030 2023-10-05T19:52:49.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:49.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef7f80 con 0x555c62ef2de0 2023-10-05T19:52:49.821 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f8270006070 con 0x555c62ef2de0 2023-10-05T19:52:49.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef8330 con 0x555c62ebd460 2023-10-05T19:52:49.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.822 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef86e0 con 0x555c62eef030 2023-10-05T19:52:49.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.823 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.817+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef96f0 con 0x555c62ef2de0 2023-10-05T19:52:49.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef96f0 con 0x555c62eef030 2023-10-05T19:52:49.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.824 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x7f8280007030 2023-10-05T19:52:49.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62ebd460 2023-10-05T19:52:49.825 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62ebd460 2023-10-05T19:52:49.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.826 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62ef2de0 2023-10-05T19:52:49.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62ebd460 2023-10-05T19:52:49.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.827 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.821+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62eef030 2023-10-05T19:52:49.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.828 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62eef030 2023-10-05T19:52:49.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.829 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62ebd460 2023-10-05T19:52:49.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x7f8280007030 2023-10-05T19:52:49.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.830 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62ebd460 2023-10-05T19:52:49.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.825+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x7f8280007030 2023-10-05T19:52:49.831 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62eef030 2023-10-05T19:52:49.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.832 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef46a0 con 0x555c62ef2de0 2023-10-05T19:52:49.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62ebd460 2023-10-05T19:52:49.833 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62eef030 2023-10-05T19:52:49.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.834 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62ef2de0 2023-10-05T19:52:49.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.835 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.829+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62ebd460 2023-10-05T19:52:49.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62ebd460 2023-10-05T19:52:49.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.836 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62ebd460 2023-10-05T19:52:49.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62ef2de0 2023-10-05T19:52:49.837 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x7f8280007030 2023-10-05T19:52:49.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.838 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62ebd460 2023-10-05T19:52:49.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x7f8280007030 2023-10-05T19:52:49.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.833+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.839 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62ef2de0 2023-10-05T19:52:49.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x7f8280007030 2023-10-05T19:52:49.840 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62eef030 2023-10-05T19:52:49.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.841 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62eef030 2023-10-05T19:52:49.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.842 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62ef2de0 2023-10-05T19:52:49.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.843 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.837+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62eef030 2023-10-05T19:52:49.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.844 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f8270028040 con 0x555c62eef030 2023-10-05T19:52:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.845 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef86e0 con 0x555c62eef030 2023-10-05T19:52:49.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.846 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef86e0 con 0x555c62ebd460 2023-10-05T19:52:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.847 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.841+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef8f80 con 0x555c62eef030 2023-10-05T19:52:49.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:49.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.848 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef8f80 con 0x555c62eef030 2023-10-05T19:52:49.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:49.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef9080 con 0x7f8280007030 2023-10-05T19:52:49.849 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 zone default found 2023-10-05T19:52:49.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 4 Realm: () 2023-10-05T19:52:49.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:49.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:49.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:49.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 zonegroup default 2023-10-05T19:52:49.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.850 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef9080 con 0x7f8280007030 2023-10-05T19:52:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efaa00 con 0x555c62ef2de0 2023-10-05T19:52:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.852 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.845+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efadb0 con 0x555c62ef2de0 2023-10-05T19:52:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.849+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.849+0000 7f828aa33e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.849+0000 7f828aa33e40 20 started sync module instance, tier type = 2023-10-05T19:52:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.849+0000 7f828aa33e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:49.853 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.849+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efa0c0 con 0x555c62eef030 2023-10-05T19:52:49.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.849+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.849+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93855285222352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efa5e0 con 0x555c62eef030 2023-10-05T19:52:49.854 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.849+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efbb40 con 0x555c62ebd460 2023-10-05T19:52:49.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.853+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.853+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93855285229136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efa5e0 con 0x555c62ebd460 2023-10-05T19:52:49.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.853+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efc630 con 0x555c62eef030 2023-10-05T19:52:49.857 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.853+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 93855285222352] v32'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.853+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 93855285229136] v32'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.859 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.853+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.857+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93855285230240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efc100 con 0x555c62eef030 2023-10-05T19:52:49.860 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.857+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efcf20 con 0x7f8280007030 2023-10-05T19:52:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.857+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.857+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 93855285230240] v32'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.857+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 93855285234224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efc100 con 0x7f8280007030 2023-10-05T19:52:49.862 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.857+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efd370 con 0x555c62eef030 2023-10-05T19:52:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.861+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 93855285234224] v32'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.861+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.861+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 93855285227872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efd370 con 0x555c62eef030 2023-10-05T19:52:49.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.861+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efdc10 con 0x555c62ef2de0 2023-10-05T19:52:49.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.861+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.861+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 93855285236864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efe4b0 con 0x555c62ef2de0 2023-10-05T19:52:49.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.861+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efeec0 con 0x555c62ef2de0 2023-10-05T19:52:49.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.861+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 93855285227872] v32'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v32'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 93855285236864] v32'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93855285235328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62eff760 con 0x555c62ef2de0 2023-10-05T19:52:49.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62effb10 con 0x7f8280007030 2023-10-05T19:52:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 93855285235328] v32'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'261 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93855285244528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62effbb0 con 0x7f8280007030 2023-10-05T19:52:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 20 add_watcher() i=0 2023-10-05T19:52:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 20 add_watcher() i=1 2023-10-05T19:52:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 20 add_watcher() i=2 2023-10-05T19:52:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 20 add_watcher() i=3 2023-10-05T19:52:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 20 add_watcher() i=4 2023-10-05T19:52:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 20 add_watcher() i=5 2023-10-05T19:52:49.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.865+0000 7f828aa33e40 20 add_watcher() i=6 2023-10-05T19:52:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 93855285244528] v32'262 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x7f8280007030 2023-10-05T19:52:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f828aa33e40 20 add_watcher() i=7 2023-10-05T19:52:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f828aa33e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:49.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62f02c80 con 0x555c62ebd460 2023-10-05T19:52:49.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93855285245632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62f00000 con 0x555c62ebd460 2023-10-05T19:52:49.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 93855285245632] v32'250 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f827800a5a0 con 0x555c62ebd460 2023-10-05T19:52:49.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f8259fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:49.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f828aa33e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:49.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f828aa33e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:49.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f828aa33e40 1 Processor -- start 2023-10-05T19:52:49.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.869+0000 7f828aa33e40 1 -- start start 2023-10-05T19:52:49.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f0d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c62f0da80 con 0x555c62f0d170 2023-10-05T19:52:49.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f8287d67700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f0d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f8287d67700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f0d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48014/0 (socket says 172.21.15.167:48014) 2023-10-05T19:52:49.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f8287d67700 1 -- 172.21.15.167:0/1495866682 learned_addr learned my addr 172.21.15.167:0/1495866682 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:49.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f8287d67700 1 -- 172.21.15.167:0/1495866682 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c62f0dbc0 con 0x555c62f0d170 2023-10-05T19:52:49.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f8287d67700 1 --2- 172.21.15.167:0/1495866682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f0d540 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x555c62eeef70 tx=0x7f8270010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b387878442def3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f82597e2700 1 -- 172.21.15.167:0/1495866682 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f827003b070 con 0x555c62f0d170 2023-10-05T19:52:49.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f82597e2700 1 -- 172.21.15.167:0/1495866682 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270022040 con 0x555c62f0d170 2023-10-05T19:52:49.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f82597e2700 1 -- 172.21.15.167:0/1495866682 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8270021040 con 0x555c62f0d170 2023-10-05T19:52:49.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 -- 172.21.15.167:0/1495866682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 msgr2=0x555c62f0d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1495866682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f0d540 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x555c62eeef70 tx=0x7f8270010000 comp rx=0 tx=0).stop 2023-10-05T19:52:49.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 -- 172.21.15.167:0/1495866682 shutdown_connections 2023-10-05T19:52:49.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1495866682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f0d540 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 -- 172.21.15.167:0/1495866682 >> 172.21.15.167:0/1495866682 conn(0x555c62f08530 msgr2=0x555c62f066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 -- 172.21.15.167:0/1495866682 shutdown_connections 2023-10-05T19:52:49.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 -- 172.21.15.167:0/1495866682 wait complete. 2023-10-05T19:52:49.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 Processor -- start 2023-10-05T19:52:49.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 -- start start 2023-10-05T19:52:49.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f12b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.873+0000 7f828aa33e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c62f13b10 con 0x555c62f0d170 2023-10-05T19:52:49.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f8287d67700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f12b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f8287d67700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f12b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48016/0 (socket says 172.21.15.167:48016) 2023-10-05T19:52:49.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f8287d67700 1 -- 172.21.15.167:0/4180311739 learned_addr learned my addr 172.21.15.167:0/4180311739 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:49.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f8287d67700 1 -- 172.21.15.167:0/4180311739 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c62e07bd0 con 0x555c62f0d170 2023-10-05T19:52:49.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f8287d67700 1 --2- 172.21.15.167:0/4180311739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f12b10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8270001b00 tx=0x7f8270037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f81d37fe700 1 -- 172.21.15.167:0/4180311739 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8270021070 con 0x555c62f0d170 2023-10-05T19:52:49.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f81d37fe700 1 -- 172.21.15.167:0/4180311739 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270041420 con 0x555c62f0d170 2023-10-05T19:52:49.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f828aa33e40 1 -- 172.21.15.167:0/4180311739 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c62f13110 con 0x555c62f0d170 2023-10-05T19:52:49.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f81d37fe700 1 -- 172.21.15.167:0/4180311739 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8270046070 con 0x555c62f0d170 2023-10-05T19:52:49.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f828aa33e40 1 -- 172.21.15.167:0/4180311739 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c62f135b0 con 0x555c62f0d170 2023-10-05T19:52:49.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f81d37fe700 1 -- 172.21.15.167:0/4180311739 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f827003e020 con 0x555c62f0d170 2023-10-05T19:52:49.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f81d37fe700 1 --2- 172.21.15.167:0/4180311739 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81c8030bb0 0x7f81c8033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:49.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f81d37fe700 1 -- 172.21.15.167:0/4180311739 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f827002e040 con 0x555c62f0d170 2023-10-05T19:52:49.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f8288d69700 1 --2- 172.21.15.167:0/4180311739 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81c8030bb0 0x7f81c8033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:49.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.877+0000 7f828aa33e40 5 note: GC not initialized 2023-10-05T19:52:49.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f8288d69700 1 --2- 172.21.15.167:0/4180311739 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81c8030bb0 0x7f81c8033060 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x555c62efe1c0 tx=0x7f827800ae50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:49.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f81d0ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:49.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f828aa33e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:49.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f81c67fc700 20 reqs_thread_entry: start 2023-10-05T19:52:49.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f828aa33e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:49.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f81c4ff9700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:53:20 2023 2023-10-05T19:52:49.886 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:49.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f81abfff700 20 reqs_thread_entry: start 2023-10-05T19:52:49.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f828aa33e40 20 get_system_obj_state: rctx=0x7fff2e3e0018 obj=default.rgw.meta:users.uid:foo state=0x555c62d940b0 s->prefetch_data=0 2023-10-05T19:52:49.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62f7b3c0 con 0x555c62ebd460 2023-10-05T19:52:49.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7f827803d050 con 0x555c62ebd460 2023-10-05T19:52:49.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f828aa33e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:49.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f828aa33e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:49.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f828aa33e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.881+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62f7de50 con 0x555c62ebd460 2023-10-05T19:52:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.885+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7f827803d050 con 0x555c62ebd460 2023-10-05T19:52:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.885+0000 7f828aa33e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:52:49.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.885+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:104 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62f7ce40 con 0x555c62ef2de0 2023-10-05T19:52:49.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.885+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(104 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.885+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93855285222352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62f397b0 con 0x555c62eef030 2023-10-05T19:52:49.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.889+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(105 notify.0 [watch unwatch cookie 93855285222352] v32'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.889+0000 7f828aa33e40 20 remove_watcher() i=0 2023-10-05T19:52:49.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.889+0000 7f828aa33e40 2 removed watcher, disabling cache 2023-10-05T19:52:49.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.889+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:106 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93855285229136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef9bd0 con 0x555c62ebd460 2023-10-05T19:52:49.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.889+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(106 notify.1 [watch unwatch cookie 93855285229136] v32'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827803d050 con 0x555c62ebd460 2023-10-05T19:52:49.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.889+0000 7f828aa33e40 20 remove_watcher() i=1 2023-10-05T19:52:49.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.889+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93855285230240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62ef9bd0 con 0x555c62eef030 2023-10-05T19:52:49.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.893+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(107 notify.2 [watch unwatch cookie 93855285230240] v32'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.893+0000 7f828aa33e40 20 remove_watcher() i=2 2023-10-05T19:52:49.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.893+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93855285234224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efbb40 con 0x7f8280007030 2023-10-05T19:52:49.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.893+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(108 notify.3 [watch unwatch cookie 93855285234224] v32'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827803d050 con 0x7f8280007030 2023-10-05T19:52:49.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.893+0000 7f828aa33e40 20 remove_watcher() i=3 2023-10-05T19:52:49.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.893+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93855285227872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efbb40 con 0x555c62eef030 2023-10-05T19:52:49.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.897+0000 7f8288568700 1 -- 172.21.15.167:0/1042101649 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(109 notify.4 [watch unwatch cookie 93855285227872] v32'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8280022020 con 0x555c62eef030 2023-10-05T19:52:49.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.897+0000 7f828aa33e40 20 remove_watcher() i=4 2023-10-05T19:52:49.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.897+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93855285236864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efbb40 con 0x555c62ef2de0 2023-10-05T19:52:49.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.897+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(110 notify.5 [watch unwatch cookie 93855285236864] v32'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.897+0000 7f828aa33e40 20 remove_watcher() i=5 2023-10-05T19:52:49.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.897+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:111 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93855285235328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efbb40 con 0x555c62ef2de0 2023-10-05T19:52:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.901+0000 7f8287d67700 1 -- 172.21.15.167:0/1042101649 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(111 notify.6 [watch unwatch cookie 93855285235328] v32'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8270024040 con 0x555c62ef2de0 2023-10-05T19:52:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.901+0000 7f828aa33e40 20 remove_watcher() i=6 2023-10-05T19:52:49.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.901+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:112 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93855285244528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efcef0 con 0x7f8280007030 2023-10-05T19:52:49.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.901+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(112 notify.7 [watch unwatch cookie 93855285244528] v32'263 uv261 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f827803d050 con 0x7f8280007030 2023-10-05T19:52:49.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.901+0000 7f828aa33e40 20 remove_watcher() i=7 2023-10-05T19:52:49.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f8259fe3700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:49.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93855285245632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555c62efcef0 con 0x555c62ebd460 2023-10-05T19:52:49.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 data_loggenerations_metadata [watch unwatch cookie 93855285245632] v32'251 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f827803d050 con 0x555c62ebd460 2023-10-05T19:52:49.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555c62eef030 msgr2=0x555c62ef2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555c62eef030 0x555c62ef2270 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555c62ebd460 msgr2=0x555c62eee2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555c62ebd460 0x555c62eee2b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8280007030 msgr2=0x7f82800119f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8280007030 0x7f82800119f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555c62ef2de0 msgr2=0x555c62ef7040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555c62ef2de0 0x555c62ef7040 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8268030c50 msgr2=0x7f8268033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8268030c50 0x7f8268033100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8270004170 tx=0x7f8270001380 comp rx=0 tx=0).stop 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 msgr2=0x555c62ee27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f8288d69700 1 -- 172.21.15.167:0/1042101649 reap_dead start 2023-10-05T19:52:49.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62ee27c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f828001e040 tx=0x7f8280003050 comp rx=0 tx=0).stop 2023-10-05T19:52:49.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 shutdown_connections 2023-10-05T19:52:49.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 --2- 172.21.15.167:0/1042101649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62ebcb50 0x555c62ee27c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 >> 172.21.15.167:0/1042101649 conn(0x555c62e305c0 msgr2=0x555c62ed61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 shutdown_connections 2023-10-05T19:52:49.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.905+0000 7f828aa33e40 1 -- 172.21.15.167:0/1042101649 wait complete. 2023-10-05T19:52:49.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 -- 172.21.15.167:0/4180311739 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81c8030bb0 msgr2=0x7f81c8033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 --2- 172.21.15.167:0/4180311739 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81c8030bb0 0x7f81c8033060 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x555c62efe1c0 tx=0x7f827800ae50 comp rx=0 tx=0).stop 2023-10-05T19:52:49.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 -- 172.21.15.167:0/4180311739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 msgr2=0x555c62f12b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:49.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 --2- 172.21.15.167:0/4180311739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f12b10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8270001b00 tx=0x7f8270037000 comp rx=0 tx=0).stop 2023-10-05T19:52:49.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 -- 172.21.15.167:0/4180311739 shutdown_connections 2023-10-05T19:52:49.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 --2- 172.21.15.167:0/4180311739 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f81c8030bb0 0x7f81c8033060 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.914 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 --2- 172.21.15.167:0/4180311739 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555c62f0d170 0x555c62f12b10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:49.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 -- 172.21.15.167:0/4180311739 >> 172.21.15.167:0/4180311739 conn(0x555c62f08530 msgr2=0x555c62f065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:49.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 -- 172.21.15.167:0/4180311739 shutdown_connections 2023-10-05T19:52:49.915 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.909+0000 7f828aa33e40 1 -- 172.21.15.167:0/4180311739 wait complete. 2023-10-05T19:52:49.915 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:49.915 INFO:teuthology.orchestra.run.smithi167.stdout: "entries": [], 2023-10-05T19:52:49.915 INFO:teuthology.orchestra.run.smithi167.stdout: "summary": [] 2023-10-05T19:52:49.915 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:49.917 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2023-10-05T19:52:49.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2023-10-05T19:52:49.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2023-10-05T19:52:49.918 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2023-10-05T19:52:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:49.999 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:50.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.993+0000 7efd64ed6e40 1 Processor -- start 2023-10-05T19:52:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 -- start start 2023-10-05T19:52:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559241e2eb60 0x559241e2ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559241d79bd0 con 0x559241e2f470 2023-10-05T19:52:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x559241d36ee0 con 0x559241e2eb60 2023-10-05T19:52:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd62a0b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559241e2eb60 0x559241e2ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd6220a700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x559241e2f470 0x559241e2ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60370/0 (socket says 172.21.15.167:60370) 2023-10-05T19:52:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd62a0b700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x559241e2eb60 0x559241e2ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48028/0 (socket says 172.21.15.167:48028) 2023-10-05T19:52:50.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd6220a700 1 -- 172.21.15.167:0/4216006390 learned_addr learned my addr 172.21.15.167:0/4216006390 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd62a0b700 1 -- 172.21.15.167:0/4216006390 >> v1:172.21.15.118:6789/0 conn(0x559241e2f470 legacy=0x559241e2ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd62a0b700 1 -- 172.21.15.167:0/4216006390 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559241e30610 con 0x559241e2eb60 2023-10-05T19:52:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd62a0b700 1 --2- 172.21.15.167:0/4216006390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e2ef30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00a5d0 tx=0x7efd5c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9978793b031bef0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd61a09700 1 -- 172.21.15.167:0/4216006390 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd5c0086a0 con 0x559241e2eb60 2023-10-05T19:52:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd61a09700 1 -- 172.21.15.167:0/4216006390 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c008800 con 0x559241e2eb60 2023-10-05T19:52:50.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd61a09700 1 -- 172.21.15.167:0/4216006390 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd5c008ad0 con 0x559241e2eb60 2023-10-05T19:52:50.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4216006390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 msgr2=0x559241e2ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4216006390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e2ef30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00a5d0 tx=0x7efd5c005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4216006390 shutdown_connections 2023-10-05T19:52:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4216006390 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e2ef30 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4216006390 >> 172.21.15.167:0/4216006390 conn(0x559241da25d0 msgr2=0x559241da29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4216006390 shutdown_connections 2023-10-05T19:52:50.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:49.997+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4216006390 wait complete. 2023-10-05T19:52:50.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.001+0000 7efd64ed6e40 1 Processor -- start 2023-10-05T19:52:50.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.001+0000 7efd64ed6e40 1 -- start start 2023-10-05T19:52:50.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.001+0000 7efd64ed6e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e4dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.001+0000 7efd64ed6e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559241cfae30 con 0x559241e2eb60 2023-10-05T19:52:50.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.001+0000 7efd62a0b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e4dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.001+0000 7efd62a0b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e4dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48036/0 (socket says 172.21.15.167:48036) 2023-10-05T19:52:50.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.001+0000 7efd62a0b700 1 -- 172.21.15.167:0/769205199 learned_addr learned my addr 172.21.15.167:0/769205199 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.001+0000 7efd62a0b700 1 -- 172.21.15.167:0/769205199 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c005cf0 con 0x559241e2eb60 2023-10-05T19:52:50.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd62a0b700 1 --2- 172.21.15.167:0/769205199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e4dbd0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7efd5c000c00 tx=0x7efd5c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761a2a490735557d server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd60a07700 1 -- 172.21.15.167:0/769205199 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd5c008970 con 0x559241e2eb60 2023-10-05T19:52:50.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd60a07700 1 -- 172.21.15.167:0/769205199 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c008af0 con 0x559241e2eb60 2023-10-05T19:52:50.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd60a07700 1 -- 172.21.15.167:0/769205199 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd5c008de0 con 0x559241e2eb60 2023-10-05T19:52:50.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 -- 172.21.15.167:0/769205199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 msgr2=0x559241e4dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/769205199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e4dbd0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7efd5c000c00 tx=0x7efd5c015000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 -- 172.21.15.167:0/769205199 shutdown_connections 2023-10-05T19:52:50.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/769205199 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e4dbd0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 -- 172.21.15.167:0/769205199 >> 172.21.15.167:0/769205199 conn(0x559241da25d0 msgr2=0x559241e49790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 -- 172.21.15.167:0/769205199 shutdown_connections 2023-10-05T19:52:50.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 -- 172.21.15.167:0/769205199 wait complete. 2023-10-05T19:52:50.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 Processor -- start 2023-10-05T19:52:50.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 -- start start 2023-10-05T19:52:50.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd64ed6e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559241ccded0 con 0x559241e2eb60 2023-10-05T19:52:50.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.005+0000 7efd62a0b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd62a0b700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48040/0 (socket says 172.21.15.167:48040) 2023-10-05T19:52:50.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 learned_addr learned my addr 172.21.15.167:0/4195626600 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559241e30610 con 0x559241e2eb60 2023-10-05T19:52:50.012 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd62a0b700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e547e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7efd5c008fd0 tx=0x7efd5c003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd5affd700 1 -- 172.21.15.167:0/4195626600 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd5c012b70 con 0x559241e2eb60 2023-10-05T19:52:50.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd5affd700 1 -- 172.21.15.167:0/4195626600 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c02a070 con 0x559241e2eb60 2023-10-05T19:52:50.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd5affd700 1 -- 172.21.15.167:0/4195626600 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd5c031480 con 0x559241e2eb60 2023-10-05T19:52:50.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559241e54d20 con 0x559241e2eb60 2023-10-05T19:52:50.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559241e551c0 con 0x559241e2eb60 2023-10-05T19:52:50.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd5affd700 1 -- 172.21.15.167:0/4195626600 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7efd5c019070 con 0x559241e2eb60 2023-10-05T19:52:50.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd5affd700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd48030c50 0x7efd48033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd5affd700 1 -- 172.21.15.167:0/4195626600 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7efd5c02c070 con 0x559241e2eb60 2023-10-05T19:52:50.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd6220a700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd48030c50 0x7efd48033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.009+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e2f470 0x559241e60240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e60970 con 0x559241e2f470 2023-10-05T19:52:50.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd6320c700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e2f470 0x559241e60240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd6220a700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd48030c50 0x7efd48033100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0016f0 tx=0x7efd4c0067f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd6320c700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e2f470 0x559241e60240 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd5400a500 con 0x559241e2f470 2023-10-05T19:52:50.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 20 realm 2023-10-05T19:52:50.018 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e5d870 con 0x559241e2f470 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd5400a500 con 0x559241e2f470 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e614a0 con 0x559241e2f470 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd5400a500 con 0x559241e2f470 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e622d0 0x559241e646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.019 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e64bf0 con 0x559241e622d0 2023-10-05T19:52:50.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd62a0b700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e622d0 0x559241e646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.013+0000 7efd62a0b700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e622d0 0x559241e646b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e650a0 con 0x559241e2f470 2023-10-05T19:52:50.021 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7efd5400a500 con 0x559241e2f470 2023-10-05T19:52:50.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd64ed6e40 20 searching for the correct realm 2023-10-05T19:52:50.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e67010 0x559241e69420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e67010 2023-10-05T19:52:50.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd6220a700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e67010 0x559241e69420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.022 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd6220a700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e67010 0x559241e69420 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c0060d0 con 0x559241e67010 2023-10-05T19:52:50.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e622d0 2023-10-05T19:52:50.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd62a0b700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efd5c007030 0x7efd5c026880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x7efd5c007030 2023-10-05T19:52:50.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd6320c700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efd5c007030 0x7efd5c026880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.023 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd6320c700 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efd5c007030 0x7efd5c026880 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.017+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x7efd5c007030 2023-10-05T19:52:50.024 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e67010 2023-10-05T19:52:50.025 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c004520 con 0x559241e67010 2023-10-05T19:52:50.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e622d0 2023-10-05T19:52:50.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.026 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e622d0 2023-10-05T19:52:50.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.027 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.021+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.028 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x7efd5c007030 2023-10-05T19:52:50.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x7efd5c007030 2023-10-05T19:52:50.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x7efd5c007030 2023-10-05T19:52:50.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x7efd5c007030 2023-10-05T19:52:50.029 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e622d0 2023-10-05T19:52:50.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.030 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e67010 2023-10-05T19:52:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c004520 con 0x559241e67010 2023-10-05T19:52:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.031 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.025+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e622d0 2023-10-05T19:52:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e67010 2023-10-05T19:52:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.032 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.033 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.034 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e67010 2023-10-05T19:52:50.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x7efd5c007030 2023-10-05T19:52:50.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x7efd5c007030 2023-10-05T19:52:50.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e2f470 2023-10-05T19:52:50.035 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.029+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x7efd5c007030 2023-10-05T19:52:50.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x7efd5c007030 2023-10-05T19:52:50.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e67010 2023-10-05T19:52:50.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.036 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x7efd5c007030 2023-10-05T19:52:50.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x7efd5c007030 2023-10-05T19:52:50.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e622d0 2023-10-05T19:52:50.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.037 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e622d0 2023-10-05T19:52:50.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.038 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e67010 2023-10-05T19:52:50.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.039 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.033+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e622d0 2023-10-05T19:52:50.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.040 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69a30 con 0x559241e622d0 2023-10-05T19:52:50.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:50.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:50.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:50.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:50.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.041 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e65dc0 con 0x559241e2f470 2023-10-05T19:52:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.042 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e66710 con 0x559241e622d0 2023-10-05T19:52:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.043 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.037+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e69ea0 con 0x559241e622d0 2023-10-05T19:52:50.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:50.044 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a250 con 0x559241e67010 2023-10-05T19:52:50.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.045 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e662b0 con 0x559241e622d0 2023-10-05T19:52:50.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.046 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6bf00 con 0x559241e67010 2023-10-05T19:52:50.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6bf00 con 0x559241e622d0 2023-10-05T19:52:50.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.047 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.041+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e662b0 con 0x7efd5c007030 2023-10-05T19:52:50.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x7efd5c007030 2023-10-05T19:52:50.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.048 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.049 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e67010 2023-10-05T19:52:50.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.050 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e622d0 2023-10-05T19:52:50.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.051 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.045+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e622d0 2023-10-05T19:52:50.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.052 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x7efd5c007030 2023-10-05T19:52:50.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x7efd5c007030 2023-10-05T19:52:50.053 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x7efd5c007030 2023-10-05T19:52:50.054 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x7efd5c007030 2023-10-05T19:52:50.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e622d0 2023-10-05T19:52:50.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.055 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.049+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e67010 2023-10-05T19:52:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.056 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e622d0 2023-10-05T19:52:50.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.057 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e67010 2023-10-05T19:52:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.058 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54014040 con 0x559241e2f470 2023-10-05T19:52:50.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.059 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.053+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.060 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e67010 2023-10-05T19:52:50.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x7efd5c007030 2023-10-05T19:52:50.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.061 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e2f470 2023-10-05T19:52:50.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x7efd5c007030 2023-10-05T19:52:50.062 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e67010 2023-10-05T19:52:50.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.063 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.057+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x7efd5c007030 2023-10-05T19:52:50.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e622d0 2023-10-05T19:52:50.064 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.065 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e622d0 2023-10-05T19:52:50.066 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e67010 2023-10-05T19:52:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e622d0 2023-10-05T19:52:50.067 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.061+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6a600 con 0x559241e622d0 2023-10-05T19:52:50.068 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.069 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e66280 con 0x559241e622d0 2023-10-05T19:52:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.070 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e66280 con 0x559241e2f470 2023-10-05T19:52:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.071 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6b3e0 con 0x559241e622d0 2023-10-05T19:52:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.065+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6b3e0 con 0x559241e622d0 2023-10-05T19:52:50.072 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:50.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.073 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6b4e0 con 0x7efd5c007030 2023-10-05T19:52:50.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 zone default found 2023-10-05T19:52:50.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 4 Realm: () 2023-10-05T19:52:50.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:50.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:50.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:50.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 zonegroup default 2023-10-05T19:52:50.074 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6b4e0 con 0x7efd5c007030 2023-10-05T19:52:50.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.075 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6ce60 con 0x559241e67010 2023-10-05T19:52:50.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6d210 con 0x559241e67010 2023-10-05T19:52:50.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.076 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 started sync module instance, tier type = 2023-10-05T19:52:50.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:50.077 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.069+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6c520 con 0x559241e622d0 2023-10-05T19:52:50.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.073+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.073+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94086659227984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6ca90 con 0x559241e622d0 2023-10-05T19:52:50.078 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.073+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6db90 con 0x559241e2f470 2023-10-05T19:52:50.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.077+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94086659227984] v32'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.077+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.080 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.077+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94086659233728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6ca90 con 0x559241e2f470 2023-10-05T19:52:50.081 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.077+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6e480 con 0x559241e622d0 2023-10-05T19:52:50.082 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.077+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94086659233728] v32'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.077+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.077+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94086659236016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6ca90 con 0x559241e622d0 2023-10-05T19:52:50.083 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.077+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6ed70 con 0x7efd5c007030 2023-10-05T19:52:50.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.081+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94086659236016] v32'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.081+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.081+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94086659229376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6ed70 con 0x7efd5c007030 2023-10-05T19:52:50.086 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.081+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6f610 con 0x559241e622d0 2023-10-05T19:52:50.087 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.085+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94086659229376] v32'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.085+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.085+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94086659238576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6f3f0 con 0x559241e622d0 2023-10-05T19:52:50.088 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.085+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6ff80 con 0x559241e67010 2023-10-05T19:52:50.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.085+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.085+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94086659242576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e70870 con 0x559241e67010 2023-10-05T19:52:50.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.085+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e712f0 con 0x559241e67010 2023-10-05T19:52:50.090 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.085+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94086659238576] v32'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(96 notify.6 [create] v32'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(95 notify.5 [watch watch cookie 94086659242576] v32'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94086659239680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e71be0 con 0x559241e67010 2023-10-05T19:52:50.092 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e72480 con 0x7efd5c007030 2023-10-05T19:52:50.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94086659239680] v32'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'264 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94086659249904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e72480 con 0x7efd5c007030 2023-10-05T19:52:50.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 20 add_watcher() i=0 2023-10-05T19:52:50.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 20 add_watcher() i=1 2023-10-05T19:52:50.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 20 add_watcher() i=2 2023-10-05T19:52:50.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 20 add_watcher() i=3 2023-10-05T19:52:50.094 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 20 add_watcher() i=4 2023-10-05T19:52:50.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 20 add_watcher() i=5 2023-10-05T19:52:50.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 20 add_watcher() i=6 2023-10-05T19:52:50.095 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94086659249904] v32'265 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 20 add_watcher() i=7 2023-10-05T19:52:50.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:50.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.089+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e75520 con 0x559241e2f470 2023-10-05T19:52:50.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.096 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94086659252112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e728d0 con 0x559241e2f470 2023-10-05T19:52:50.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94086659252112] v32'252 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd337ee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:50.098 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd64ed6e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:50.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd64ed6e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:50.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd64ed6e40 1 Processor -- start 2023-10-05T19:52:50.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd64ed6e40 1 -- start start 2023-10-05T19:52:50.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd64ed6e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e801b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.099 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.093+0000 7efd64ed6e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559241e806f0 con 0x559241e7fde0 2023-10-05T19:52:50.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd6220a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd6220a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e801b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48052/0 (socket says 172.21.15.167:48052) 2023-10-05T19:52:50.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd6220a700 1 -- 172.21.15.167:0/355712809 learned_addr learned my addr 172.21.15.167:0/355712809 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.100 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd6220a700 1 -- 172.21.15.167:0/355712809 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559241e80830 con 0x559241e7fde0 2023-10-05T19:52:50.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd6220a700 1 --2- 172.21.15.167:0/355712809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e801b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efd4c001330 tx=0x7efd4c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6756bf93431d4bbc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd32fed700 1 -- 172.21.15.167:0/355712809 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd4c01a040 con 0x559241e7fde0 2023-10-05T19:52:50.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd32fed700 1 -- 172.21.15.167:0/355712809 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c01b040 con 0x559241e7fde0 2023-10-05T19:52:50.101 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd32fed700 1 -- 172.21.15.167:0/355712809 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd4c004bb0 con 0x559241e7fde0 2023-10-05T19:52:50.102 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 -- 172.21.15.167:0/355712809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 msgr2=0x559241e801b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/355712809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e801b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efd4c001330 tx=0x7efd4c006000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 -- 172.21.15.167:0/355712809 shutdown_connections 2023-10-05T19:52:50.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/355712809 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e801b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 -- 172.21.15.167:0/355712809 >> 172.21.15.167:0/355712809 conn(0x559241e7b1a0 msgr2=0x559241e792f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 -- 172.21.15.167:0/355712809 shutdown_connections 2023-10-05T19:52:50.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 -- 172.21.15.167:0/355712809 wait complete. 2023-10-05T19:52:50.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 Processor -- start 2023-10-05T19:52:50.103 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 -- start start 2023-10-05T19:52:50.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e85840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd64ed6e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x559241e86840 con 0x559241e7fde0 2023-10-05T19:52:50.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd6220a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e85840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd6220a700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e85840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48066/0 (socket says 172.21.15.167:48066) 2023-10-05T19:52:50.104 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.097+0000 7efd6220a700 1 -- 172.21.15.167:0/1068412053 learned_addr learned my addr 172.21.15.167:0/1068412053 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd6220a700 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559241d79bd0 con 0x559241e7fde0 2023-10-05T19:52:50.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd6220a700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e85840 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efd4c001330 tx=0x7efd4c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd317ea700 1 -- 172.21.15.167:0/1068412053 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd4c01a040 con 0x559241e7fde0 2023-10-05T19:52:50.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd317ea700 1 -- 172.21.15.167:0/1068412053 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c02cca0 con 0x559241e7fde0 2023-10-05T19:52:50.105 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559241e85e40 con 0x559241e7fde0 2023-10-05T19:52:50.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd317ea700 1 -- 172.21.15.167:0/1068412053 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efd4c02ce70 con 0x559241e7fde0 2023-10-05T19:52:50.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559241e86280 con 0x559241e7fde0 2023-10-05T19:52:50.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd317ea700 1 -- 172.21.15.167:0/1068412053 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7efd4c011410 con 0x559241e7fde0 2023-10-05T19:52:50.106 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd317ea700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efca8030bb0 0x7efca8033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd317ea700 1 -- 172.21.15.167:0/1068412053 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7efd4c027040 con 0x559241e7fde0 2023-10-05T19:52:50.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd6320c700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efca8030bb0 0x7efca8033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e90460 0x559241e92870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e92f10 con 0x559241e90460 2023-10-05T19:52:50.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd62a0b700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e90460 0x559241e92870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.107 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.101+0000 7efd6320c700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efca8030bb0 0x7efca8033060 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x559241e75690 tx=0x7efd5400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.108 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.105+0000 7efd62a0b700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e90460 0x559241e92870 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.105+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 gc.0 [create,call,call,call] v32'35 uv28 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.105+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x559241e93be0 0x559241e95fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.105+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:2 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e966f0 con 0x559241e93be0 2023-10-05T19:52:50.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.105+0000 7efd6220a700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x559241e93be0 0x559241e95fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.110 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.105+0000 7efd6220a700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x559241e93be0 0x559241e95fc0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.109+0000 7efd6220a700 1 -- 172.21.15.167:0/1068412053 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(2 gc.1 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e93be0 2023-10-05T19:52:50.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.109+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e973c0 0x559241e997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.109+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e99f00 con 0x559241e973c0 2023-10-05T19:52:50.112 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.109+0000 7efd6320c700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e973c0 0x559241e997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.113 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.109+0000 7efd6320c700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e973c0 0x559241e997d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.109+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 gc.2 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.109+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e9abd0 0x559241e9cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.109+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:4 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9d710 con 0x559241e9abd0 2023-10-05T19:52:50.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.109+0000 7efd62a0b700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e9abd0 0x559241e9cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.113+0000 7efd62a0b700 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e9abd0 0x559241e9cfe0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.113+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(4 gc.3 [create,call,call,call] v32'253 uv182 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.113+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9dd60 con 0x559241e9abd0 2023-10-05T19:52:50.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.113+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(5 gc.4 [create,call,call,call] v32'77 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.117+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9e380 con 0x559241e973c0 2023-10-05T19:52:50.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.117+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(6 gc.5 [create,call,call,call] v32'52 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.117+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9e9a0 con 0x559241e90460 2023-10-05T19:52:50.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.117+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 gc.6 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.117+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9ee90 con 0x559241e9abd0 2023-10-05T19:52:50.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.121+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(8 gc.7 [create,call,call,call] v32'50 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.121+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:9 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9ee90 con 0x559241e90460 2023-10-05T19:52:50.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.125+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(9 gc.8 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.125+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9ee90 con 0x559241e90460 2023-10-05T19:52:50.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.125+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(10 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.131 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.125+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:11 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9ee90 con 0x559241e9abd0 2023-10-05T19:52:50.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.129+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(11 gc.10 [create,call,call,call] v32'78 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.129+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:12 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9ee90 con 0x559241e973c0 2023-10-05T19:52:50.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.129+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(12 gc.11 [create,call,call,call] v32'35 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.129+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f4b0 con 0x559241e90460 2023-10-05T19:52:50.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.133+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(13 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.133+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f4b0 con 0x559241e9abd0 2023-10-05T19:52:50.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.137+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(14 gc.13 [create,call,call,call] v32'72 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.137+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f4b0 con 0x559241e9abd0 2023-10-05T19:52:50.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.137+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(15 gc.14 [create,call,call,call] v32'254 uv184 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.137+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f4b0 con 0x559241e90460 2023-10-05T19:52:50.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.141+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(16 gc.15 [create,call,call,call] v32'74 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.141+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f4b0 con 0x559241e9abd0 2023-10-05T19:52:50.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.141+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(17 gc.16 [create,call,call,call] v32'79 uv58 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.141+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f4b0 con 0x559241e973c0 2023-10-05T19:52:50.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.145+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(18 gc.17 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.145+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f710 con 0x559241e90460 2023-10-05T19:52:50.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.145+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(19 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.149+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:20 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f710 con 0x559241e9abd0 2023-10-05T19:52:50.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.149+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(20 gc.19 [create,call,call,call] v32'255 uv186 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.149+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:21 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f710 con 0x559241e90460 2023-10-05T19:52:50.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.153+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(21 gc.20 [create,call,call,call] v32'75 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.153+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f710 con 0x559241e90460 2023-10-05T19:52:50.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.153+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(22 gc.21 [create,call,call,call] v32'41 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.153+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e9f710 con 0x559241e973c0 2023-10-05T19:52:50.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.157+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(23 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.157+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:24 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e8bd80 con 0x559241e90460 2023-10-05T19:52:50.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.161+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(24 gc.23 [create,call,call,call] v32'37 uv30 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.161+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e8bd80 con 0x559241e973c0 2023-10-05T19:52:50.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.161+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(25 gc.24 [create,call,call,call] v32'27 uv20 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.161+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:26 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e8bd80 con 0x559241e973c0 2023-10-05T19:52:50.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.165+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(26 gc.25 [create,call,call,call] v32'53 uv39 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.165+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e8bd80 con 0x559241e973c0 2023-10-05T19:52:50.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.169+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(27 gc.26 [create,call,call,call] v32'33 uv26 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.169+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:28 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e8bd80 con 0x559241e90460 2023-10-05T19:52:50.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.169+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(28 gc.27 [create,call,call,call] v32'44 uv33 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.169+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e8bd80 con 0x559241e9abd0 2023-10-05T19:52:50.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.173+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(29 gc.28 [create,call,call,call] v32'51 uv37 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.173+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e8bd80 con 0x559241e90460 2023-10-05T19:52:50.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.173+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(30 gc.29 [create,call,call,call] v32'76 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e90460 2023-10-05T19:52:50.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.177+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:31 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e8bd80 con 0x559241e9abd0 2023-10-05T19:52:50.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.177+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(31 gc.30 [create,call,call,call] v32'73 uv43 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e9abd0 2023-10-05T19:52:50.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.177+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e8bd80 con 0x559241e93be0 2023-10-05T19:52:50.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.181+0000 7efd6220a700 1 -- 172.21.15.167:0/1068412053 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(32 gc.31 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e93be0 2023-10-05T19:52:50.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.181+0000 7efca27fc700 20 reqs_thread_entry: start 2023-10-05T19:52:50.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.181+0000 7efc93fff700 20 reqs_thread_entry: start 2023-10-05T19:52:50.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.181+0000 7efd64ed6e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:50.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:50.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efc927fc700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:53:20 2023 2023-10-05T19:52:50.188 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:50.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efc91ffb700 20 reqs_thread_entry: start 2023-10-05T19:52:50.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 20 get_system_obj_state: rctx=0x7fff1c0516a8 obj=default.rgw.meta:users.uid:foo state=0x559241d060b0 s->prefetch_data=0 2023-10-05T19:52:50.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-10-05T19:52:50.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241efe750 con 0x559241e2f470 2023-10-05T19:52:50.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+139 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x16 2023-10-05T19:52:50.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:52:50.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:50.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:50.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:50.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 10 cache get: name=default.rgw.meta+users.uid+foo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:50.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f011e0 con 0x559241e2f470 2023-10-05T19:52:50.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 foo [call,call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 273+0+480 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=357 2023-10-05T19:52:50.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-10-05T19:52:50.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-10-05T19:52:50.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:50.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.185+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:104 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f011e0 con 0x7efd5c007030 2023-10-05T19:52:50.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(104 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 20 get_system_obj_state: rctx=0x7fff1c051350 obj=default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 state=0x559241d060b0 s->prefetch_data=0 2023-10-05T19:52:50.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 : miss 2023-10-05T19:52:50.192 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:105 8.0 8:06c17bc0:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f009f0 con 0x559241e67010 2023-10-05T19:52:50.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(105 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 [call out=48b,getxattrs out=218b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 290+0+282 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 info.flags=0x16 2023-10-05T19:52:50.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 to cache LRU end 2023-10-05T19:52:50.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:50.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:50.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:50.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 20 Read xattr: user.rgw.acl 2023-10-05T19:52:50.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 20 Read xattr: user.rgw.idtag 2023-10-05T19:52:50.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:50.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:106 8.0 8:06c17bc0:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f03480 con 0x559241e67010 2023-10-05T19:52:50.194 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(106 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 [call,call out=48b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+618 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 20 rados_obj.operate() r=0 bl.length=352 2023-10-05T19:52:50.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 info.flags=0x13 2023-10-05T19:52:50.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 to cache LRU end 2023-10-05T19:52:50.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:50.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:50.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 2023-10-05T19:52:50.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 10 int RGWRados::cls_bucket_list_unordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, uint32_t, bool, std::vector&, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter) :myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6]) start_after="", prefix="", shard_id=-1", num_entries=1100, list_versions=1, force_check_filter is unset 2023-10-05T19:52:50.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:107 4.13 4:c94b8f89:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f02fc0 con 0x7efd5c007030 2023-10-05T19:52:50.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(107 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.189+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:108 4.1c 4:380af8f9:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f02fc0 con 0x7efd5c007030 2023-10-05T19:52:50.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.193+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 21 ==== osd_op_reply(108 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.193+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:109 4.36 4:6f85ae29:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f02fc0 con 0x559241e2f470 2023-10-05T19:52:50.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.193+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(109 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.197 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.193+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:110 4.19 4:9bac0f85:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f034f0 con 0x559241e67010 2023-10-05T19:52:50.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.193+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 24 ==== osd_op_reply(110 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.193+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:111 4.20 4:0696092a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f034f0 con 0x559241e622d0 2023-10-05T19:52:50.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.197+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(111 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.197+0000 7efd64ed6e40 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2023-10-05T19:52:50.201 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.197+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 4.5 4:a33e023f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f034f0 con 0x559241e622d0 2023-10-05T19:52:50.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.197+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(112 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.197+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:113 4.2 4:42742c76:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f034f0 con 0x559241e2f470 2023-10-05T19:52:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.197+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(113 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.203 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.197+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:114 4.3a 4:5cf3de03:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f034f0 con 0x559241e67010 2023-10-05T19:52:50.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.201+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 25 ==== osd_op_reply(114 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.201+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:115 4.a 4:52d2f946:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f034f0 con 0x559241e622d0 2023-10-05T19:52:50.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.201+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(115 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.201+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:116 4.d 4:b0d5d84e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f034b0 con 0x559241e622d0 2023-10-05T19:52:50.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.201+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== osd_op_reply(116 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.201+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:117 4.3a 4:5e7ed5a8:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f034b0 con 0x559241e67010 2023-10-05T19:52:50.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.201+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 26 ==== osd_op_reply(117 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.201+0000 7efd64ed6e40 20 get_obj_state: rctx=0x7fff1c051370 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x559241f01b68 s->prefetch_data=0 2023-10-05T19:52:50.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.201+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 3.1cs0 3:38763f4a:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f029c0 con 0x559241e2f470 2023-10-05T19:52:50.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.205+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(118 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.205+0000 7efd64ed6e40 10 manifest: total_size = 6 2023-10-05T19:52:50.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.205+0000 7efd64ed6e40 20 get_obj_state: setting s->obj_tag to e814e647-c2a9-43bf-96a6-1088a1b789e2.4229.3629662178433837582 2023-10-05T19:52:50.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.205+0000 7efd64ed6e40 20 get_obj_state: rctx=0x7fff1c051370 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x559241f01b68 s->prefetch_data=0 2023-10-05T19:52:50.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.205+0000 7efd64ed6e40 20 prepare_atomic_modification: state is not atomic. state=0x559241f01b68 2023-10-05T19:52:50.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.205+0000 7efd64ed6e40 20 bucket index object: default.rgw.buckets.index:.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4 2023-10-05T19:52:50.209 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.205+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:119 4.20 4:0696092a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f07e80 con 0x559241e622d0 2023-10-05T19:52:50.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.205+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== osd_op_reply(119 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4 [stat,call,call] v32'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.205+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:120 3.1cs0 3:38763f4a:::e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f05e60 con 0x559241e2f470 2023-10-05T19:52:50.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(120 e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6_15f6f8dc036519d7fe15b39338f6e5db [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:121 4.20 4:0696092a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08970 con 0x559241e622d0 2023-10-05T19:52:50.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 10 cache get: name=default.rgw.log++bucket.sync-source-hints.myfoo : miss 2023-10-05T19:52:50.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:122 6.18 6:1df25bda:::bucket.sync-source-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f0aed0 con 0x7efd5c007030 2023-10-05T19:52:50.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 22 ==== osd_op_reply(122 bucket.sync-source-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 10 cache put: name=default.rgw.log++bucket.sync-source-hints.myfoo info.flags=0x0 2023-10-05T19:52:50.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 10 adding default.rgw.log++bucket.sync-source-hints.myfoo to cache LRU end 2023-10-05T19:52:50.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 10 cache get: name=default.rgw.log++bucket.sync-target-hints.myfoo : miss 2023-10-05T19:52:50.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:123 6.4 6:26e4c4bc:::bucket.sync-target-hints.myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f0b2f0 con 0x559241e2f470 2023-10-05T19:52:50.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 38 ==== osd_op_reply(123 bucket.sync-target-hints.myfoo [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 216+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 10 cache put: name=default.rgw.log++bucket.sync-target-hints.myfoo info.flags=0x0 2023-10-05T19:52:50.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 10 adding default.rgw.log++bucket.sync-target-hints.myfoo to cache LRU end 2023-10-05T19:52:50.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 10 chain_cache_entry: cache_locator= 2023-10-05T19:52:50.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 20 chain_cache_entry: couldn't find cache locator 2023-10-05T19:52:50.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2023-10-05T19:52:50.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 20 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): starting attempt 1 2023-10-05T19:52:50.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): :myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6]) start_after="_multipart_", prefix="_multipart_, delimiter="", shard_id=-1", num_entries=1001, list_versions=0, expansion_factor=1, force_check_filter is unset 2023-10-05T19:52:50.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 10 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T19:52:50.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:124 4.13 4:c94b8f89:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f0aad0 con 0x7efd5c007030 2023-10-05T19:52:50.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:125 4.1c 4:380af8f9:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e30 con 0x7efd5c007030 2023-10-05T19:52:50.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.209+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:126 4.36 4:6f85ae29:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f87a80 con 0x559241e2f470 2023-10-05T19:52:50.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:127 4.19 4:9bac0f85:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f8a340 con 0x559241e67010 2023-10-05T19:52:50.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:128 4.20 4:0696092a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e30 con 0x559241e622d0 2023-10-05T19:52:50.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:129 4.5 4:a33e023f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f8f590 con 0x559241e622d0 2023-10-05T19:52:50.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:130 4.2 4:42742c76:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e30 con 0x559241e2f470 2023-10-05T19:52:50.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(121 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7efd5c042040 con 0x559241e622d0 2023-10-05T19:52:50.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd60a07700 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2023-10-05T19:52:50.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(129 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd5c07f060 con 0x559241e622d0 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 39 ==== osd_op_reply(126 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 27 ==== osd_op_reply(127 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 40 ==== osd_op_reply(130 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 23 ==== osd_op_reply(124 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== osd_op_reply(128 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7efd5c07f060 con 0x559241e622d0 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 24 ==== osd_op_reply(125 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:131 4.3a 4:5cf3de03:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e30 con 0x559241e67010 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:132 4.a 4:52d2f946:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f8efa0 con 0x559241e622d0 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:133 4.d 4:b0d5d84e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01d20 con 0x559241e622d0 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:134 4.3a 4:5e7ed5a8:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f89230 con 0x559241e67010 2023-10-05T19:52:50.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 28 ==== osd_op_reply(131 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(132 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd5c07f060 con 0x559241e622d0 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(133 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd5c07f060 con 0x559241e622d0 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 29 ==== osd_op_reply(134 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, count=0, is_truncated=0 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 20 int RGWRados::cls_bucket_list_ordered(const DoutPrefixProvider*, RGWBucketInfo&, int, const rgw_obj_index_key&, const string&, const string&, uint32_t, bool, uint16_t, RGWRados::ent_map_t&, bool*, bool*, rgw_obj_index_key*, optional_yield, RGWBucketListNameFilter): returning, last_entry NOT SET 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 10 int RGWRados::Bucket::List::list_objects_ordered(const DoutPrefixProvider*, int64_t, std::vector*, std::map, bool>*, bool*, optional_yield): exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6])"; uploads.size()=0; is_truncated=0 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 10 lifecycle: RGWRados::convert_old_bucket_info(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6]) 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 20 lifecycle: get_system_obj_state: rctx=0x7fff1c050e08 obj=default.rgw.meta:root:myfoo state=0x559241d060b0 s->prefetch_data=0 2023-10-05T19:52:50.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : miss 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.213+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01a80 con 0x7efd5c007030 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 25 ==== osd_op_reply(135 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv39 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: adding default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 20 lifecycle: get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 20 lifecycle: Read xattr: user.rgw.idtag 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x16) 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 20 lifecycle: rados->read ofs=0 len=0 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f88d40 con 0x7efd5c007030 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 26 ==== osd_op_reply(136 myfoo [call,call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv39 ondisk = 0) v8 ==== 275+0+288 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 20 lifecycle: rados_obj.operate() r=0 bl.length=165 2023-10-05T19:52:50.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2023-10-05T19:52:50.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:52:50.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:50.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:137 8.0 8:06c17bc0:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e20 con 0x559241e67010 2023-10-05T19:52:50.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 30 ==== osd_op_reply(137 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 [delete,create,call,call,writefull 0~352,setxattr (123)] v32'2 uv2 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 info.flags=0x17 2023-10-05T19:52:50.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 to cache LRU end 2023-10-05T19:52:50.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:50.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 10 lifecycle: distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6, ofs0, ns] 2023-10-05T19:52:50.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:138 7.9 7:93e5b521:::notify.7:head [notify cookie 94086660395488 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e20 con 0x7efd5c007030 2023-10-05T19:52:50.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 27 ==== watch-notify(notify (1) cookie 94086659249904 notify 137438953503 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7efd54067130 con 0x7efd5c007030 2023-10-05T19:52:50.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd5bfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94086659249904 notifier 4763 bl.length()=725 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd5bfff700 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 info.flags=0x17 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 28 ==== osd_op_reply(138 notify.7 [notify cookie 94086660395488 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd5bfff700 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 to cache LRU end 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd5bfff700 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.217+0000 7efd5bfff700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:139 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efcb00034e0 con 0x7efd5c007030 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 29 ==== osd_op_reply(139 notify.7 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 30 ==== watch-notify(notify_complete (2) cookie 94086660395488 notify 137438953503 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7efd5405f7c0 con 0x7efd5c007030 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd64ed6e40 20 lifecycle: handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6]): orig_sources= new_sources= 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd64ed6e40 20 lifecycle: handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6]): potential sources added=[] removed=[] 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd64ed6e40 20 lifecycle: handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6]): orig_dests= new_dests= 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd64ed6e40 20 lifecycle: handle_bi_update(): bucket=:myfoo[e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6]): potential dests added=[] removed=[] 2023-10-05T19:52:50.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:33 6.11 6:8f661e56:lc::lc.12:head [call lock.lock in=65b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e20 con 0x559241e973c0 2023-10-05T19:52:50.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(33 lc.12 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:34 6.11 6:8f661e56:lc::lc.12:head [call rgw.lc_rm_entry in=92b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e20 con 0x559241e973c0 2023-10-05T19:52:50.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(34 lc.12 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.221+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 6.11 6:8f661e56:lc::lc.12:head [call lock.unlock in=49b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e20 con 0x559241e973c0 2023-10-05T19:52:50.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd6320c700 1 -- 172.21.15.167:0/1068412053 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(35 lc.12 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e973c0 2023-10-05T19:52:50.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:140 4.13 4:c94b8f89:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e20 con 0x7efd5c007030 2023-10-05T19:52:50.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:141 4.1c 4:380af8f9:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08fa0 con 0x7efd5c007030 2023-10-05T19:52:50.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:142 4.36 4:6f85ae29:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f8abc0 con 0x559241e2f470 2023-10-05T19:52:50.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:143 4.19 4:9bac0f85:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08fa0 con 0x559241e67010 2023-10-05T19:52:50.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:144 4.20 4:0696092a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e20 con 0x559241e622d0 2023-10-05T19:52:50.231 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:145 4.5 4:a33e023f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f8abc0 con 0x559241e622d0 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:146 4.2 4:42742c76:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08fa0 con 0x559241e2f470 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 31 ==== osd_op_reply(140 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 32 ==== osd_op_reply(141 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:147 4.3a 4:5cf3de03:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f01e20 con 0x559241e67010 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 31 ==== osd_op_reply(143 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 41 ==== osd_op_reply(142 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:148 4.a 4:52d2f946:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08fa0 con 0x559241e622d0 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 42 ==== osd_op_reply(146 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:149 4.d 4:b0d5d84e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f8abc0 con 0x559241e622d0 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:150 4.3a 4:5e7ed5a8:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08fa0 con 0x559241e67010 2023-10-05T19:52:50.232 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(145 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 43 ==== osd_op_reply(144 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 32 ==== osd_op_reply(147 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 44 ==== osd_op_reply(148 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.8 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 45 ==== osd_op_reply(149 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 33 ==== osd_op_reply(150 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.10 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.233 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.225+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:151 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x7efd5c007030 2023-10-05T19:52:50.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 33 ==== osd_op_reply(151 foo.buckets [call] v32'44 uv44 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 20 get_system_obj_state: rctx=0x7fff1c050888 obj=default.rgw.meta:root:myfoo state=0x559241d060b0 s->prefetch_data=0 2023-10-05T19:52:50.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x16, cached=0x13) 2023-10-05T19:52:50.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x7efd5c007030 2023-10-05T19:52:50.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 34 ==== osd_op_reply(152 myfoo [call out=48b,getxattrs out=75b,stat out=16b] v0'0 uv39 ondisk = 0) v8 ==== 233+0+139 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x16 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 20 get_system_obj_state: s->obj_tag was set empty 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x17) 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 10 removing default.rgw.meta+root+myfoo from cache 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:153 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94086659838224 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08fa0 con 0x559241e67010 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 34 ==== watch-notify(notify (1) cookie 94086659239680 notify 137438953500 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7efd4c05d040 con 0x559241e67010 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd60a07700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94086659239680 notifier 4763 bl.length()=149 2023-10-05T19:52:50.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 35 ==== osd_op_reply(153 notify.6 [notify cookie 94086659838224 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd60a07700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efd3c003c50 con 0x559241e67010 2023-10-05T19:52:50.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 36 ==== osd_op_reply(154 notify.6 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 37 ==== watch-notify(notify_complete (2) cookie 94086659838224 notify 137438953500 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559241e86280 con 0x559241e67010 2023-10-05T19:52:50.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:155 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x7efd5c007030 2023-10-05T19:52:50.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 35 ==== osd_op_reply(155 myfoo [call,call,delete] v32'45 uv45 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 10 removing default.rgw.meta+root+.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 from cache 2023-10-05T19:52:50.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6, ofs0, ns] 2023-10-05T19:52:50.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:156 7.9 7:93e5b521:::notify.7:head [notify cookie 94086659838224 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08fa0 con 0x7efd5c007030 2023-10-05T19:52:50.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.229+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 36 ==== watch-notify(notify (1) cookie 94086659249904 notify 137438953504 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7efd5405f7c0 con 0x7efd5c007030 2023-10-05T19:52:50.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd5bfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94086659249904 notifier 4763 bl.length()=206 2023-10-05T19:52:50.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd5bfff700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:157 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efcb00034c0 con 0x7efd5c007030 2023-10-05T19:52:50.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 37 ==== osd_op_reply(156 notify.7 [notify cookie 94086659838224 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 38 ==== osd_op_reply(157 notify.7 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 39 ==== watch-notify(notify_complete (2) cookie 94086659838224 notify 137438953504 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7efd5405f9f0 con 0x7efd5c007030 2023-10-05T19:52:50.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:158 8.0 8:06c17bc0:root::.bucket.meta.myfoo%3ae814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e67010 2023-10-05T19:52:50.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 38 ==== osd_op_reply(158 .bucket.meta.myfoo:e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 [call,call,delete] v32'3 uv3 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:159 4.13 4:c94b8f89:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x7efd5c007030 2023-10-05T19:52:50.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:160 4.1c 4:380af8f9:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f8abc0 con 0x7efd5c007030 2023-10-05T19:52:50.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:161 4.36 4:6f85ae29:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241eff9e0 con 0x559241e2f470 2023-10-05T19:52:50.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:162 4.19 4:9bac0f85:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e67010 2023-10-05T19:52:50.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:163 4.20 4:0696092a:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f8abc0 con 0x559241e622d0 2023-10-05T19:52:50.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:164 4.5 4:a33e023f:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241eff9e0 con 0x559241e622d0 2023-10-05T19:52:50.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:165 4.2 4:42742c76:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f87d30 con 0x559241e2f470 2023-10-05T19:52:50.240 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:166 4.3a 4:5cf3de03:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f8abc0 con 0x559241e67010 2023-10-05T19:52:50.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:167 4.a 4:52d2f946:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f87d30 con 0x559241e622d0 2023-10-05T19:52:50.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:168 4.d 4:b0d5d84e:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241eff9e0 con 0x559241e622d0 2023-10-05T19:52:50.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.233+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:169 4.3a 4:5e7ed5a8:::.dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e67010 2023-10-05T19:52:50.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 40 ==== osd_op_reply(160 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.1 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 41 ==== osd_op_reply(159 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.0 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 39 ==== osd_op_reply(162 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.3 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 46 ==== osd_op_reply(168 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.9 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 47 ==== osd_op_reply(163 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.4 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 48 ==== osd_op_reply(167 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.8 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 49 ==== osd_op_reply(164 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.5 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.242 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 43 ==== osd_op_reply(165 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.6 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 40 ==== osd_op_reply(166 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.7 [delete] v32'11 uv11 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 41 ==== osd_op_reply(169 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.10 [delete] v32'12 uv12 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 44 ==== osd_op_reply(161 .dir.e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6.2 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:170 6.0 6:06c3b002:::pubsub..bucket.myfoo%2fe814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e2f470 2023-10-05T19:52:50.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.237+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 45 ==== osd_op_reply(170 pubsub..bucket.myfoo/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 250+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd64ed6e40 10 removing default.rgw.log++pubsub..bucket.myfoo/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 from cache 2023-10-05T19:52:50.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd64ed6e40 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6, ofs0, ns] 2023-10-05T19:52:50.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:171 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94086659870848 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e67010 2023-10-05T19:52:50.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 42 ==== watch-notify(notify (1) cookie 94086659239680 notify 137438953501 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x559241e86280 con 0x559241e67010 2023-10-05T19:52:50.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd5bfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94086659239680 notifier 4763 bl.length()=203 2023-10-05T19:52:50.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd5bfff700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efcb00034c0 con 0x559241e67010 2023-10-05T19:52:50.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 43 ==== osd_op_reply(171 notify.6 [notify cookie 94086659870848 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 44 ==== osd_op_reply(172 notify.6 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.245 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 45 ==== watch-notify(notify_complete (2) cookie 94086659870848 notify 137438953501 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559241e85e40 con 0x559241e67010 2023-10-05T19:52:50.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:173 6.0 6:06c3b002:::pubsub..bucket.myfoo%2fe814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e2f470 2023-10-05T19:52:50.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 46 ==== osd_op_reply(173 pubsub..bucket.myfoo/e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.6 [delete] v32'74 uv71 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.241+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:174 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x7efd5c007030 2023-10-05T19:52:50.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 42 ==== osd_op_reply(174 foo.buckets [call] v32'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd64ed6e40 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2023-10-05T19:52:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd64ed6e40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2023-10-05T19:52:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:175 7.e 7:7759931f:::notify.3:head [notify cookie 94086659870848 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x7efd5c007030 2023-10-05T19:52:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 43 ==== watch-notify(notify (1) cookie 94086659229376 notify 137438953505 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7efd5405f9f0 con 0x7efd5c007030 2023-10-05T19:52:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd60a07700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94086659229376 notifier 4763 bl.length()=170 2023-10-05T19:52:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd60a07700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efd3c003c50 con 0x7efd5c007030 2023-10-05T19:52:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 44 ==== osd_op_reply(175 notify.3 [notify cookie 94086659870848 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 45 ==== osd_op_reply(176 notify.3 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.250 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 46 ==== watch-notify(notify_complete (2) cookie 94086659870848 notify 137438953505 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7efd5405fc20 con 0x7efd5c007030 2023-10-05T19:52:50.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:177 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e2f470 2023-10-05T19:52:50.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 47 ==== osd_op_reply(177 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd64ed6e40 10 removing email index: foo@foo.com 2023-10-05T19:52:50.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd64ed6e40 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2023-10-05T19:52:50.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:178 7.e 7:7759931f:::notify.3:head [notify cookie 94086659870848 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x7efd5c007030 2023-10-05T19:52:50.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 47 ==== watch-notify(notify (1) cookie 94086659229376 notify 137438953506 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x7efd5405fc20 con 0x7efd5c007030 2023-10-05T19:52:50.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd5bfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94086659229376 notifier 4763 bl.length()=162 2023-10-05T19:52:50.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 48 ==== osd_op_reply(178 notify.3 [notify cookie 94086659870848 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.251 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd5bfff700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:179 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efcb00034c0 con 0x7efd5c007030 2023-10-05T19:52:50.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 49 ==== osd_op_reply(179 notify.3 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 50 ==== watch-notify(notify_complete (2) cookie 94086659870848 notify 137438953506 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7efd5405fe50 con 0x7efd5c007030 2023-10-05T19:52:50.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.245+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:180 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e2f470 2023-10-05T19:52:50.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 48 ==== osd_op_reply(180 foo@foo.com [delete] v32'11 uv11 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd64ed6e40 10 removing user buckets index 2023-10-05T19:52:50.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd64ed6e40 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2023-10-05T19:52:50.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:181 7.3 7:c609908c:::notify.5:head [notify cookie 94086659870848 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e67010 2023-10-05T19:52:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 46 ==== watch-notify(notify (1) cookie 94086659242576 notify 137438953502 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x559241e85e40 con 0x559241e67010 2023-10-05T19:52:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd5bfff700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94086659242576 notifier 4763 bl.length()=160 2023-10-05T19:52:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 47 ==== osd_op_reply(181 notify.5 [notify cookie 94086659870848 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd5bfff700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:182 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efcb00034c0 con 0x559241e67010 2023-10-05T19:52:50.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 48 ==== osd_op_reply(182 notify.5 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 49 ==== watch-notify(notify_complete (2) cookie 94086659870848 notify 137438953502 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559241d79bd0 con 0x559241e67010 2023-10-05T19:52:50.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.249+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:183 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x7efd5c007030 2023-10-05T19:52:50.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 51 ==== osd_op_reply(183 foo.buckets [delete] v32'47 uv47 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd64ed6e40 10 removing user index: foo 2023-10-05T19:52:50.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd64ed6e40 10 removing default.rgw.meta+users.uid+foo from cache 2023-10-05T19:52:50.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd64ed6e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-10-05T19:52:50.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:184 7.d 7:b4812045:::notify.4:head [notify cookie 94086659870848 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e622d0 2023-10-05T19:52:50.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 50 ==== watch-notify(notify (1) cookie 94086659238576 notify 137438953518 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x559241e551c0 con 0x559241e622d0 2023-10-05T19:52:50.256 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd60a07700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953518 cookie 94086659238576 notifier 4763 bl.length()=152 2023-10-05T19:52:50.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 51 ==== osd_op_reply(184 notify.4 [notify cookie 94086659870848 out=8b] v0'0 uv264 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd60a07700 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:185 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7efd3c003c50 con 0x559241e622d0 2023-10-05T19:52:50.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 52 ==== osd_op_reply(185 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.257 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 53 ==== watch-notify(notify_complete (2) cookie 94086659870848 notify 137438953518 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x559241e54d20 con 0x559241e622d0 2023-10-05T19:52:50.258 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:186 8.18 8:1e6ca5ed:users.uid::foo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f08ab0 con 0x559241e2f470 2023-10-05T19:52:50.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.253+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 49 ==== osd_op_reply(186 foo [call,delete] v32'20 uv20 ondisk = 0) v8 ==== 189+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.259 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.257+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:187 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94086659227984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241f09080 con 0x559241e622d0 2023-10-05T19:52:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.257+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 54 ==== osd_op_reply(187 notify.0 [watch unwatch cookie 94086659227984] v32'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.257+0000 7efd64ed6e40 20 remove_watcher() i=0 2023-10-05T19:52:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.257+0000 7efd64ed6e40 2 removed watcher, disabling cache 2023-10-05T19:52:50.262 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.257+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:188 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94086659233728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6c150 con 0x559241e2f470 2023-10-05T19:52:50.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.257+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 50 ==== osd_op_reply(188 notify.1 [watch unwatch cookie 94086659233728] v32'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.257+0000 7efd64ed6e40 20 remove_watcher() i=1 2023-10-05T19:52:50.263 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.257+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:189 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94086659236016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6c150 con 0x559241e622d0 2023-10-05T19:52:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.261+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 55 ==== osd_op_reply(189 notify.2 [watch unwatch cookie 94086659236016] v32'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.261+0000 7efd64ed6e40 20 remove_watcher() i=2 2023-10-05T19:52:50.265 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.261+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:190 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94086659229376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6e0b0 con 0x7efd5c007030 2023-10-05T19:52:50.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.261+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 52 ==== osd_op_reply(190 notify.3 [watch unwatch cookie 94086659229376] v32'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.261+0000 7efd64ed6e40 20 remove_watcher() i=3 2023-10-05T19:52:50.267 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.261+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:191 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94086659238576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6c150 con 0x559241e622d0 2023-10-05T19:52:50.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.265+0000 7efd62a0b700 1 -- 172.21.15.167:0/4195626600 <== osd.0 v2:172.21.15.118:6800/26580 56 ==== osd_op_reply(191 notify.4 [watch unwatch cookie 94086659238576] v32'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd5c088060 con 0x559241e622d0 2023-10-05T19:52:50.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.265+0000 7efd64ed6e40 20 remove_watcher() i=4 2023-10-05T19:52:50.269 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.265+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:192 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94086659242576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6c6c0 con 0x559241e67010 2023-10-05T19:52:50.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.265+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 50 ==== osd_op_reply(192 notify.5 [watch unwatch cookie 94086659242576] v32'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.265+0000 7efd64ed6e40 20 remove_watcher() i=5 2023-10-05T19:52:50.271 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.265+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:193 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94086659239680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6eab0 con 0x559241e67010 2023-10-05T19:52:50.272 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.269+0000 7efd6220a700 1 -- 172.21.15.167:0/4195626600 <== osd.3 v2:172.21.15.167:6800/26773 51 ==== osd_op_reply(193 notify.6 [watch unwatch cookie 94086659239680] v32'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd4c01d040 con 0x559241e67010 2023-10-05T19:52:50.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.269+0000 7efd64ed6e40 20 remove_watcher() i=6 2023-10-05T19:52:50.273 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.269+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:194 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94086659249904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241e6c150 con 0x7efd5c007030 2023-10-05T19:52:50.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.269+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.2 v2:172.21.15.167:6816/26774 53 ==== osd_op_reply(194 notify.7 [watch unwatch cookie 94086659249904] v32'266 uv264 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efd54033040 con 0x7efd5c007030 2023-10-05T19:52:50.274 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.269+0000 7efd64ed6e40 20 remove_watcher() i=7 2023-10-05T19:52:50.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd337ee700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:50.276 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:195 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94086659252112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559241ebe9c0 con 0x559241e2f470 2023-10-05T19:52:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 <== osd.1 v2:172.21.15.167:6808/26775 51 ==== osd_op_reply(195 data_loggenerations_metadata [watch unwatch cookie 94086659252112] v32'256 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efd54033040 con 0x559241e2f470 2023-10-05T19:52:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e622d0 msgr2=0x559241e646b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e622d0 0x559241e646b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e2f470 msgr2=0x559241e60240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e2f470 0x559241e60240 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efd5c007030 msgr2=0x7efd5c026880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7efd5c007030 0x7efd5c026880 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e67010 msgr2=0x559241e69420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.279 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e67010 0x559241e69420 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd48030c50 msgr2=0x7efd48033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efd48030c50 0x7efd48033100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0016f0 tx=0x7efd4c0067f0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd6320c700 1 -- 172.21.15.167:0/4195626600 reap_dead start 2023-10-05T19:52:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 msgr2=0x559241e547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.281 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e547e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7efd5c008fd0 tx=0x7efd5c003050 comp rx=0 tx=0).stop 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 shutdown_connections 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/4195626600 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e2eb60 0x559241e547e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 >> 172.21.15.167:0/4195626600 conn(0x559241da25d0 msgr2=0x559241e48210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 shutdown_connections 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.273+0000 7efd64ed6e40 1 -- 172.21.15.167:0/4195626600 wait complete. 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e90460 msgr2=0x559241e92870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x559241e90460 0x559241e92870 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e9abd0 msgr2=0x559241e9cfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x559241e9abd0 0x559241e9cfe0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.282 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x559241e93be0 msgr2=0x559241e95fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x559241e93be0 0x559241e95fc0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e973c0 msgr2=0x559241e997d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x559241e973c0 0x559241e997d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efca8030bb0 msgr2=0x7efca8033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7efca8030bb0 0x7efca8033060 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x559241e75690 tx=0x7efd5400e040 comp rx=0 tx=0).stop 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 msgr2=0x559241e85840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e85840 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efd4c001330 tx=0x7efd4c036000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd62a0b700 1 -- 172.21.15.167:0/1068412053 reap_dead start 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 shutdown_connections 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 --2- 172.21.15.167:0/1068412053 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x559241e7fde0 0x559241e85840 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 >> 172.21.15.167:0/1068412053 conn(0x559241e7b1a0 msgr2=0x559241e79240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.283 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 shutdown_connections 2023-10-05T19:52:50.284 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.277+0000 7efd64ed6e40 1 -- 172.21.15.167:0/1068412053 wait complete. 2023-10-05T19:52:50.286 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-10-05T19:52:50.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-10-05T19:52:50.286 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-10-05T19:52:50.325 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:50.325 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:50.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff3951f9e40 1 Processor -- start 2023-10-05T19:52:50.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff3951f9e40 1 -- start start 2023-10-05T19:52:50.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff3951f9e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x562afe1ea490 0x562afe2796f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff3951f9e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562afe1c3bd0 con 0x562afe279c30 2023-10-05T19:52:50.326 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff3951f9e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x562afe180ee0 con 0x562afe1ea490 2023-10-05T19:52:50.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff392d2e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x562afe1ea490 0x562afe2796f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff392d2e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x562afe1ea490 0x562afe2796f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48068/0 (socket says 172.21.15.167:48068) 2023-10-05T19:52:50.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff39252d700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x562afe279c30 0x562afe27c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60380/0 (socket says 172.21.15.167:60380) 2023-10-05T19:52:50.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff392d2e700 1 -- 172.21.15.167:0/801265599 learned_addr learned my addr 172.21.15.167:0/801265599 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.327 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff392d2e700 1 -- 172.21.15.167:0/801265599 >> v1:172.21.15.118:6789/0 conn(0x562afe279c30 legacy=0x562afe27c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.328 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff392d2e700 1 -- 172.21.15.167:0/801265599 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562afe27e740 con 0x562afe1ea490 2023-10-05T19:52:50.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.321+0000 7ff392d2e700 1 --2- 172.21.15.167:0/801265599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 0x562afe2796f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00a5c0 tx=0x7ff38c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cb39ccb55305b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff391d2c700 1 -- 172.21.15.167:0/801265599 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38c00e510 con 0x562afe1ea490 2023-10-05T19:52:50.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff391d2c700 1 -- 172.21.15.167:0/801265599 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00e670 con 0x562afe1ea490 2023-10-05T19:52:50.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff391d2c700 1 -- 172.21.15.167:0/801265599 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38c00e920 con 0x562afe1ea490 2023-10-05T19:52:50.329 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 -- 172.21.15.167:0/801265599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 msgr2=0x562afe2796f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/801265599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 0x562afe2796f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00a5c0 tx=0x7ff38c005e00 comp rx=0 tx=0).stop 2023-10-05T19:52:50.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 -- 172.21.15.167:0/801265599 shutdown_connections 2023-10-05T19:52:50.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/801265599 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 0x562afe2796f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 -- 172.21.15.167:0/801265599 >> 172.21.15.167:0/801265599 conn(0x562afe271240 msgr2=0x562afe273650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 -- 172.21.15.167:0/801265599 shutdown_connections 2023-10-05T19:52:50.330 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 -- 172.21.15.167:0/801265599 wait complete. 2023-10-05T19:52:50.332 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 Processor -- start 2023-10-05T19:52:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 -- start start 2023-10-05T19:52:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 0x562afe276c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff3951f9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562afe144e30 con 0x562afe1ea490 2023-10-05T19:52:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff392d2e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 0x562afe276c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff392d2e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 0x562afe276c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48070/0 (socket says 172.21.15.167:48070) 2023-10-05T19:52:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff392d2e700 1 -- 172.21.15.167:0/2734438412 learned_addr learned my addr 172.21.15.167:0/2734438412 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff392d2e700 1 -- 172.21.15.167:0/2734438412 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c00a180 con 0x562afe1ea490 2023-10-05T19:52:50.333 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff392d2e700 1 --2- 172.21.15.167:0/2734438412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 0x562afe276c70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x562afe1ea930 tx=0x7ff38c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad508d0851b1132 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff390d2a700 1 -- 172.21.15.167:0/2734438412 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38c0032f0 con 0x562afe1ea490 2023-10-05T19:52:50.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff390d2a700 1 -- 172.21.15.167:0/2734438412 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00e7e0 con 0x562afe1ea490 2023-10-05T19:52:50.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.325+0000 7ff390d2a700 1 -- 172.21.15.167:0/2734438412 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38c00ead0 con 0x562afe1ea490 2023-10-05T19:52:50.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 -- 172.21.15.167:0/2734438412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 msgr2=0x562afe276c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/2734438412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 0x562afe276c70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x562afe1ea930 tx=0x7ff38c013000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 -- 172.21.15.167:0/2734438412 shutdown_connections 2023-10-05T19:52:50.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/2734438412 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe1ea490 0x562afe276c70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 -- 172.21.15.167:0/2734438412 >> 172.21.15.167:0/2734438412 conn(0x562afe271240 msgr2=0x562afe291590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.334 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 -- 172.21.15.167:0/2734438412 shutdown_connections 2023-10-05T19:52:50.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 -- 172.21.15.167:0/2734438412 wait complete. 2023-10-05T19:52:50.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 Processor -- start 2023-10-05T19:52:50.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 -- start start 2023-10-05T19:52:50.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe279c30 0x562afe29e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.335 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562afe117ed0 con 0x562afe279c30 2023-10-05T19:52:50.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff392d2e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe279c30 0x562afe29e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.336 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff392d2e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe279c30 0x562afe29e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48084/0 (socket says 172.21.15.167:48084) 2023-10-05T19:52:50.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 learned_addr learned my addr 172.21.15.167:0/3743623426 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562afe27e740 con 0x562afe279c30 2023-10-05T19:52:50.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff392d2e700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe279c30 0x562afe29e970 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff38c01e040 tx=0x7ff38c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff382ffd700 1 -- 172.21.15.167:0/3743623426 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38c01cb50 con 0x562afe279c30 2023-10-05T19:52:50.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff382ffd700 1 -- 172.21.15.167:0/3743623426 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c01ccb0 con 0x562afe279c30 2023-10-05T19:52:50.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562afe29eeb0 con 0x562afe279c30 2023-10-05T19:52:50.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff382ffd700 1 -- 172.21.15.167:0/3743623426 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38c010440 con 0x562afe279c30 2023-10-05T19:52:50.337 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.329+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562afe29f2f0 con 0x562afe279c30 2023-10-05T19:52:50.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff382ffd700 1 -- 172.21.15.167:0/3743623426 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff38c0105a0 con 0x562afe279c30 2023-10-05T19:52:50.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff382ffd700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff378030c50 0x7ff378033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.339 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff382ffd700 1 -- 172.21.15.167:0/3743623426 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7ff38c046500 con 0x562afe279c30 2023-10-05T19:52:50.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff39252d700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff378030c50 0x7ff378033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562afe2a83f0 0x562afe2aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2aae80 con 0x562afe2a83f0 2023-10-05T19:52:50.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff39352f700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562afe2a83f0 0x562afe2aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff39252d700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff378030c50 0x7ff378033100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff388001e70 tx=0x7ff388001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.340 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff39352f700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562afe2a83f0 0x562afe2aa7d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff38400a500 con 0x562afe2a83f0 2023-10-05T19:52:50.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.333+0000 7ff3951f9e40 20 realm 2023-10-05T19:52:50.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2a7a60 con 0x562afe2a83f0 2023-10-05T19:52:50.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff38400a500 con 0x562afe2a83f0 2023-10-05T19:52:50.344 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:50.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2ab960 con 0x562afe2a83f0 2023-10-05T19:52:50.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff38400a500 con 0x562afe2a83f0 2023-10-05T19:52:50.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562afe2ab590 0x562afe2ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.345 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2aef00 con 0x562afe2ab590 2023-10-05T19:52:50.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff392d2e700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562afe2ab590 0x562afe2ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff392d2e700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562afe2ab590 0x562afe2ae7d0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2af7d0 con 0x562afe2a83f0 2023-10-05T19:52:50.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff38400a500 con 0x562afe2a83f0 2023-10-05T19:52:50.346 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 20 searching for the correct realm 2023-10-05T19:52:50.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562afe2af340 0x562afe2b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.337+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2af340 2023-10-05T19:52:50.347 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39252d700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562afe2af340 0x562afe2b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39252d700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562afe2af340 0x562afe2b35a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2ab590 2023-10-05T19:52:50.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff392d2e700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff38c037020 0x7ff38c025400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.350 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x7ff38c037020 2023-10-05T19:52:50.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39352f700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff38c037020 0x7ff38c025400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39352f700 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff38c037020 0x7ff38c025400 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x7ff38c037020 2023-10-05T19:52:50.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.351 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.341+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2af340 2023-10-05T19:52:50.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2ab590 2023-10-05T19:52:50.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2ab590 2023-10-05T19:52:50.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.352 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x7ff38c037020 2023-10-05T19:52:50.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x7ff38c037020 2023-10-05T19:52:50.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.354 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.345+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x7ff38c037020 2023-10-05T19:52:50.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x7ff38c037020 2023-10-05T19:52:50.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2ab590 2023-10-05T19:52:50.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2af340 2023-10-05T19:52:50.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.355 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.356 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2ab590 2023-10-05T19:52:50.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.357 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2af340 2023-10-05T19:52:50.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.349+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.358 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2af340 2023-10-05T19:52:50.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.359 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x7ff38c037020 2023-10-05T19:52:50.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x7ff38c037020 2023-10-05T19:52:50.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2a83f0 2023-10-05T19:52:50.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.360 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x7ff38c037020 2023-10-05T19:52:50.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x7ff38c037020 2023-10-05T19:52:50.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2af340 2023-10-05T19:52:50.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.353+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x7ff38c037020 2023-10-05T19:52:50.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x7ff38c037020 2023-10-05T19:52:50.361 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2ab590 2023-10-05T19:52:50.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2ab590 2023-10-05T19:52:50.362 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2af340 2023-10-05T19:52:50.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2ab590 2023-10-05T19:52:50.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.363 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.357+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b3b80 con 0x562afe2ab590 2023-10-05T19:52:50.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:50.364 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:50.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:50.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:50.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b0340 con 0x562afe2a83f0 2023-10-05T19:52:50.365 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b0cc0 con 0x562afe2ab590 2023-10-05T19:52:50.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.366 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.367 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2aff30 con 0x562afe2ab590 2023-10-05T19:52:50.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:50.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.370 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.361+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b4530 con 0x562afe2af340 2023-10-05T19:52:50.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.371 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b4c90 con 0x562afe2ab590 2023-10-05T19:52:50.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff3951f9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b6050 con 0x562afe2af340 2023-10-05T19:52:50.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.372 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b6050 con 0x562afe2ab590 2023-10-05T19:52:50.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.373 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b6050 con 0x7ff38c037020 2023-10-05T19:52:50.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x7ff38c037020 2023-10-05T19:52:50.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.365+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2af340 2023-10-05T19:52:50.374 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.375 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2ab590 2023-10-05T19:52:50.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2ab590 2023-10-05T19:52:50.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.376 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.369+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x7ff38c037020 2023-10-05T19:52:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x7ff38c037020 2023-10-05T19:52:50.377 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x7ff38c037020 2023-10-05T19:52:50.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x7ff38c037020 2023-10-05T19:52:50.378 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2ab590 2023-10-05T19:52:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2af340 2023-10-05T19:52:50.379 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.373+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.380 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2ab590 2023-10-05T19:52:50.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2af340 2023-10-05T19:52:50.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.381 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384014040 con 0x562afe2a83f0 2023-10-05T19:52:50.382 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.383 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.377+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2af340 2023-10-05T19:52:50.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.384 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x7ff38c037020 2023-10-05T19:52:50.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2a83f0 2023-10-05T19:52:50.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.385 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x7ff38c037020 2023-10-05T19:52:50.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2af340 2023-10-05T19:52:50.386 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x7ff38c037020 2023-10-05T19:52:50.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.387 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.381+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2ab590 2023-10-05T19:52:50.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.388 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2ab590 2023-10-05T19:52:50.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2af340 2023-10-05T19:52:50.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.389 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2ab590 2023-10-05T19:52:50.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.390 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b48e0 con 0x562afe2ab590 2023-10-05T19:52:50.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff3951f9e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:50.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff3951f9e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:50.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff3951f9e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:50.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff3951f9e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:50.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.391 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.385+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b5040 con 0x562afe2ab590 2023-10-05T19:52:50.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.392 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b53f0 con 0x562afe2a83f0 2023-10-05T19:52:50.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.393 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b4130 con 0x562afe2ab590 2023-10-05T19:52:50.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.394 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b5ce0 con 0x562afe2ab590 2023-10-05T19:52:50.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:50.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.395 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b5ce0 con 0x7ff38c037020 2023-10-05T19:52:50.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.389+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 zone default found 2023-10-05T19:52:50.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 4 Realm: () 2023-10-05T19:52:50.396 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:50.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:50.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:50.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 zonegroup default 2023-10-05T19:52:50.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b5ce0 con 0x7ff38c037020 2023-10-05T19:52:50.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.397 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b7660 con 0x562afe2af340 2023-10-05T19:52:50.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.398 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b7a10 con 0x562afe2af340 2023-10-05T19:52:50.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 started sync module instance, tier type = 2023-10-05T19:52:50.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:50.399 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.393+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b6d20 con 0x562afe2ab590 2023-10-05T19:52:50.400 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.397+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.397+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94742652868512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b7dc0 con 0x562afe2ab590 2023-10-05T19:52:50.401 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.397+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b8660 con 0x562afe2a83f0 2023-10-05T19:52:50.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.397+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94742652868512] v32'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.397+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.403 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.397+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94742652874304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b82b0 con 0x562afe2a83f0 2023-10-05T19:52:50.404 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.397+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b8cc0 con 0x562afe2ab590 2023-10-05T19:52:50.405 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.401+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94742652874304] v32'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.401+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.401+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94742652881136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b82b0 con 0x562afe2ab590 2023-10-05T19:52:50.406 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.401+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b95b0 con 0x7ff38c037020 2023-10-05T19:52:50.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.405+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.408 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.405+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94742652881136] v32'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.405+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94742652883136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b9a00 con 0x7ff38c037020 2023-10-05T19:52:50.409 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.405+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2ba2a0 con 0x562afe2ab590 2023-10-05T19:52:50.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.405+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94742652883136] v32'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.405+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.405+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94742652884240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2b9e50 con 0x562afe2ab590 2023-10-05T19:52:50.411 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.405+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2ba860 con 0x562afe2af340 2023-10-05T19:52:50.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.409+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.409+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94742652887920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2bb100 con 0x562afe2af340 2023-10-05T19:52:50.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.409+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94742652884240] v32'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.413 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.409+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2bbb10 con 0x562afe2af340 2023-10-05T19:52:50.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.409+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94742652887920] v32'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.409+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.414 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.409+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94742652892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2bbec0 con 0x562afe2af340 2023-10-05T19:52:50.415 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.409+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2bc760 con 0x7ff38c037020 2023-10-05T19:52:50.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94742652892704] v32'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'267 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94742652894912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2bc800 con 0x7ff38c037020 2023-10-05T19:52:50.416 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 20 add_watcher() i=0 2023-10-05T19:52:50.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 20 add_watcher() i=1 2023-10-05T19:52:50.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 20 add_watcher() i=2 2023-10-05T19:52:50.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 20 add_watcher() i=3 2023-10-05T19:52:50.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 20 add_watcher() i=4 2023-10-05T19:52:50.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 20 add_watcher() i=5 2023-10-05T19:52:50.417 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 20 add_watcher() i=6 2023-10-05T19:52:50.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94742652894912] v32'268 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 20 add_watcher() i=7 2023-10-05T19:52:50.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:50.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2bf8a0 con 0x562afe2a83f0 2023-10-05T19:52:50.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.418 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.413+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94742652896016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe2bcc50 con 0x562afe2a83f0 2023-10-05T19:52:50.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94742652896016] v32'257 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff363fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:50.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:50.420 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:50.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 Processor -- start 2023-10-05T19:52:50.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 -- start start 2023-10-05T19:52:50.421 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562afe2ca720 con 0x562afe2c9e10 2023-10-05T19:52:50.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff39252d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff39252d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48086/0 (socket says 172.21.15.167:48086) 2023-10-05T19:52:50.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff39252d700 1 -- 172.21.15.167:0/3630035224 learned_addr learned my addr 172.21.15.167:0/3630035224 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.422 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff39252d700 1 -- 172.21.15.167:0/3630035224 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562afe2ca860 con 0x562afe2c9e10 2023-10-05T19:52:50.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff39252d700 1 --2- 172.21.15.167:0/3630035224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2ca1e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x562afe2afe80 tx=0x7ff388006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84d3abceb650f95 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3637e6700 1 -- 172.21.15.167:0/3630035224 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38802e740 con 0x562afe2c9e10 2023-10-05T19:52:50.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3637e6700 1 -- 172.21.15.167:0/3630035224 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff388024040 con 0x562afe2c9e10 2023-10-05T19:52:50.423 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3637e6700 1 -- 172.21.15.167:0/3630035224 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38802e8e0 con 0x562afe2c9e10 2023-10-05T19:52:50.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3630035224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 msgr2=0x562afe2ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3630035224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2ca1e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x562afe2afe80 tx=0x7ff388006000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3630035224 shutdown_connections 2023-10-05T19:52:50.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3630035224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2ca1e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3630035224 >> 172.21.15.167:0/3630035224 conn(0x562afe2c51d0 msgr2=0x562afe2c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.424 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.417+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3630035224 shutdown_connections 2023-10-05T19:52:50.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3630035224 wait complete. 2023-10-05T19:52:50.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff3951f9e40 1 Processor -- start 2023-10-05T19:52:50.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff3951f9e40 1 -- start start 2023-10-05T19:52:50.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff3951f9e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.425 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff3951f9e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x562afe2d0970 con 0x562afe2c9e10 2023-10-05T19:52:50.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff39252d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff39252d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48088/0 (socket says 172.21.15.167:48088) 2023-10-05T19:52:50.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff39252d700 1 -- 172.21.15.167:0/3008717292 learned_addr learned my addr 172.21.15.167:0/3008717292 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff39252d700 1 -- 172.21.15.167:0/3008717292 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388006070 con 0x562afe2c9e10 2023-10-05T19:52:50.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff39252d700 1 --2- 172.21.15.167:0/3008717292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2cf970 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x562afe2c3ef0 tx=0x7ff388037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff361fe3700 1 -- 172.21.15.167:0/3008717292 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38803a590 con 0x562afe2c9e10 2023-10-05T19:52:50.426 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3008717292 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562afe2cff70 con 0x562afe2c9e10 2023-10-05T19:52:50.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff361fe3700 1 -- 172.21.15.167:0/3008717292 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38803a710 con 0x562afe2c9e10 2023-10-05T19:52:50.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff361fe3700 1 -- 172.21.15.167:0/3008717292 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff38803a8c0 con 0x562afe2c9e10 2023-10-05T19:52:50.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3008717292 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562afe2d03b0 con 0x562afe2c9e10 2023-10-05T19:52:50.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff361fe3700 1 -- 172.21.15.167:0/3008717292 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7ff388040050 con 0x562afe2c9e10 2023-10-05T19:52:50.427 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff361fe3700 1 --2- 172.21.15.167:0/3008717292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2d8030c00 0x7ff2d80330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff361fe3700 1 -- 172.21.15.167:0/3008717292 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7ff388044d00 con 0x562afe2c9e10 2023-10-05T19:52:50.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff39352f700 1 --2- 172.21.15.167:0/3008717292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2d8030c00 0x7ff2d80330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.421+0000 7ff3951f9e40 5 note: GC not initialized 2023-10-05T19:52:50.428 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff39352f700 1 --2- 172.21.15.167:0/3008717292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2d8030c00 0x7ff2d80330b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x562afe2bfa10 tx=0x7ff38400e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff2d2ffd700 20 reqs_thread_entry: start 2023-10-05T19:52:50.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff3951f9e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:50.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff2d0ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:50.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff3951f9e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:50.430 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff2c2ffd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:53:20 2023 2023-10-05T19:52:50.431 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:50.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff2c27fc700 20 reqs_thread_entry: start 2023-10-05T19:52:50.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff3951f9e40 20 get_system_obj_state: rctx=0x7ffc16603538 obj=default.rgw.meta:users.uid:foo state=0x562afe1500b0 s->prefetch_data=0 2023-10-05T19:52:50.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x562afe2a83f0 2023-10-05T19:52:50.431 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 foo [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.431 INFO:teuthology.orchestra.run.smithi167.stderr:could not fetch user info: no user info saved 2023-10-05T19:52:50.432 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.425+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:103 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94742652868512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x562afe2ab590 2023-10-05T19:52:50.433 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.429+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== osd_op_reply(103 notify.0 [watch unwatch cookie 94742652868512] v32'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.429+0000 7ff3951f9e40 20 remove_watcher() i=0 2023-10-05T19:52:50.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.429+0000 7ff3951f9e40 2 removed watcher, disabling cache 2023-10-05T19:52:50.434 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.429+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94742652874304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x562afe2a83f0 2023-10-05T19:52:50.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.429+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(104 notify.1 [watch unwatch cookie 94742652874304] v32'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.429+0000 7ff3951f9e40 20 remove_watcher() i=1 2023-10-05T19:52:50.435 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.429+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94742652881136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x562afe2ab590 2023-10-05T19:52:50.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.433+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.2 [watch unwatch cookie 94742652881136] v32'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.433+0000 7ff3951f9e40 20 remove_watcher() i=2 2023-10-05T19:52:50.437 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.433+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:106 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94742652883136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x7ff38c037020 2023-10-05T19:52:50.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.433+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(106 notify.3 [watch unwatch cookie 94742652883136] v32'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.439 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.433+0000 7ff3951f9e40 20 remove_watcher() i=3 2023-10-05T19:52:50.440 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.433+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:107 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94742652884240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x562afe2ab590 2023-10-05T19:52:50.441 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.437+0000 7ff392d2e700 1 -- 172.21.15.167:0/3743623426 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(107 notify.4 [watch unwatch cookie 94742652884240] v32'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38c02b070 con 0x562afe2ab590 2023-10-05T19:52:50.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.437+0000 7ff3951f9e40 20 remove_watcher() i=4 2023-10-05T19:52:50.442 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.437+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:108 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94742652887920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x562afe2af340 2023-10-05T19:52:50.443 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.437+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(108 notify.5 [watch unwatch cookie 94742652887920] v32'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.441+0000 7ff3951f9e40 20 remove_watcher() i=5 2023-10-05T19:52:50.444 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.441+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:109 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94742652892704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x562afe2af340 2023-10-05T19:52:50.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.441+0000 7ff39252d700 1 -- 172.21.15.167:0/3743623426 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(109 notify.6 [watch unwatch cookie 94742652892704] v32'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff38800f560 con 0x562afe2af340 2023-10-05T19:52:50.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.441+0000 7ff3951f9e40 20 remove_watcher() i=6 2023-10-05T19:52:50.445 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.441+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:110 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94742652894912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x7ff38c037020 2023-10-05T19:52:50.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.441+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(110 notify.7 [watch unwatch cookie 94742652894912] v32'269 uv267 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff384033040 con 0x7ff38c037020 2023-10-05T19:52:50.447 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.441+0000 7ff3951f9e40 20 remove_watcher() i=7 2023-10-05T19:52:50.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff363fe7700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:50.448 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94742652896016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x562afe3381c0 con 0x562afe2a83f0 2023-10-05T19:52:50.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(111 data_loggenerations_metadata [watch unwatch cookie 94742652896016] v32'258 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff384033040 con 0x562afe2a83f0 2023-10-05T19:52:50.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562afe2ab590 msgr2=0x562afe2ae7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x562afe2ab590 0x562afe2ae7d0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562afe2a83f0 msgr2=0x562afe2aa7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.451 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x562afe2a83f0 0x562afe2aa7d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff38c037020 msgr2=0x7ff38c025400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7ff38c037020 0x7ff38c025400 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562afe2af340 msgr2=0x562afe2b35a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x562afe2af340 0x562afe2b35a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff378030c50 msgr2=0x7ff378033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff378030c50 0x7ff378033100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff388001e70 tx=0x7ff388001390 comp rx=0 tx=0).stop 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff39352f700 1 -- 172.21.15.167:0/3743623426 reap_dead start 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe279c30 msgr2=0x562afe29e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe279c30 0x562afe29e970 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff38c01e040 tx=0x7ff38c01c000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 shutdown_connections 2023-10-05T19:52:50.452 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3743623426 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe279c30 0x562afe29e970 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 >> 172.21.15.167:0/3743623426 conn(0x562afe271240 msgr2=0x562afe290010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 shutdown_connections 2023-10-05T19:52:50.453 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.445+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3743623426 wait complete. 2023-10-05T19:52:50.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3008717292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2d8030c00 msgr2=0x7ff2d80330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3008717292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2d8030c00 0x7ff2d80330b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x562afe2bfa10 tx=0x7ff38400e040 comp rx=0 tx=0).stop 2023-10-05T19:52:50.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3008717292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 msgr2=0x562afe2cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3008717292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2cf970 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x562afe2c3ef0 tx=0x7ff388037000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3008717292 shutdown_connections 2023-10-05T19:52:50.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3008717292 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7ff2d8030c00 0x7ff2d80330b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 --2- 172.21.15.167:0/3008717292 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562afe2c9e10 0x562afe2cf970 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.454 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3008717292 >> 172.21.15.167:0/3008717292 conn(0x562afe2c51d0 msgr2=0x562afe2c32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3008717292 shutdown_connections 2023-10-05T19:52:50.455 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.449+0000 7ff3951f9e40 1 -- 172.21.15.167:0/3008717292 wait complete. 2023-10-05T19:52:50.457 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-05T19:52:50.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2023-10-05T19:52:50.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2023-10-05T19:52:50.458 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2023-10-05T19:52:50.497 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:50.497 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:50.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc5b37e40 1 Processor -- start 2023-10-05T19:52:50.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc5b37e40 1 -- start start 2023-10-05T19:52:50.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc5b37e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x558c367fa570 0x558c367f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc5b37e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558c367d1bd0 con 0x558c367f9090 2023-10-05T19:52:50.498 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc5b37e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x558c3678eee0 con 0x558c367fa570 2023-10-05T19:52:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc366c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x558c367fa570 0x558c367f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc2e6b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x558c367f9090 0x558c368912d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60394/0 (socket says 172.21.15.167:60394) 2023-10-05T19:52:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1888933943 learned_addr learned my addr 172.21.15.167:0/1888933943 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc366c700 1 -- 172.21.15.167:0/1888933943 >> v1:172.21.15.118:6789/0 conn(0x558c367f9090 legacy=0x558c368912d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc266a700 1 -- 172.21.15.167:0/1888933943 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458460150 0 0) 0x558c367d1bd0 con 0x558c367f9090 2023-10-05T19:52:50.499 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.493+0000 7f8fc366c700 1 -- 172.21.15.167:0/1888933943 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c367faa00 con 0x558c367fa570 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc366c700 1 --2- 172.21.15.167:0/1888933943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367fa570 0x558c367f8b50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400a520 tx=0x7f8fb4005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fd094cd6ea833f server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc266a700 1 -- 172.21.15.167:0/1888933943 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fb400f590 con 0x558c367fa570 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc266a700 1 -- 172.21.15.167:0/1888933943 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb400f6f0 con 0x558c367fa570 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc266a700 1 -- 172.21.15.167:0/1888933943 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fb400f880 con 0x558c367fa570 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1888933943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367fa570 msgr2=0x558c367f8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1888933943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367fa570 0x558c367f8b50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400a520 tx=0x7f8fb4005d40 comp rx=0 tx=0).stop 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1888933943 shutdown_connections 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1888933943 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367fa570 0x558c367f8b50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1888933943 >> 172.21.15.167:0/1888933943 conn(0x558c368803e0 msgr2=0x558c368827f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.501 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1888933943 shutdown_connections 2023-10-05T19:52:50.502 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1888933943 wait complete. 2023-10-05T19:52:50.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 Processor -- start 2023-10-05T19:52:50.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 -- start start 2023-10-05T19:52:50.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc5b37e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c36752e30 con 0x558c367f9090 2023-10-05T19:52:50.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc366c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc366c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48118/0 (socket says 172.21.15.167:48118) 2023-10-05T19:52:50.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc366c700 1 -- 172.21.15.167:0/2778824482 learned_addr learned my addr 172.21.15.167:0/2778824482 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.503 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc366c700 1 -- 172.21.15.167:0/2778824482 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb400a0e0 con 0x558c367f9090 2023-10-05T19:52:50.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.497+0000 7f8fc366c700 1 --2- 172.21.15.167:0/2778824482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368a9eb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400a470 tx=0x7f8fb4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4665ebb5811551c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc1668700 1 -- 172.21.15.167:0/2778824482 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fb400f860 con 0x558c367f9090 2023-10-05T19:52:50.504 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc1668700 1 -- 172.21.15.167:0/2778824482 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb400f9e0 con 0x558c367f9090 2023-10-05T19:52:50.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc1668700 1 -- 172.21.15.167:0/2778824482 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fb400fb90 con 0x558c367f9090 2023-10-05T19:52:50.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2778824482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 msgr2=0x558c368a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/2778824482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368a9eb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400a470 tx=0x7f8fb4014000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2778824482 shutdown_connections 2023-10-05T19:52:50.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/2778824482 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368a9eb0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2778824482 >> 172.21.15.167:0/2778824482 conn(0x558c368803e0 msgr2=0x558c368a5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2778824482 shutdown_connections 2023-10-05T19:52:50.505 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2778824482 wait complete. 2023-10-05T19:52:50.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 Processor -- start 2023-10-05T19:52:50.506 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 -- start start 2023-10-05T19:52:50.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c36725ed0 con 0x558c367f9090 2023-10-05T19:52:50.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc366c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc366c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48128/0 (socket says 172.21.15.167:48128) 2023-10-05T19:52:50.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 learned_addr learned my addr 172.21.15.167:0/1671258427 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c367faa00 con 0x558c367f9090 2023-10-05T19:52:50.507 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc366c700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368b0b10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400a470 tx=0x7f8fb401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fbb7fe700 1 -- 172.21.15.167:0/1671258427 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fb401ce00 con 0x558c367f9090 2023-10-05T19:52:50.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558c368b1050 con 0x558c367f9090 2023-10-05T19:52:50.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fbb7fe700 1 -- 172.21.15.167:0/1671258427 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4010630 con 0x558c367f9090 2023-10-05T19:52:50.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fbb7fe700 1 -- 172.21.15.167:0/1671258427 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fb4010820 con 0x558c367f9090 2023-10-05T19:52:50.508 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.501+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c368b1490 con 0x558c367f9090 2023-10-05T19:52:50.509 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 Processor -- start 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fbb7fe700 1 -- 172.21.15.167:0/1671258427 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f8fb4010980 con 0x558c367f9090 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 -- start start 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c368c2af0 con 0x558c368c21e0 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fbb7fe700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8fa4030c50 0x7f8fa4033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc3e6d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc3e6d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48138/0 (socket says 172.21.15.167:48138) 2023-10-05T19:52:50.510 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1262229764 learned_addr learned my addr 172.21.15.167:0/1262229764 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fbb7fe700 1 -- 172.21.15.167:0/1671258427 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f8fb402b070 con 0x558c367f9090 2023-10-05T19:52:50.511 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc366c700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8fa4030c50 0x7f8fa4033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1262229764 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c368c2c30 con 0x558c368c21e0 2023-10-05T19:52:50.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc3e6d700 1 --2- 172.21.15.167:0/1262229764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c25b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00a320 tx=0x7f8fbc0059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d3b5b8ed31e746 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc366c700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8fa4030c50 0x7f8fa4033100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4039f60 tx=0x7f8fb4039e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8f94fe1700 1 -- 172.21.15.167:0/1262229764 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fbc00ae30 con 0x558c368c21e0 2023-10-05T19:52:50.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8f94fe1700 1 -- 172.21.15.167:0/1262229764 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc00c610 con 0x558c368c21e0 2023-10-05T19:52:50.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8f94fe1700 1 -- 172.21.15.167:0/1262229764 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fbc00c7c0 con 0x558c368c21e0 2023-10-05T19:52:50.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1262229764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 msgr2=0x558c368c25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1262229764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c25b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00a320 tx=0x7f8fbc0059d0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.513 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1262229764 shutdown_connections 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1262229764 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c25b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1262229764 >> 172.21.15.167:0/1262229764 conn(0x558c367fa570 msgr2=0x558c368bef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1262229764 shutdown_connections 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.505+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1262229764 wait complete. 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc5b37e40 1 Processor -- start 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc5b37e40 1 -- start start 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc5b37e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc5b37e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c368ca360 con 0x558c368c21e0 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc3e6d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.514 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc3e6d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48140/0 (socket says 172.21.15.167:48140) 2023-10-05T19:52:50.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/2099699615 learned_addr learned my addr 172.21.15.167:0/2099699615 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.515 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/2099699615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc005c90 con 0x558c368c21e0 2023-10-05T19:52:50.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc3e6d700 1 --2- 172.21.15.167:0/2099699615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c9360 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00aa70 tx=0x7f8fbc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8f56ffd700 1 -- 172.21.15.167:0/2099699615 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fbc015660 con 0x558c368c21e0 2023-10-05T19:52:50.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8f56ffd700 1 -- 172.21.15.167:0/2099699615 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc0157c0 con 0x558c368c21e0 2023-10-05T19:52:50.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2099699615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558c368c9960 con 0x558c368c21e0 2023-10-05T19:52:50.516 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8f56ffd700 1 -- 172.21.15.167:0/2099699615 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8fbc015a70 con 0x558c368c21e0 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2099699615 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c368c9e20 con 0x558c368c21e0 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.509+0000 7f8f56ffd700 1 -- 172.21.15.167:0/2099699615 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f8fbc007050 con 0x558c368c21e0 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8f56ffd700 1 --2- 172.21.15.167:0/2099699615 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8f08030c50 0x7f8f08033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name=default 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8f56ffd700 1 -- 172.21.15.167:0/2099699615 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f8fbc0440e0 con 0x558c368c21e0 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558c368e7060 0x558c368e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c368fa5a0 con 0x558c368e7060 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc2e6b700 1 --2- 172.21.15.167:0/2099699615 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8f08030c50 0x7f8f08033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.517 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8f54ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:50.518 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc3e6d700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558c368e7060 0x558c368e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc3e6d700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558c368e7060 0x558c368e7500 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc2e6b700 1 --2- 172.21.15.167:0/2099699615 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8f08030c50 0x7f8f08033100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0011e0 tx=0x7f8fac001350 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558c368fae60 0x558c368fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c368fd780 con 0x558c368fae60 2023-10-05T19:52:50.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc366c700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558c368fae60 0x558c368fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.519 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc366c700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558c368fae60 0x558c368fd240 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(2 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.520 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558c368ff050 0x558c36901430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.513+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368ff050 2023-10-05T19:52:50.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc2e6b700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558c368ff050 0x558c36901430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.521 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc2e6b700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558c368ff050 0x558c36901430 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fac006070 con 0x558c368ff050 2023-10-05T19:52:50.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368e7060 2023-10-05T19:52:50.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(4 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc3e6d700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8fbc021020 0x7f8fbc0410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:5 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x7f8fbc021020 2023-10-05T19:52:50.522 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc3e6d700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8fbc021020 0x7f8fbc0410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc3e6d700 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8fbc021020 0x7f8fbc0410c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x7f8fbc021020 2023-10-05T19:52:50.523 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:6 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.517+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:7 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:8 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368ff050 2023-10-05T19:52:50.524 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fac006070 con 0x558c368ff050 2023-10-05T19:52:50.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.525 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368e7060 2023-10-05T19:52:50.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368e7060 2023-10-05T19:52:50.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.526 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:13 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x7f8fbc021020 2023-10-05T19:52:50.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x7f8fbc021020 2023-10-05T19:52:50.527 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.521+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:15 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x7f8fbc021020 2023-10-05T19:52:50.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x7f8fbc021020 2023-10-05T19:52:50.528 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368e7060 2023-10-05T19:52:50.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.529 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:17 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368ff050 2023-10-05T19:52:50.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fac006070 con 0x558c368ff050 2023-10-05T19:52:50.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:18 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.530 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.525+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368e7060 2023-10-05T19:52:50.531 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368ff050 2023-10-05T19:52:50.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fac006070 con 0x558c368ff050 2023-10-05T19:52:50.532 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:22 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.533 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:23 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.534 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:24 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368ff050 2023-10-05T19:52:50.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fac006070 con 0x558c368ff050 2023-10-05T19:52:50.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:25 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x7f8fbc021020 2023-10-05T19:52:50.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x7f8fbc021020 2023-10-05T19:52:50.535 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.529+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368fae60 2023-10-05T19:52:50.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:27 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x7f8fbc021020 2023-10-05T19:52:50.536 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x7f8fbc021020 2023-10-05T19:52:50.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:28 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368ff050 2023-10-05T19:52:50.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fac006070 con 0x558c368ff050 2023-10-05T19:52:50.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:29 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x7f8fbc021020 2023-10-05T19:52:50.537 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x7f8fbc021020 2023-10-05T19:52:50.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368e7060 2023-10-05T19:52:50.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.538 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:31 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368e7060 2023-10-05T19:52:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.533+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:32 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368ff050 2023-10-05T19:52:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fac006070 con 0x558c368ff050 2023-10-05T19:52:50.539 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc2e6b700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368e7060 2023-10-05T19:52:50.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.540 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c36901970 con 0x558c368e7060 2023-10-05T19:52:50.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8fbc029c60 con 0x558c368e7060 2023-10-05T19:52:50.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:50.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:50.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:50.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:50.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.541 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:35 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558c368fdb30 con 0x558c368fae60 2023-10-05T19:52:50.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc366c700 1 -- 172.21.15.167:0/1671258427 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(35 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8fb4024920 con 0x558c368fae60 2023-10-05T19:52:50.542 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558c368e7060 msgr2=0x558c368e7500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x558c368e7060 0x558c368e7500 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558c368fae60 msgr2=0x558c368fd240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x558c368fae60 0x558c368fd240 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8fbc021020 msgr2=0x7f8fbc0410c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f8fbc021020 0x7f8fbc0410c0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558c368ff050 msgr2=0x558c36901430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.537+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x558c368ff050 0x558c36901430 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8fa4030c50 msgr2=0x7f8fa4033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.544 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8fa4030c50 0x7f8fa4033100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4039f60 tx=0x7f8fb4039e30 comp rx=0 tx=0).stop 2023-10-05T19:52:50.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 msgr2=0x558c368b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc3e6d700 1 -- 172.21.15.167:0/1671258427 reap_dead start 2023-10-05T19:52:50.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368b0b10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400a470 tx=0x7f8fb401d000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 shutdown_connections 2023-10-05T19:52:50.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/1671258427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c367f9090 0x558c368b0b10 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.545 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 >> 172.21.15.167:0/1671258427 conn(0x558c368803e0 msgr2=0x558c368a44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 shutdown_connections 2023-10-05T19:52:50.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/1671258427 wait complete. 2023-10-05T19:52:50.546 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2099699615 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8f08030c50 msgr2=0x7f8f08033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/2099699615 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8f08030c50 0x7f8f08033100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0011e0 tx=0x7f8fac001350 comp rx=0 tx=0).stop 2023-10-05T19:52:50.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2099699615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 msgr2=0x558c368c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/2099699615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c9360 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00aa70 tx=0x7f8fbc013000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2099699615 shutdown_connections 2023-10-05T19:52:50.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/2099699615 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f8f08030c50 0x7f8f08033100 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 --2- 172.21.15.167:0/2099699615 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x558c368c21e0 0x558c368c9360 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2099699615 >> 172.21.15.167:0/2099699615 conn(0x558c367fa570 msgr2=0x558c368beb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2099699615 shutdown_connections 2023-10-05T19:52:50.547 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.541+0000 7f8fc5b37e40 1 -- 172.21.15.167:0/2099699615 wait complete. 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2", 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "default", 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "control_pool": "default.rgw.control", 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "log_pool": "default.rgw.log", 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T19:52:50.548 INFO:teuthology.orchestra.run.smithi167.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "system_key": { 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "", 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "" 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_pools": [ 2023-10-05T19:52:50.549 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "default-placement", 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: "val": { 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: "storage_classes": { 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: "STANDARD": { 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": 0, 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: "inline_data": "true" 2023-10-05T19:52:50.550 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.551 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.551 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:50.551 INFO:teuthology.orchestra.run.smithi167.stdout: "realm_id": "", 2023-10-05T19:52:50.551 INFO:teuthology.orchestra.run.smithi167.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T19:52:50.551 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:50.552 DEBUG:tasks.util.rgw: json result: {'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T19:52:50.552 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2023-10-05T19:52:50.552 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2023-10-05T19:52:50.552 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2023-10-05T19:52:50.586 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:50.586 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:50.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.581+0000 7f730c3d0e40 1 Processor -- start 2023-10-05T19:52:50.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.581+0000 7f730c3d0e40 1 -- start start 2023-10-05T19:52:50.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.581+0000 7f730c3d0e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55556f071aa0 0x55556f105a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.587 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.581+0000 7f730c3d0e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55556f049c00 con 0x55556f072db0 2023-10-05T19:52:50.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.581+0000 7f730c3d0e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55556f006ee0 con 0x55556f071aa0 2023-10-05T19:52:50.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7309f05700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55556f072db0 0x55556f071390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60404/0 (socket says 172.21.15.167:60404) 2023-10-05T19:52:50.588 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7309f05700 1 -- 172.21.15.167:0/3369483527 learned_addr learned my addr 172.21.15.167:0/3369483527 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:50.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7301704700 1 --2- 172.21.15.167:0/3369483527 >> v2:172.21.15.118:3300/0 conn(0x55556f071aa0 0x55556f105a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7309704700 1 -- 172.21.15.167:0/3369483527 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045653141 0 0) 0x55556f049c00 con 0x55556f072db0 2023-10-05T19:52:50.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7309704700 1 -- 172.21.15.167:0/3369483527 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f8001e10 con 0x55556f072db0 2023-10-05T19:52:50.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7301704700 1 -- 172.21.15.167:0/3369483527 >> v1:172.21.15.118:6789/0 conn(0x55556f072db0 legacy=0x55556f071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.589 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7301704700 1 -- 172.21.15.167:0/3369483527 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55556f073240 con 0x55556f071aa0 2023-10-05T19:52:50.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7301704700 1 --2- 172.21.15.167:0/3369483527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f105a40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f72f400a5d0 tx=0x7f72f4005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9168be7da1c3a979 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7309704700 1 -- 172.21.15.167:0/3369483527 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f4007610 con 0x55556f071aa0 2023-10-05T19:52:50.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7309704700 1 -- 172.21.15.167:0/3369483527 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4007770 con 0x55556f071aa0 2023-10-05T19:52:50.590 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f7309704700 1 -- 172.21.15.167:0/3369483527 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72f4007a20 con 0x55556f071aa0 2023-10-05T19:52:50.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3369483527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 msgr2=0x55556f105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/3369483527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f105a40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f72f400a5d0 tx=0x7f72f4005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:50.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3369483527 shutdown_connections 2023-10-05T19:52:50.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/3369483527 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f105a40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3369483527 >> 172.21.15.167:0/3369483527 conn(0x55556f0f8330 msgr2=0x55556f0fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3369483527 shutdown_connections 2023-10-05T19:52:50.591 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.585+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3369483527 wait complete. 2023-10-05T19:52:50.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f730c3d0e40 1 Processor -- start 2023-10-05T19:52:50.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f730c3d0e40 1 -- start start 2023-10-05T19:52:50.593 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f730c3d0e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f11d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f730c3d0e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55556efcae30 con 0x55556f071aa0 2023-10-05T19:52:50.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f7309f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f11d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f7309f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f11d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48170/0 (socket says 172.21.15.167:48170) 2023-10-05T19:52:50.594 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f7309f05700 1 -- 172.21.15.167:0/117109480 learned_addr learned my addr 172.21.15.167:0/117109480 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f7309f05700 1 -- 172.21.15.167:0/117109480 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4005cf0 con 0x55556f071aa0 2023-10-05T19:52:50.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f7309f05700 1 --2- 172.21.15.167:0/117109480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f11d990 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f72fc001c30 tx=0x7f72fc001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52bc1ea62e42660 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f7303fff700 1 -- 172.21.15.167:0/117109480 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc00bbf0 con 0x55556f071aa0 2023-10-05T19:52:50.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f7303fff700 1 -- 172.21.15.167:0/117109480 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc00bd50 con 0x55556f071aa0 2023-10-05T19:52:50.595 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.589+0000 7f7303fff700 1 -- 172.21.15.167:0/117109480 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc00e470 con 0x55556f071aa0 2023-10-05T19:52:50.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 -- 172.21.15.167:0/117109480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 msgr2=0x55556f11d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/117109480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f11d990 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f72fc001c30 tx=0x7f72fc001810 comp rx=0 tx=0).stop 2023-10-05T19:52:50.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 -- 172.21.15.167:0/117109480 shutdown_connections 2023-10-05T19:52:50.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/117109480 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f11d990 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 -- 172.21.15.167:0/117109480 >> 172.21.15.167:0/117109480 conn(0x55556f0f8330 msgr2=0x55556f119550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.596 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 -- 172.21.15.167:0/117109480 shutdown_connections 2023-10-05T19:52:50.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 -- 172.21.15.167:0/117109480 wait complete. 2023-10-05T19:52:50.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 Processor -- start 2023-10-05T19:52:50.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 -- start start 2023-10-05T19:52:50.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f124720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.597 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f730c3d0e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55556ef9ded0 con 0x55556f071aa0 2023-10-05T19:52:50.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f7309f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f124720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f7309f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f124720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48182/0 (socket says 172.21.15.167:48182) 2023-10-05T19:52:50.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 learned_addr learned my addr 172.21.15.167:0/2013850593 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.598 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8001e10 con 0x55556f071aa0 2023-10-05T19:52:50.599 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f7309f05700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f124720 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00b960 tx=0x7f72fc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.593+0000 7f73027fc700 1 -- 172.21.15.167:0/2013850593 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc01f070 con 0x55556f071aa0 2023-10-05T19:52:50.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f73027fc700 1 -- 172.21.15.167:0/2013850593 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc01a2e0 con 0x55556f071aa0 2023-10-05T19:52:50.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55556f124c60 con 0x55556f071aa0 2023-10-05T19:52:50.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f73027fc700 1 -- 172.21.15.167:0/2013850593 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc00e470 con 0x55556f071aa0 2023-10-05T19:52:50.600 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55556f1250a0 con 0x55556f071aa0 2023-10-05T19:52:50.601 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f73027fc700 1 -- 172.21.15.167:0/2013850593 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f72fc01aa10 con 0x55556f071aa0 2023-10-05T19:52:50.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f73027fc700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f72ec030c40 0x7f72ec0330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f73027fc700 1 -- 172.21.15.167:0/2013850593 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f72fc045280 con 0x55556f071aa0 2023-10-05T19:52:50.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f730c3d0e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:50.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f730c3d0e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:50.602 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f7301704700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f72ec030c40 0x7f72ec0330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f730c3d0e40 1 Processor -- start 2023-10-05T19:52:50.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f730c3d0e40 1 -- start start 2023-10-05T19:52:50.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f730c3d0e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f1360e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f730c3d0e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55556f136620 con 0x55556f135d10 2023-10-05T19:52:50.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f7301704700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f72ec030c40 0x7f72ec0330f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72f40030c0 tx=0x7f72f4014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f7309f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f1360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f7309f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f1360e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48196/0 (socket says 172.21.15.167:48196) 2023-10-05T19:52:50.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.597+0000 7f7309f05700 1 -- 172.21.15.167:0/2996098446 learned_addr learned my addr 172.21.15.167:0/2996098446 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.604 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f7309f05700 1 -- 172.21.15.167:0/2996098446 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55556f136760 con 0x55556f135d10 2023-10-05T19:52:50.605 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f7309f05700 1 --2- 172.21.15.167:0/2996098446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f1360e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f72fc02dfd0 tx=0x7f72fc043570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2489cb951303c78 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f72dafe5700 1 -- 172.21.15.167:0/2996098446 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc00bbf0 con 0x55556f135d10 2023-10-05T19:52:50.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f72dafe5700 1 -- 172.21.15.167:0/2996098446 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc031070 con 0x55556f135d10 2023-10-05T19:52:50.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f72dafe5700 1 -- 172.21.15.167:0/2996098446 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc003f50 con 0x55556f135d10 2023-10-05T19:52:50.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2996098446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 msgr2=0x55556f1360e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2996098446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f1360e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f72fc02dfd0 tx=0x7f72fc043570 comp rx=0 tx=0).stop 2023-10-05T19:52:50.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2996098446 shutdown_connections 2023-10-05T19:52:50.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2996098446 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f1360e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.606 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2996098446 >> 172.21.15.167:0/2996098446 conn(0x55556f072db0 msgr2=0x55556f132a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2996098446 shutdown_connections 2023-10-05T19:52:50.607 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2996098446 wait complete. 2023-10-05T19:52:50.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 Processor -- start 2023-10-05T19:52:50.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 -- start start 2023-10-05T19:52:50.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.608 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f730c3d0e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55556f13df50 con 0x55556f135d10 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f7309f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f7309f05700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f13cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48202/0 (socket says 172.21.15.167:48202) 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.601+0000 7f7309f05700 1 -- 172.21.15.167:0/3426196512 learned_addr learned my addr 172.21.15.167:0/3426196512 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f7309f05700 1 -- 172.21.15.167:0/3426196512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55556f1250a0 con 0x55556f135d10 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f7309f05700 1 --2- 172.21.15.167:0/3426196512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f13cf50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f72fc016fd0 tx=0x7f72fc038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f72d97e2700 1 -- 172.21.15.167:0/3426196512 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc0185d0 con 0x55556f135d10 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f72d97e2700 1 -- 172.21.15.167:0/3426196512 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc041040 con 0x55556f135d10 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f72d97e2700 1 -- 172.21.15.167:0/3426196512 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f72fc017c50 con 0x55556f135d10 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3426196512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55556f13d550 con 0x55556f135d10 2023-10-05T19:52:50.609 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3426196512 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55556f13da70 con 0x55556f135d10 2023-10-05T19:52:50.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f72d97e2700 1 -- 172.21.15.167:0/3426196512 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f72fc033070 con 0x55556f135d10 2023-10-05T19:52:50.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f72d97e2700 1 --2- 172.21.15.167:0/3426196512 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7258030c50 0x7f7258033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f72d97e2700 1 -- 172.21.15.167:0/3426196512 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f72fc03c070 con 0x55556f135d10 2023-10-05T19:52:50.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f7301704700 1 --2- 172.21.15.167:0/3426196512 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7258030c50 0x7f7258033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name= 2023-10-05T19:52:50.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f7252ffd700 20 reqs_thread_entry: start 2023-10-05T19:52:50.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55556f15ac50 0x55556f15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.611 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f15b5e0 con 0x55556f15ac50 2023-10-05T19:52:50.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730a706700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55556f15ac50 0x55556f15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730a706700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55556f15ac50 0x55556f15b0a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.612 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f7301704700 1 --2- 172.21.15.167:0/3426196512 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7258030c50 0x7f7258033100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72f4000c00 tx=0x7f72f401c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55556f16e6a0 0x55556f170a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.605+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f170fc0 con 0x55556f16e6a0 2023-10-05T19:52:50.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f7309f05700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55556f16e6a0 0x55556f170a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f7309f05700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55556f16e6a0 0x55556f170a80 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.613 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f730c3d0e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f730c3d0e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.614 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f171370 con 0x55556f15ac50 2023-10-05T19:52:50.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(3 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f730c3d0e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55556f172c40 0x55556f175020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:4 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f172c40 2023-10-05T19:52:50.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f7301704700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55556f172c40 0x55556f175020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f7301704700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55556f172c40 0x55556f175020 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(4 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.615 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.609+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f16e6a0 2023-10-05T19:52:50.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f7309f05700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f72fc02d020 0x7f72fc03e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:6 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x7f72fc02d020 2023-10-05T19:52:50.616 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f72fc02d020 0x7f72fc03e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f72fc02d020 0x7f72fc03e930 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.617 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:7 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:9 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f172c40 2023-10-05T19:52:50.618 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f16e6a0 2023-10-05T19:52:50.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.619 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.613+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:12 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f16e6a0 2023-10-05T19:52:50.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:13 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(13 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.620 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:14 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x7f72fc02d020 2023-10-05T19:52:50.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x7f72fc02d020 2023-10-05T19:52:50.621 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f16e6a0 2023-10-05T19:52:50.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.622 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f172c40 2023-10-05T19:52:50.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:19 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.623 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.617+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:20 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f16e6a0 2023-10-05T19:52:50.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.624 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:21 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f172c40 2023-10-05T19:52:50.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:22 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.625 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:23 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.626 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f172c40 2023-10-05T19:52:50.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.627 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:26 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x7f72fc02d020 2023-10-05T19:52:50.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.621+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:27 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f15ac50 2023-10-05T19:52:50.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x7f72fc02d020 2023-10-05T19:52:50.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.628 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:29 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f172c40 2023-10-05T19:52:50.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x7f72fc02d020 2023-10-05T19:52:50.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.629 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:31 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f16e6a0 2023-10-05T19:52:50.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.630 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:32 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f16e6a0 2023-10-05T19:52:50.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.625+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:33 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f172c40 2023-10-05T19:52:50.631 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f16e6a0 2023-10-05T19:52:50.632 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:35 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f175560 con 0x55556f16e6a0 2023-10-05T19:52:50.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.633 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:50.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:50.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:50.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:50.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f171720 con 0x55556f16e6a0 2023-10-05T19:52:50.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(36 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.634 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:37 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f171b50 con 0x55556f15ac50 2023-10-05T19:52:50.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(37 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.635 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.629+0000 7f730c3d0e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730c3d0e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f15c8c0 con 0x55556f15ac50 2023-10-05T19:52:50.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.636 INFO:teuthology.orchestra.run.smithi167.stderr:zone id e814e647-c2a9-43bf-96a6-1088a1b789e22023-10-05T19:52:50.633+0000 7f730c3d0e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.636 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:39 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f172c40 2023-10-05T19:52:50.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(39 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.637 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f16e6a0 2023-10-05T19:52:50.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:41 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x7f72fc02d020 2023-10-05T19:52:50.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(41 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.638 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(42 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:43 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(43 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.639 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.633+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f172c40 2023-10-05T19:52:50.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:45 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.640 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:46 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f16e6a0 2023-10-05T19:52:50.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.641 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:47 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f16e6a0 2023-10-05T19:52:50.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.642 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:49 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x7f72fc02d020 2023-10-05T19:52:50.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.637+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.643 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:51 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x7f72fc02d020 2023-10-05T19:52:50.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.644 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f16e6a0 2023-10-05T19:52:50.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:53 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f172c40 2023-10-05T19:52:50.645 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(53 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:54 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.646 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:55 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f16e6a0 2023-10-05T19:52:50.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.647 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.641+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:56 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f172c40 2023-10-05T19:52:50.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:57 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.648 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:58 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.649 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:60 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f172c40 2023-10-05T19:52:50.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:61 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x7f72fc02d020 2023-10-05T19:52:50.650 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f15ac50 2023-10-05T19:52:50.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.651 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.645+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:63 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x7f72fc02d020 2023-10-05T19:52:50.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:64 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f172c40 2023-10-05T19:52:50.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.652 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:65 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x7f72fc02d020 2023-10-05T19:52:50.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f730400a520 con 0x7f72fc02d020 2023-10-05T19:52:50.653 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:66 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f16e6a0 2023-10-05T19:52:50.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.654 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:67 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f16e6a0 2023-10-05T19:52:50.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:68 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f172c40 2023-10-05T19:52:50.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72f402e440 con 0x55556f172c40 2023-10-05T19:52:50.655 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.649+0000 7f7301704700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:69 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f16e6a0 2023-10-05T19:52:50.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(69 [pgnls start_epoch 32 out=178b] v23'3 uv3 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.656 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:70 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f179920 con 0x55556f16e6a0 2023-10-05T19:52:50.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.657 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:50.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:50.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:50.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:50.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.658 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f17e260 con 0x55556f16e6a0 2023-10-05T19:52:50.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(71 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:72 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f17b830 con 0x55556f15ac50 2023-10-05T19:52:50.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(72 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.659 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.660 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.653+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:73 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [delete,create,writefull 0~1036 in=1036b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f171f50 con 0x55556f15ac50 2023-10-05T19:52:50.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.657+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(73 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [delete,create,writefull 0~1036] v32'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f730400a520 con 0x55556f15ac50 2023-10-05T19:52:50.662 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.657+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f43b6ece:::zone_names.default:head [delete,create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55556f172360 con 0x55556f16e6a0 2023-10-05T19:52:50.664 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f7309f05700 1 -- 172.21.15.167:0/2013850593 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(74 zone_names.default [delete,create,writefull 0~46] v32'4 uv4 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f72fc014070 con 0x55556f16e6a0 2023-10-05T19:52:50.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55556f16e6a0 msgr2=0x55556f170a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55556f16e6a0 0x55556f170a80 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55556f15ac50 msgr2=0x55556f15b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55556f15ac50 0x55556f15b0a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.667 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f72fc02d020 msgr2=0x7f72fc03e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f72fc02d020 0x7f72fc03e930 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55556f172c40 msgr2=0x55556f175020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55556f172c40 0x55556f175020 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f72ec030c40 msgr2=0x7f72ec0330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f72ec030c40 0x7f72ec0330f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72f40030c0 tx=0x7f72f4014000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730a706700 1 -- 172.21.15.167:0/2013850593 reap_dead start 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 msgr2=0x55556f124720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f124720 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00b960 tx=0x7f72fc014000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 shutdown_connections 2023-10-05T19:52:50.668 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/2013850593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f071aa0 0x55556f124720 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 >> 172.21.15.167:0/2013850593 conn(0x55556f0f8330 msgr2=0x55556f117fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 shutdown_connections 2023-10-05T19:52:50.669 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.661+0000 7f730c3d0e40 1 -- 172.21.15.167:0/2013850593 wait complete. 2023-10-05T19:52:50.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3426196512 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7258030c50 msgr2=0x7f7258033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/3426196512 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7258030c50 0x7f7258033100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72f4000c00 tx=0x7f72f401c000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3426196512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 msgr2=0x55556f13cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/3426196512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f13cf50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f72fc016fd0 tx=0x7f72fc038000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3426196512 shutdown_connections 2023-10-05T19:52:50.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/3426196512 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7258030c50 0x7f7258033100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.670 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 --2- 172.21.15.167:0/3426196512 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55556f135d10 0x55556f13cf50 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3426196512 >> 172.21.15.167:0/3426196512 conn(0x55556f072db0 msgr2=0x55556f1326a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3426196512 shutdown_connections 2023-10-05T19:52:50.671 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.665+0000 7f730c3d0e40 1 -- 172.21.15.167:0/3426196512 wait complete. 2023-10-05T19:52:50.671 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:50.671 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2", 2023-10-05T19:52:50.671 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "default", 2023-10-05T19:52:50.671 INFO:teuthology.orchestra.run.smithi167.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T19:52:50.671 INFO:teuthology.orchestra.run.smithi167.stdout: "control_pool": "default.rgw.control", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "log_pool": "default.rgw.log", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T19:52:50.672 INFO:teuthology.orchestra.run.smithi167.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: "system_key": { 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "", 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "" 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_pools": [ 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "default-placement", 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: "val": { 2023-10-05T19:52:50.673 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: "storage_classes": { 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: "STANDARD": { 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": 0, 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: "inline_data": "true" 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.674 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "new-placement", 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: "val": { 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": ".rgw.buckets.index.2", 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: "storage_classes": { 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: "STANDARD": { 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": ".rgw.buckets.2" 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T19:52:50.675 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": 0, 2023-10-05T19:52:50.676 INFO:teuthology.orchestra.run.smithi167.stdout: "inline_data": "false" 2023-10-05T19:52:50.676 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.676 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.676 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:50.676 INFO:teuthology.orchestra.run.smithi167.stdout: "realm_id": "", 2023-10-05T19:52:50.676 INFO:teuthology.orchestra.run.smithi167.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T19:52:50.676 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:50.677 DEBUG:tasks.util.rgw: json result: {'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'false'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T19:52:50.677 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2023-10-05T19:52:50.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2023-10-05T19:52:50.678 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2023-10-05T19:52:50.759 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:50.759 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:50.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 Processor -- start 2023-10-05T19:52:50.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 -- start start 2023-10-05T19:52:50.760 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c63efc0dd0 0x55c63efc31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c63ef0ac00 con 0x55c63efbc7f0 2023-10-05T19:52:50.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c63eec7ee0 con 0x55c63efc0dd0 2023-10-05T19:52:50.761 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc4334700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c63efc0dd0 0x55c63efc31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc4334700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55c63efc0dd0 0x55c63efc31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48204/0 (socket says 172.21.15.167:48204) 2023-10-05T19:52:50.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc4334700 1 -- 172.21.15.167:0/1667677655 learned_addr learned my addr 172.21.15.167:0/1667677655 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc4b35700 1 --1- 172.21.15.167:0/1667677655 >> v1:172.21.15.118:6789/0 conn(0x55c63efbc7f0 0x55c63efbcbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60406/0 (socket says 172.21.15.167:60406) 2023-10-05T19:52:50.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc4334700 1 -- 172.21.15.167:0/1667677655 >> v1:172.21.15.118:6789/0 conn(0x55c63efbc7f0 legacy=0x55c63efbcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc4334700 1 -- 172.21.15.167:0/1667677655 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c63efbd400 con 0x55c63efc0dd0 2023-10-05T19:52:50.762 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc4334700 1 --2- 172.21.15.167:0/1667677655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efc0dd0 0x55c63efc31b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fccac00a5c0 tx=0x7fccac005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bbdb47e986a68a server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc3b33700 1 -- 172.21.15.167:0/1667677655 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccac00e510 con 0x55c63efc0dd0 2023-10-05T19:52:50.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc3b33700 1 -- 172.21.15.167:0/1667677655 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccac00e670 con 0x55c63efc0dd0 2023-10-05T19:52:50.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc3b33700 1 -- 172.21.15.167:0/1667677655 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccac00e920 con 0x55c63efc0dd0 2023-10-05T19:52:50.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 -- 172.21.15.167:0/1667677655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efc0dd0 msgr2=0x55c63efc31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.763 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 --2- 172.21.15.167:0/1667677655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efc0dd0 0x55c63efc31b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fccac00a5c0 tx=0x7fccac005e00 comp rx=0 tx=0).stop 2023-10-05T19:52:50.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 -- 172.21.15.167:0/1667677655 shutdown_connections 2023-10-05T19:52:50.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 --2- 172.21.15.167:0/1667677655 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efc0dd0 0x55c63efc31b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 -- 172.21.15.167:0/1667677655 >> 172.21.15.167:0/1667677655 conn(0x55c63efb8210 msgr2=0x55c63efba620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 -- 172.21.15.167:0/1667677655 shutdown_connections 2023-10-05T19:52:50.764 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.757+0000 7fccc7000e40 1 -- 172.21.15.167:0/1667677655 wait complete. 2023-10-05T19:52:50.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 Processor -- start 2023-10-05T19:52:50.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 -- start start 2023-10-05T19:52:50.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63ee8be30 con 0x55c63efbc7f0 2023-10-05T19:52:50.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc4b35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc4b35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48218/0 (socket says 172.21.15.167:48218) 2023-10-05T19:52:50.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc4b35700 1 -- 172.21.15.167:0/2722320450 learned_addr learned my addr 172.21.15.167:0/2722320450 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.765 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc4b35700 1 -- 172.21.15.167:0/2722320450 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac00a180 con 0x55c63efbc7f0 2023-10-05T19:52:50.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc4b35700 1 --2- 172.21.15.167:0/2722320450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe1590 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fccbc001cf0 tx=0x7fccbc0018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1012ecda54d623e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.766 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc2b31700 1 -- 172.21.15.167:0/2722320450 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccbc014070 con 0x55c63efbc7f0 2023-10-05T19:52:50.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc2b31700 1 -- 172.21.15.167:0/2722320450 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc00f450 con 0x55c63efbc7f0 2023-10-05T19:52:50.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc2b31700 1 -- 172.21.15.167:0/2722320450 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccbc00bea0 con 0x55c63efbc7f0 2023-10-05T19:52:50.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 -- 172.21.15.167:0/2722320450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 msgr2=0x55c63efe1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 --2- 172.21.15.167:0/2722320450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe1590 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fccbc001cf0 tx=0x7fccbc0018a0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 -- 172.21.15.167:0/2722320450 shutdown_connections 2023-10-05T19:52:50.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 --2- 172.21.15.167:0/2722320450 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe1590 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 -- 172.21.15.167:0/2722320450 >> 172.21.15.167:0/2722320450 conn(0x55c63efb8210 msgr2=0x55c63ef31720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 -- 172.21.15.167:0/2722320450 shutdown_connections 2023-10-05T19:52:50.767 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 -- 172.21.15.167:0/2722320450 wait complete. 2023-10-05T19:52:50.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 Processor -- start 2023-10-05T19:52:50.768 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 -- start start 2023-10-05T19:52:50.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.761+0000 7fccc7000e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63ee5eed0 con 0x55c63efbc7f0 2023-10-05T19:52:50.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc4b35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc4b35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48226/0 (socket says 172.21.15.167:48226) 2023-10-05T19:52:50.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 learned_addr learned my addr 172.21.15.167:0/443983473 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c63ef0ac00 con 0x55c63efbc7f0 2023-10-05T19:52:50.769 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc4b35700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe59d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0018e0 tx=0x7fccbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc132e700 1 -- 172.21.15.167:0/443983473 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccbc01c790 con 0x55c63efbc7f0 2023-10-05T19:52:50.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c63efe5f10 con 0x55c63efbc7f0 2023-10-05T19:52:50.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc132e700 1 -- 172.21.15.167:0/443983473 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc01c8f0 con 0x55c63efbc7f0 2023-10-05T19:52:50.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc132e700 1 -- 172.21.15.167:0/443983473 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccbc01cbe0 con 0x55c63efbc7f0 2023-10-05T19:52:50.770 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c63efe6350 con 0x55c63efbc7f0 2023-10-05T19:52:50.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc7000e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:50.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc7000e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:50.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc132e700 1 -- 172.21.15.167:0/443983473 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fccbc023020 con 0x55c63efbc7f0 2023-10-05T19:52:50.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc7000e40 1 Processor -- start 2023-10-05T19:52:50.771 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc7000e40 1 -- start start 2023-10-05T19:52:50.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc132e700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcca8030c00 0x7fcca80330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.765+0000 7fccc132e700 1 -- 172.21.15.167:0/443983473 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7fccbc008030 con 0x55c63efbc7f0 2023-10-05T19:52:50.772 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63eff8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc5336700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcca8030c00 0x7fcca80330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63eff8f80 con 0x55c63eff8670 2023-10-05T19:52:50.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc4b35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63eff8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc4b35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63eff8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48232/0 (socket says 172.21.15.167:48232) 2023-10-05T19:52:50.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc4b35700 1 -- 172.21.15.167:0/2883137787 learned_addr learned my addr 172.21.15.167:0/2883137787 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc4b35700 1 -- 172.21.15.167:0/2883137787 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c63eff90c0 con 0x55c63eff8670 2023-10-05T19:52:50.773 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc5336700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcca8030c00 0x7fcca80330b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fccb400a370 tx=0x7fccb4005500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc4b35700 1 --2- 172.21.15.167:0/2883137787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63eff8a40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fccbc02ec00 tx=0x7fccbc0436d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c0106dd9f0cbb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fcc957f2700 1 -- 172.21.15.167:0/2883137787 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccbc025c40 con 0x55c63eff8670 2023-10-05T19:52:50.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fcc957f2700 1 -- 172.21.15.167:0/2883137787 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc00ecb0 con 0x55c63eff8670 2023-10-05T19:52:50.774 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fcc957f2700 1 -- 172.21.15.167:0/2883137787 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccbc01ac60 con 0x55c63eff8670 2023-10-05T19:52:50.775 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 -- 172.21.15.167:0/2883137787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 msgr2=0x55c63eff8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 --2- 172.21.15.167:0/2883137787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63eff8a40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fccbc02ec00 tx=0x7fccbc0436d0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 -- 172.21.15.167:0/2883137787 shutdown_connections 2023-10-05T19:52:50.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 --2- 172.21.15.167:0/2883137787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63eff8a40 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 -- 172.21.15.167:0/2883137787 >> 172.21.15.167:0/2883137787 conn(0x55c63efc0dd0 msgr2=0x55c63eff3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.777 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 -- 172.21.15.167:0/2883137787 shutdown_connections 2023-10-05T19:52:50.778 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 -- 172.21.15.167:0/2883137787 wait complete. 2023-10-05T19:52:50.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 Processor -- start 2023-10-05T19:52:50.779 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.769+0000 7fccc7000e40 1 -- start start 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc7000e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63effe300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc7000e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63efff300 con 0x55c63eff8670 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc4b35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63effe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc4b35700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63effe300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48238/0 (socket says 172.21.15.167:48238) 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc4b35700 1 -- 172.21.15.167:0/2098582459 learned_addr learned my addr 172.21.15.167:0/2098582459 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc4b35700 1 -- 172.21.15.167:0/2098582459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c63efe6350 con 0x55c63eff8670 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc4b35700 1 --2- 172.21.15.167:0/2098582459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63effe300 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fccbc02e660 tx=0x7fccbc036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fcc177fe700 1 -- 172.21.15.167:0/2098582459 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccbc03e0b0 con 0x55c63eff8670 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fcc177fe700 1 -- 172.21.15.167:0/2098582459 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc02e960 con 0x55c63eff8670 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc7000e40 1 -- 172.21.15.167:0/2098582459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c63effe900 con 0x55c63eff8670 2023-10-05T19:52:50.780 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fcc177fe700 1 -- 172.21.15.167:0/2098582459 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fccbc043cf0 con 0x55c63eff8670 2023-10-05T19:52:50.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc7000e40 1 -- 172.21.15.167:0/2098582459 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c63effedc0 con 0x55c63eff8670 2023-10-05T19:52:50.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fcc177fe700 1 -- 172.21.15.167:0/2098582459 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7fccbc03f070 con 0x55c63eff8670 2023-10-05T19:52:50.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fcc177fe700 1 --2- 172.21.15.167:0/2098582459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcc0c030c00 0x7fcc0c0330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fcc177fe700 1 -- 172.21.15.167:0/2098582459 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7fccbc044050 con 0x55c63eff8670 2023-10-05T19:52:50.781 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.773+0000 7fccc4334700 1 --2- 172.21.15.167:0/2098582459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcc0c030c00 0x7fcc0c0330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc4334700 1 --2- 172.21.15.167:0/2098582459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcc0c030c00 0x7fcc0c0330b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fccac000f80 tx=0x7fccac013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fcc157fa700 20 reqs_thread_entry: start 2023-10-05T19:52:50.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc7000e40 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name= 2023-10-05T19:52:50.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc7000e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c63f01be60 0x55c63f01c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f01c7d0 con 0x55c63f01be60 2023-10-05T19:52:50.782 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc5336700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c63f01be60 0x55c63f01c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc5336700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c63f01be60 0x55c63f01c290 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fccb400c720 con 0x55c63f01be60 2023-10-05T19:52:50.783 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc7000e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc7000e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c63f02f890 0x55c63f031c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f0321b0 con 0x55c63f02f890 2023-10-05T19:52:50.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.777+0000 7fccc4b35700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c63f02f890 0x55c63f031c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.784 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc4b35700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c63f02f890 0x55c63f031c70 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc7000e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc7000e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.785 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f032560 con 0x55c63f01be60 2023-10-05T19:52:50.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(3 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+1036 (crc 0 0 0) 0x7fccb4011420 con 0x55c63f01be60 2023-10-05T19:52:50.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc7000e40 20 rados_obj.operate() r=0 bl.length=1036 2023-10-05T19:52:50.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c63f033e30 0x55c63f036210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:4 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f033e30 2023-10-05T19:52:50.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc4334700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c63f033e30 0x55c63f036210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.786 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc4334700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c63f033e30 0x55c63f036210 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(4 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac017050 con 0x55c63f033e30 2023-10-05T19:52:50.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f02f890 2023-10-05T19:52:50.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.787 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc4b35700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fccbc01a070 0x7fccbc042de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.781+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:6 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x7fccbc01a070 2023-10-05T19:52:50.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fccbc01a070 0x7fccbc042de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.788 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fccbc01a070 0x7fccbc042de0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x7fccbc01a070 2023-10-05T19:52:50.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:7 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.789 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:9 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f033e30 2023-10-05T19:52:50.790 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac017050 con 0x55c63f033e30 2023-10-05T19:52:50.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.791 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.785+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f02f890 2023-10-05T19:52:50.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:12 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f02f890 2023-10-05T19:52:50.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.792 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:13 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(13 [pgnls start_epoch 32 out=107b] v32'3 uv3 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:14 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x7fccbc01a070 2023-10-05T19:52:50.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x7fccbc01a070 2023-10-05T19:52:50.793 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.794 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x7fccbc01a070 2023-10-05T19:52:50.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x7fccbc01a070 2023-10-05T19:52:50.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.789+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f02f890 2023-10-05T19:52:50.795 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f033e30 2023-10-05T19:52:50.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac017050 con 0x55c63f033e30 2023-10-05T19:52:50.796 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:19 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:20 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f02f890 2023-10-05T19:52:50.797 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:21 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f033e30 2023-10-05T19:52:50.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac017050 con 0x55c63f033e30 2023-10-05T19:52:50.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:22 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.798 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:23 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.793+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.799 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f033e30 2023-10-05T19:52:50.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac017050 con 0x55c63f033e30 2023-10-05T19:52:50.800 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:26 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x7fccbc01a070 2023-10-05T19:52:50.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x7fccbc01a070 2023-10-05T19:52:50.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:27 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f01be60 2023-10-05T19:52:50.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.801 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x7fccbc01a070 2023-10-05T19:52:50.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x7fccbc01a070 2023-10-05T19:52:50.802 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:29 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f033e30 2023-10-05T19:52:50.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac017050 con 0x55c63f033e30 2023-10-05T19:52:50.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x7fccbc01a070 2023-10-05T19:52:50.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccb4011040 con 0x7fccbc01a070 2023-10-05T19:52:50.803 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.797+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:31 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f02f890 2023-10-05T19:52:50.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.804 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:32 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f02f890 2023-10-05T19:52:50.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:33 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f033e30 2023-10-05T19:52:50.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccac017050 con 0x55c63f033e30 2023-10-05T19:52:50.805 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc4334700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f02f890 2023-10-05T19:52:50.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=178b] v32'4 uv4 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.806 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:35 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f036750 con 0x55c63f02f890 2023-10-05T19:52:50.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc4b35700 1 -- 172.21.15.167:0/443983473 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fccbc016070 con 0x55c63f02f890 2023-10-05T19:52:50.807 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc7000e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc7000e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc7000e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc7000e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc7000e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.801+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:36 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c63f032910 con 0x55c63f01be60 2023-10-05T19:52:50.808 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(36 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+1036 (crc 0 0 0) 0x7fccb4011040 con 0x55c63f01be60 2023-10-05T19:52:50.809 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 20 rados_obj.operate() r=0 bl.length=1036 2023-10-05T19:52:50.810 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c63f02f890 msgr2=0x55c63f031c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55c63f02f890 0x55c63f031c70 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c63f01be60 msgr2=0x55c63f01c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55c63f01be60 0x55c63f01c290 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fccbc01a070 msgr2=0x7fccbc042de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7fccbc01a070 0x7fccbc042de0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c63f033e30 msgr2=0x55c63f036210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55c63f033e30 0x55c63f036210 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcca8030c00 msgr2=0x7fcca80330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcca8030c00 0x7fcca80330b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fccb400a370 tx=0x7fccb4005500 comp rx=0 tx=0).stop 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc5336700 1 -- 172.21.15.167:0/443983473 reap_dead start 2023-10-05T19:52:50.811 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 msgr2=0x55c63efe59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe59d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0018e0 tx=0x7fccbc016000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 shutdown_connections 2023-10-05T19:52:50.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 --2- 172.21.15.167:0/443983473 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63efbc7f0 0x55c63efe59d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 >> 172.21.15.167:0/443983473 conn(0x55c63efb8210 msgr2=0x55c63efd5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 shutdown_connections 2023-10-05T19:52:50.812 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/443983473 wait complete. 2023-10-05T19:52:50.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/2098582459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcc0c030c00 msgr2=0x7fcc0c0330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 --2- 172.21.15.167:0/2098582459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcc0c030c00 0x7fcc0c0330b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fccac000f80 tx=0x7fccac013000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 -- 172.21.15.167:0/2098582459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 msgr2=0x55c63effe300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.805+0000 7fccc7000e40 1 --2- 172.21.15.167:0/2098582459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63effe300 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fccbc02e660 tx=0x7fccbc036000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.813 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.809+0000 7fccc7000e40 1 -- 172.21.15.167:0/2098582459 shutdown_connections 2023-10-05T19:52:50.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.809+0000 7fccc7000e40 1 --2- 172.21.15.167:0/2098582459 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7fcc0c030c00 0x7fcc0c0330b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.809+0000 7fccc7000e40 1 --2- 172.21.15.167:0/2098582459 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c63eff8670 0x55c63effe300 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.809+0000 7fccc7000e40 1 -- 172.21.15.167:0/2098582459 >> 172.21.15.167:0/2098582459 conn(0x55c63efc0dd0 msgr2=0x55c63eff3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.809+0000 7fccc7000e40 1 -- 172.21.15.167:0/2098582459 shutdown_connections 2023-10-05T19:52:50.814 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.809+0000 7fccc7000e40 1 -- 172.21.15.167:0/2098582459 wait complete. 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2", 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "default", 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout: "control_pool": "default.rgw.control", 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout: "log_pool": "default.rgw.log", 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T19:52:50.815 INFO:teuthology.orchestra.run.smithi167.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "system_key": { 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "", 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "" 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.816 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_pools": [ 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "default-placement", 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: "val": { 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: "storage_classes": { 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: "STANDARD": { 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": 0, 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: "inline_data": "true" 2023-10-05T19:52:50.817 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "new-placement", 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: "val": { 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": ".rgw.buckets.index.2", 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: "storage_classes": { 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: "STANDARD": { 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": ".rgw.buckets.2" 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T19:52:50.818 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": 0, 2023-10-05T19:52:50.819 INFO:teuthology.orchestra.run.smithi167.stdout: "inline_data": "false" 2023-10-05T19:52:50.819 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.819 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.819 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:50.819 INFO:teuthology.orchestra.run.smithi167.stdout: "realm_id": "", 2023-10-05T19:52:50.819 INFO:teuthology.orchestra.run.smithi167.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T19:52:50.819 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:50.820 DEBUG:tasks.util.rgw: json result: {'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'false'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T19:52:50.820 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-10-05T19:52:50.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-10-05T19:52:50.820 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2023-10-05T19:52:50.863 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:50.863 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:50.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 Processor -- start 2023-10-05T19:52:50.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 -- start start 2023-10-05T19:52:50.864 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e934a9a150 0x55e934a9c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e9349e0bd0 con 0x55e934a95b70 2023-10-05T19:52:50.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e93499dee0 con 0x55e934a9a150 2023-10-05T19:52:50.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a8801c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e934a9a150 0x55e934a9c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a8801c700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55e934a9a150 0x55e934a9c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48250/0 (socket says 172.21.15.167:48250) 2023-10-05T19:52:50.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a8801c700 1 -- 172.21.15.167:0/1217824334 learned_addr learned my addr 172.21.15.167:0/1217824334 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.865 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a9081d700 1 --1- 172.21.15.167:0/1217824334 >> v1:172.21.15.118:6789/0 conn(0x55e934a95b70 0x55e934a95f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60422/0 (socket says 172.21.15.167:60422) 2023-10-05T19:52:50.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a8801c700 1 -- 172.21.15.167:0/1217824334 >> v1:172.21.15.118:6789/0 conn(0x55e934a95b70 legacy=0x55e934a95f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a8801c700 1 -- 172.21.15.167:0/1217824334 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e934a96780 con 0x55e934a9a150 2023-10-05T19:52:50.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a8801c700 1 --2- 172.21.15.167:0/1217824334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a9a150 0x55e934a9c530 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800a650 tx=0x7f7a78005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc91180cc141e62 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a8bfff700 1 -- 172.21.15.167:0/1217824334 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a78008760 con 0x55e934a9a150 2023-10-05T19:52:50.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a8bfff700 1 -- 172.21.15.167:0/1217824334 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a780088c0 con 0x55e934a9a150 2023-10-05T19:52:50.866 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a8bfff700 1 -- 172.21.15.167:0/1217824334 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a78008bb0 con 0x55e934a9a150 2023-10-05T19:52:50.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1217824334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a9a150 msgr2=0x55e934a9c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/1217824334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a9a150 0x55e934a9c530 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800a650 tx=0x7f7a78005b10 comp rx=0 tx=0).stop 2023-10-05T19:52:50.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1217824334 shutdown_connections 2023-10-05T19:52:50.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/1217824334 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a9a150 0x55e934a9c530 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1217824334 >> 172.21.15.167:0/1217824334 conn(0x55e934a09530 msgr2=0x55e934a09930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1217824334 shutdown_connections 2023-10-05T19:52:50.867 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.861+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1217824334 wait complete. 2023-10-05T19:52:50.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 Processor -- start 2023-10-05T19:52:50.868 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 -- start start 2023-10-05T19:52:50.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934ab4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e934961e30 con 0x55e934a95b70 2023-10-05T19:52:50.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a9081d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934ab4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a9081d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934ab4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48254/0 (socket says 172.21.15.167:48254) 2023-10-05T19:52:50.869 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a9081d700 1 -- 172.21.15.167:0/3760388916 learned_addr learned my addr 172.21.15.167:0/3760388916 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a9081d700 1 -- 172.21.15.167:0/3760388916 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a78005db0 con 0x55e934a95b70 2023-10-05T19:52:50.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a9081d700 1 --2- 172.21.15.167:0/3760388916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934ab4d30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7a80001cf0 tx=0x7f7a800018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3465203d64bb8352 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a8affd700 1 -- 172.21.15.167:0/3760388916 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a80014070 con 0x55e934a95b70 2023-10-05T19:52:50.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a8affd700 1 -- 172.21.15.167:0/3760388916 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8000be10 con 0x55e934a95b70 2023-10-05T19:52:50.870 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a8affd700 1 -- 172.21.15.167:0/3760388916 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a8000f590 con 0x55e934a95b70 2023-10-05T19:52:50.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3760388916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 msgr2=0x55e934ab4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3760388916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934ab4d30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7a80001cf0 tx=0x7f7a800018a0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3760388916 shutdown_connections 2023-10-05T19:52:50.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3760388916 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934ab4d30 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3760388916 >> 172.21.15.167:0/3760388916 conn(0x55e934a09530 msgr2=0x55e934ab0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3760388916 shutdown_connections 2023-10-05T19:52:50.871 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.865+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3760388916 wait complete. 2023-10-05T19:52:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a92ce8e40 1 Processor -- start 2023-10-05T19:52:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a92ce8e40 1 -- start start 2023-10-05T19:52:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a92ce8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934abbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.872 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a92ce8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e934934ed0 con 0x55e934a95b70 2023-10-05T19:52:50.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a9081d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934abbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a9081d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934abbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48270/0 (socket says 172.21.15.167:48270) 2023-10-05T19:52:50.873 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 learned_addr learned my addr 172.21.15.167:0/3023590753 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9349e0bd0 con 0x55e934a95b70 2023-10-05T19:52:50.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a9081d700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934abbb00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7a800018e0 tx=0x7f7a80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.874 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a897fa700 1 -- 172.21.15.167:0/3023590753 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a8001c740 con 0x55e934a95b70 2023-10-05T19:52:50.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a897fa700 1 -- 172.21.15.167:0/3023590753 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8001c8a0 con 0x55e934a95b70 2023-10-05T19:52:50.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e934abc040 con 0x55e934a95b70 2023-10-05T19:52:50.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a897fa700 1 -- 172.21.15.167:0/3023590753 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a8001cb90 con 0x55e934a95b70 2023-10-05T19:52:50.875 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.869+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e934abc480 con 0x55e934a95b70 2023-10-05T19:52:50.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a897fa700 1 -- 172.21.15.167:0/3023590753 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7a80023020 con 0x55e934a95b70 2023-10-05T19:52:50.876 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a92ce8e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:50.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a92ce8e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:50.877 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a92ce8e40 1 Processor -- start 2023-10-05T19:52:50.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a92ce8e40 1 -- start start 2023-10-05T19:52:50.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a897fa700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a70030c50 0x7f7a70033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a897fa700 1 -- 172.21.15.167:0/3023590753 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f7a80008030 con 0x55e934a95b70 2023-10-05T19:52:50.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a92ce8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934acd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a92ce8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e934acdb70 con 0x55e934acd260 2023-10-05T19:52:50.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a9101e700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a70030c50 0x7f7a70033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.878 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a9081d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934acd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a9081d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934acd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48278/0 (socket says 172.21.15.167:48278) 2023-10-05T19:52:50.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a9081d700 1 -- 172.21.15.167:0/3377682966 learned_addr learned my addr 172.21.15.167:0/3377682966 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a9101e700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a70030c50 0x7f7a70033100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c00a3e0 tx=0x7f7a8c005880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a9081d700 1 -- 172.21.15.167:0/3377682966 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e934acdcb0 con 0x55e934acd260 2023-10-05T19:52:50.879 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a9081d700 1 --2- 172.21.15.167:0/3377682966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934acd630 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7a80043630 tx=0x7f7a80043590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54de6d965a60cd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a627e4700 1 -- 172.21.15.167:0/3377682966 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800450d0 con 0x55e934acd260 2023-10-05T19:52:50.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a627e4700 1 -- 172.21.15.167:0/3377682966 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8003f070 con 0x55e934acd260 2023-10-05T19:52:50.880 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.873+0000 7f7a627e4700 1 -- 172.21.15.167:0/3377682966 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a8002e490 con 0x55e934acd260 2023-10-05T19:52:50.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3377682966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 msgr2=0x55e934acd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3377682966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934acd630 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7a80043630 tx=0x7f7a80043590 comp rx=0 tx=0).stop 2023-10-05T19:52:50.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3377682966 shutdown_connections 2023-10-05T19:52:50.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3377682966 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934acd630 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3377682966 >> 172.21.15.167:0/3377682966 conn(0x55e934a9a150 msgr2=0x55e934ac9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3377682966 shutdown_connections 2023-10-05T19:52:50.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3377682966 wait complete. 2023-10-05T19:52:50.881 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 Processor -- start 2023-10-05T19:52:50.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 -- start start 2023-10-05T19:52:50.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934ad44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.882 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e934ad54a0 con 0x55e934acd260 2023-10-05T19:52:50.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a9081d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934ad44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a9081d700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934ad44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48294/0 (socket says 172.21.15.167:48294) 2023-10-05T19:52:50.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a9081d700 1 -- 172.21.15.167:0/1615472251 learned_addr learned my addr 172.21.15.167:0/1615472251 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.883 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a9081d700 1 -- 172.21.15.167:0/1615472251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80041040 con 0x55e934acd260 2023-10-05T19:52:50.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a9081d700 1 --2- 172.21.15.167:0/1615472251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934ad44a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7a8002eee0 tx=0x7f7a80036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a60fe1700 1 -- 172.21.15.167:0/1615472251 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a8001ae70 con 0x55e934acd260 2023-10-05T19:52:50.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a60fe1700 1 -- 172.21.15.167:0/1615472251 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a800253d0 con 0x55e934acd260 2023-10-05T19:52:50.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1615472251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e934ad4aa0 con 0x55e934acd260 2023-10-05T19:52:50.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a60fe1700 1 -- 172.21.15.167:0/1615472251 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800256c0 con 0x55e934acd260 2023-10-05T19:52:50.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.877+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1615472251 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e934ad4fc0 con 0x55e934acd260 2023-10-05T19:52:50.884 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a60fe1700 1 -- 172.21.15.167:0/1615472251 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f7a80025820 con 0x55e934acd260 2023-10-05T19:52:50.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a60fe1700 1 --2- 172.21.15.167:0/1615472251 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79e0030c00 0x7f79e00330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a60fe1700 1 -- 172.21.15.167:0/1615472251 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f7a80046d30 con 0x55e934acd260 2023-10-05T19:52:50.885 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a8801c700 1 --2- 172.21.15.167:0/1615472251 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79e0030c00 0x7f79e00330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.886 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a8801c700 1 --2- 172.21.15.167:0/1615472251 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79e0030c00 0x7f79e00330b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7a780030a0 tx=0x7f7a78015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f79da7fc700 20 reqs_thread_entry: start 2023-10-05T19:52:50.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a92ce8e40 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name=default 2023-10-05T19:52:50.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a92ce8e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e934af1f20 0x55e934af23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b05400 con 0x55e934af1f20 2023-10-05T19:52:50.887 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.881+0000 7f7a9101e700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e934af1f20 0x55e934af23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.888 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a9101e700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e934af1f20 0x55e934af23c0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7a8c012040 con 0x55e934af1f20 2023-10-05T19:52:50.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a92ce8e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a92ce8e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e934b05cc0 0x55e934b080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b085e0 con 0x55e934b05cc0 2023-10-05T19:52:50.889 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a9081d700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e934b05cc0 0x55e934b080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a9081d700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e934b05cc0 0x55e934b080a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.890 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(2 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+1036 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a92ce8e40 20 rados_obj.operate() r=0 bl.length=1036 2023-10-05T19:52:50.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e934af4660 0x55e934b0bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:3 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af4660 2023-10-05T19:52:50.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a8801c700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e934af4660 0x55e934b0bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.891 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.885+0000 7f7a8801c700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e934af4660 0x55e934b0bec0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(3 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a78008a30 con 0x55e934af4660 2023-10-05T19:52:50.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af1f20 2023-10-05T19:52:50.892 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(4 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c012040 con 0x55e934af1f20 2023-10-05T19:52:50.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9101e700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a8c010070 0x7f7a8c010950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:5 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x7f7a8c010070 2023-10-05T19:52:50.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9101e700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a8c010070 0x7f7a8c010950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.893 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9101e700 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a8c010070 0x7f7a8c010950 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c012040 con 0x7f7a8c010070 2023-10-05T19:52:50.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:6 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.894 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:7 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.895 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:8 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af4660 2023-10-05T19:52:50.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a78008a30 con 0x55e934af4660 2023-10-05T19:52:50.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.889+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:10 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af1f20 2023-10-05T19:52:50.896 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c012040 con 0x55e934af1f20 2023-10-05T19:52:50.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af1f20 2023-10-05T19:52:50.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c012040 con 0x55e934af1f20 2023-10-05T19:52:50.897 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(12 [pgnls start_epoch 32 out=107b] v32'3 uv3 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:13 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x7f7a8c010070 2023-10-05T19:52:50.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c012040 con 0x7f7a8c010070 2023-10-05T19:52:50.898 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:14 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:15 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x7f7a8c010070 2023-10-05T19:52:50.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c02e040 con 0x7f7a8c010070 2023-10-05T19:52:50.899 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.893+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:16 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af1f20 2023-10-05T19:52:50.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c02e040 con 0x55e934af1f20 2023-10-05T19:52:50.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:17 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af4660 2023-10-05T19:52:50.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a78008a30 con 0x55e934af4660 2023-10-05T19:52:50.900 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:18 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.901 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af1f20 2023-10-05T19:52:50.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c02e040 con 0x55e934af1f20 2023-10-05T19:52:50.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af4660 2023-10-05T19:52:50.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a78008a30 con 0x55e934af4660 2023-10-05T19:52:50.902 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:22 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.903 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.897+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:23 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.904 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:24 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af4660 2023-10-05T19:52:50.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a78008a30 con 0x55e934af4660 2023-10-05T19:52:50.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:25 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x7f7a8c010070 2023-10-05T19:52:50.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c02e040 con 0x7f7a8c010070 2023-10-05T19:52:50.905 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934b05cc0 2023-10-05T19:52:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:27 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x7f7a8c010070 2023-10-05T19:52:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c02e040 con 0x7f7a8c010070 2023-10-05T19:52:50.906 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:28 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af4660 2023-10-05T19:52:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a78008a30 con 0x55e934af4660 2023-10-05T19:52:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:29 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x7f7a8c010070 2023-10-05T19:52:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c02e040 con 0x7f7a8c010070 2023-10-05T19:52:50.907 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.901+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:30 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af1f20 2023-10-05T19:52:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c02e040 con 0x55e934af1f20 2023-10-05T19:52:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:31 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af1f20 2023-10-05T19:52:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c02e040 con 0x55e934af1f20 2023-10-05T19:52:50.908 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:32 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af4660 2023-10-05T19:52:50.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a78008a30 con 0x55e934af4660 2023-10-05T19:52:50.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a8801c700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af1f20 2023-10-05T19:52:50.909 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=178b] v32'4 uv4 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f7a8c02e040 con 0x55e934af1f20 2023-10-05T19:52:50.910 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b0c400 con 0x55e934af1f20 2023-10-05T19:52:50.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7a8c02e040 con 0x55e934af1f20 2023-10-05T19:52:50.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a92ce8e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:50.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a92ce8e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:50.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a92ce8e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:50.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a92ce8e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:50.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a92ce8e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.911 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:35 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b08990 con 0x55e934b05cc0 2023-10-05T19:52:50.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(35 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+1036 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a92ce8e40 20 rados_obj.operate() r=0 bl.length=1036 2023-10-05T19:52:50.912 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.905+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:36 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [delete,create,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e934b08d90 con 0x55e934b05cc0 2023-10-05T19:52:50.913 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a9081d700 1 -- 172.21.15.167:0/3023590753 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(36 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [delete,create,writefull 0~874] v32'4 uv4 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7a80016070 con 0x55e934b05cc0 2023-10-05T19:52:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e934af1f20 msgr2=0x55e934af23c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55e934af1f20 0x55e934af23c0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e934b05cc0 msgr2=0x55e934b080a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55e934b05cc0 0x55e934b080a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a8c010070 msgr2=0x7f7a8c010950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f7a8c010070 0x7f7a8c010950 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e934af4660 msgr2=0x55e934b0bec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55e934af4660 0x55e934b0bec0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.916 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a70030c50 msgr2=0x7f7a70033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f7a70030c50 0x7f7a70033100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c00a3e0 tx=0x7f7a8c005880 comp rx=0 tx=0).stop 2023-10-05T19:52:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 msgr2=0x55e934abbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/3023590753 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934a95b70 0x55e934abbb00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7a800018e0 tx=0x7f7a80016000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 reap_dead start 2023-10-05T19:52:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.909+0000 7f7a9101e700 1 -- 172.21.15.167:0/3023590753 reap_dead start 2023-10-05T19:52:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 shutdown_connections 2023-10-05T19:52:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 >> 172.21.15.167:0/3023590753 conn(0x55e934a09530 msgr2=0x55e934aaf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 shutdown_connections 2023-10-05T19:52:50.917 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/3023590753 wait complete. 2023-10-05T19:52:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1615472251 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79e0030c00 msgr2=0x7f79e00330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/1615472251 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79e0030c00 0x7f79e00330b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7a780030a0 tx=0x7f7a78015000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1615472251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 msgr2=0x55e934ad44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/1615472251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934ad44a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7a8002eee0 tx=0x7f7a80036000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.918 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1615472251 shutdown_connections 2023-10-05T19:52:50.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/1615472251 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f79e0030c00 0x7f79e00330b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 --2- 172.21.15.167:0/1615472251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55e934acd260 0x55e934ad44a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1615472251 >> 172.21.15.167:0/1615472251 conn(0x55e934a9a150 msgr2=0x55e934ac9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1615472251 shutdown_connections 2023-10-05T19:52:50.919 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.913+0000 7f7a92ce8e40 1 -- 172.21.15.167:0/1615472251 wait complete. 2023-10-05T19:52:50.919 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:50.919 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2", 2023-10-05T19:52:50.919 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "default", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "domain_root": "default.rgw.meta:root", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "control_pool": "default.rgw.control", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "gc_pool": "default.rgw.log:gc", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "lc_pool": "default.rgw.log:lc", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "log_pool": "default.rgw.log", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "intent_log_pool": "default.rgw.log:intent", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "usage_log_pool": "default.rgw.log:usage", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "roles_pool": "default.rgw.meta:roles", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "reshard_pool": "default.rgw.log:reshard", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "user_keys_pool": "default.rgw.meta:users.keys", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "user_email_pool": "default.rgw.meta:users.email", 2023-10-05T19:52:50.920 INFO:teuthology.orchestra.run.smithi167.stdout: "user_swift_pool": "default.rgw.meta:users.swift", 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "user_uid_pool": "default.rgw.meta:users.uid", 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "otp_pool": "default.rgw.otp", 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "system_key": { 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "", 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "" 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_pools": [ 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "key": "default-placement", 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "val": { 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "index_pool": "default.rgw.buckets.index", 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "storage_classes": { 2023-10-05T19:52:50.921 INFO:teuthology.orchestra.run.smithi167.stdout: "STANDARD": { 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: "data_pool": "default.rgw.buckets.data" 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: "data_extra_pool": "default.rgw.buckets.non-ec", 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: "index_type": 0, 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: "inline_data": "true" 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: "realm_id": "", 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout: "notif_pool": "default.rgw.log:notif" 2023-10-05T19:52:50.922 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:50.923 DEBUG:tasks.util.rgw: json result: {'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': 'true'}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T19:52:50.923 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2023-10-05T19:52:50.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2023-10-05T19:52:50.924 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2023-10-05T19:52:50.962 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:50.963 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:50.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.957+0000 7f4084910e40 1 Processor -- start 2023-10-05T19:52:50.963 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.957+0000 7f4084910e40 1 -- start start 2023-10-05T19:52:50.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x555b188c77f0 0x555b188c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555b18815c00 con 0x555b188c8100 2023-10-05T19:52:50.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x555b187d2ee0 con 0x555b188c77f0 2023-10-05T19:52:50.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4082445700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x555b188c77f0 0x555b188c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.964 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4081c44700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x555b188c8100 0x555b188c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60424/0 (socket says 172.21.15.167:60424) 2023-10-05T19:52:50.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4081c44700 1 -- 172.21.15.167:0/1321947618 learned_addr learned my addr 172.21.15.167:0/1321947618 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:50.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4082445700 1 -- 172.21.15.167:0/1321947618 >> v1:172.21.15.118:6789/0 conn(0x555b188c8100 legacy=0x555b188c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4082445700 1 -- 172.21.15.167:0/1321947618 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b188c92b0 con 0x555b188c77f0 2023-10-05T19:52:50.965 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4082445700 1 --2- 172.21.15.167:0/1321947618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188c7bc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f407c00a5d0 tx=0x7f407c005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a7aab118d1ac1e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4081443700 1 -- 172.21.15.167:0/1321947618 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407c007610 con 0x555b188c77f0 2023-10-05T19:52:50.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4081443700 1 -- 172.21.15.167:0/1321947618 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c007770 con 0x555b188c77f0 2023-10-05T19:52:50.966 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4081443700 1 -- 172.21.15.167:0/1321947618 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407c007a60 con 0x555b188c77f0 2023-10-05T19:52:50.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 -- 172.21.15.167:0/1321947618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 msgr2=0x555b188c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 --2- 172.21.15.167:0/1321947618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188c7bc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f407c00a5d0 tx=0x7f407c005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:50.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 -- 172.21.15.167:0/1321947618 shutdown_connections 2023-10-05T19:52:50.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 --2- 172.21.15.167:0/1321947618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188c7bc0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 -- 172.21.15.167:0/1321947618 >> 172.21.15.167:0/1321947618 conn(0x555b188c3210 msgr2=0x555b188c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 -- 172.21.15.167:0/1321947618 shutdown_connections 2023-10-05T19:52:50.967 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 -- 172.21.15.167:0/1321947618 wait complete. 2023-10-05T19:52:50.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 Processor -- start 2023-10-05T19:52:50.968 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.961+0000 7f4084910e40 1 -- start start 2023-10-05T19:52:50.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188e7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b18796e30 con 0x555b188c77f0 2023-10-05T19:52:50.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4082445700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4082445700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188e7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48326/0 (socket says 172.21.15.167:48326) 2023-10-05T19:52:50.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4082445700 1 -- 172.21.15.167:0/2400425476 learned_addr learned my addr 172.21.15.167:0/2400425476 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.969 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4082445700 1 -- 172.21.15.167:0/2400425476 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c005cf0 con 0x555b188c77f0 2023-10-05T19:52:50.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4082445700 1 --2- 172.21.15.167:0/2400425476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188e7940 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f407c00ad20 tx=0x7f407c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7a257dba81d68e server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f407bfff700 1 -- 172.21.15.167:0/2400425476 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407c0078e0 con 0x555b188c77f0 2023-10-05T19:52:50.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f407bfff700 1 -- 172.21.15.167:0/2400425476 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c007a60 con 0x555b188c77f0 2023-10-05T19:52:50.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f407bfff700 1 -- 172.21.15.167:0/2400425476 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407c007d50 con 0x555b188c77f0 2023-10-05T19:52:50.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 -- 172.21.15.167:0/2400425476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 msgr2=0x555b188e7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 --2- 172.21.15.167:0/2400425476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188e7940 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f407c00ad20 tx=0x7f407c013000 comp rx=0 tx=0).stop 2023-10-05T19:52:50.970 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 -- 172.21.15.167:0/2400425476 shutdown_connections 2023-10-05T19:52:50.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 --2- 172.21.15.167:0/2400425476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188e7940 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 -- 172.21.15.167:0/2400425476 >> 172.21.15.167:0/2400425476 conn(0x555b188c3210 msgr2=0x555b188e3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 -- 172.21.15.167:0/2400425476 shutdown_connections 2023-10-05T19:52:50.971 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 -- 172.21.15.167:0/2400425476 wait complete. 2023-10-05T19:52:50.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 Processor -- start 2023-10-05T19:52:50.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 -- start start 2023-10-05T19:52:50.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4084910e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b18769ed0 con 0x555b188c77f0 2023-10-05T19:52:50.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4082445700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4082445700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188ee5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48340/0 (socket says 172.21.15.167:48340) 2023-10-05T19:52:50.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.965+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 learned_addr learned my addr 172.21.15.167:0/1312693516 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.972 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b188c92b0 con 0x555b188c77f0 2023-10-05T19:52:50.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4082445700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188ee5d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f407c021040 tx=0x7f407c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f407a7fc700 1 -- 172.21.15.167:0/1312693516 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407c0078e0 con 0x555b188c77f0 2023-10-05T19:52:50.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f407a7fc700 1 -- 172.21.15.167:0/1312693516 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c01e440 con 0x555b188c77f0 2023-10-05T19:52:50.973 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b188eeb10 con 0x555b188c77f0 2023-10-05T19:52:50.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f407a7fc700 1 -- 172.21.15.167:0/1312693516 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407c01e710 con 0x555b188c77f0 2023-10-05T19:52:50.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b188eefb0 con 0x555b188c77f0 2023-10-05T19:52:50.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4084910e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:50.974 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4084910e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:50.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4084910e40 1 Processor -- start 2023-10-05T19:52:50.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4084910e40 1 -- start start 2023-10-05T19:52:50.975 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f407a7fc700 1 -- 172.21.15.167:0/1312693516 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f407c02f070 con 0x555b188c77f0 2023-10-05T19:52:50.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4084910e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b189025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4084910e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b18902b30 con 0x555b18902220 2023-10-05T19:52:50.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f407a7fc700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4068030c90 0x7f4068033140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4082c46700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b189025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4082c46700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b189025f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48348/0 (socket says 172.21.15.167:48348) 2023-10-05T19:52:50.976 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f4082c46700 1 -- 172.21.15.167:0/1217363537 learned_addr learned my addr 172.21.15.167:0/1217363537 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.969+0000 7f407a7fc700 1 -- 172.21.15.167:0/1312693516 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f407c02d070 con 0x555b188c77f0 2023-10-05T19:52:50.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4082445700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4068030c90 0x7f4068033140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4082c46700 1 -- 172.21.15.167:0/1217363537 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b18902c70 con 0x555b18902220 2023-10-05T19:52:50.977 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4082c46700 1 --2- 172.21.15.167:0/1217363537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b189025f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f407400a320 tx=0x7f40740059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ad347fedefff2c server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4082445700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4068030c90 0x7f4068033140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f407c0114f0 tx=0x7f407c043520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.978 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4052fed700 1 -- 172.21.15.167:0/1217363537 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407400ae30 con 0x555b18902220 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4052fed700 1 -- 172.21.15.167:0/1217363537 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407400c610 con 0x555b18902220 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4052fed700 1 -- 172.21.15.167:0/1217363537 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f407400c7c0 con 0x555b18902220 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 -- 172.21.15.167:0/1217363537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 msgr2=0x555b189025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 --2- 172.21.15.167:0/1217363537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b189025f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f407400a320 tx=0x7f40740059d0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 -- 172.21.15.167:0/1217363537 shutdown_connections 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 --2- 172.21.15.167:0/1217363537 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b189025f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 -- 172.21.15.167:0/1217363537 >> 172.21.15.167:0/1217363537 conn(0x555b188c8100 msgr2=0x555b188cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 -- 172.21.15.167:0/1217363537 shutdown_connections 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 -- 172.21.15.167:0/1217363537 wait complete. 2023-10-05T19:52:50.979 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 Processor -- start 2023-10-05T19:52:50.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 -- start start 2023-10-05T19:52:50.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b18909050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.981 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4084910e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b1890a050 con 0x555b18902220 2023-10-05T19:52:50.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4082c46700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b18909050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4082c46700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b18909050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48350/0 (socket says 172.21.15.167:48350) 2023-10-05T19:52:50.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.973+0000 7f4082c46700 1 -- 172.21.15.167:0/3968044980 learned_addr learned my addr 172.21.15.167:0/3968044980 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:50.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4082c46700 1 -- 172.21.15.167:0/3968044980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4074005c90 con 0x555b18902220 2023-10-05T19:52:50.983 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4082c46700 1 --2- 172.21.15.167:0/3968044980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b18909050 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x555b188ccbd0 tx=0x7f4074013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f40517ea700 1 -- 172.21.15.167:0/3968044980 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4074015660 con 0x555b18902220 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f40517ea700 1 -- 172.21.15.167:0/3968044980 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40740157c0 con 0x555b18902220 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4084910e40 1 -- 172.21.15.167:0/3968044980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b18909650 con 0x555b18902220 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f40517ea700 1 -- 172.21.15.167:0/3968044980 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4074015ab0 con 0x555b18902220 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4084910e40 1 -- 172.21.15.167:0/3968044980 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b18909b10 con 0x555b18902220 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f40517ea700 1 -- 172.21.15.167:0/3968044980 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f4074007050 con 0x555b18902220 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f40517ea700 1 --2- 172.21.15.167:0/3968044980 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3fd0030c50 0x7f3fd0033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f40517ea700 1 -- 172.21.15.167:0/3968044980 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f40740441d0 con 0x555b18902220 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4081c44700 1 --2- 172.21.15.167:0/3968044980 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3fd0030c50 0x7f3fd0033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4084910e40 20 try_to_resolve_local_entities(): before: realm_id= realm_name= zonegroup_id= zonegroup_name= zone_id= zone_name= 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f3fcaffd700 20 reqs_thread_entry: start 2023-10-05T19:52:50.984 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4084910e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555b18926d30 0x555b18927170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189276b0 con 0x555b18926d30 2023-10-05T19:52:50.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4081c44700 1 --2- 172.21.15.167:0/3968044980 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3fd0030c50 0x7f3fd0033100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f406c0044f0 tx=0x7f406c006670 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4082c46700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555b18926d30 0x555b18927170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.985 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.977+0000 7f4082c46700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555b18926d30 0x555b18927170 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555b1893a730 0x555b1893cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b1893d050 con 0x555b1893a730 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4082445700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555b1893a730 0x555b1893cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4082445700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555b1893a730 0x555b1893cb10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:50.987 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:50.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b1893d400 con 0x555b18926d30 2023-10-05T19:52:50.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(3 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:50.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:50.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555b1893ecd0 0x555b189410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:4 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893ecd0 2023-10-05T19:52:50.988 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4081c44700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555b1893ecd0 0x555b189410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.981+0000 7f4081c44700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555b1893ecd0 0x555b189410b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(4 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406c0060d0 con 0x555b1893ecd0 2023-10-05T19:52:50.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:5 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893a730 2023-10-05T19:52:50.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:50.989 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082445700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f407c03c040 0x7f407c01e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:50.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:6 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x7f407c03c040 2023-10-05T19:52:50.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082c46700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f407c03c040 0x7f407c01e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:50.990 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082c46700 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f407c03c040 0x7f407c01e900 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:50.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x7f407c03c040 2023-10-05T19:52:50.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:7 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:50.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:50.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:8 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:50.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:50.991 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:9 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893ecd0 2023-10-05T19:52:50.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406c0045c0 con 0x555b1893ecd0 2023-10-05T19:52:50.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.985+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:50.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:50.992 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:11 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893a730 2023-10-05T19:52:50.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:50.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:12 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893a730 2023-10-05T19:52:50.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:50.993 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:13 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:50.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(13 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:50.994 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:14 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x7f407c03c040 2023-10-05T19:52:50.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x7f407c03c040 2023-10-05T19:52:50.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:50.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:50.995 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.989+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x7f407c03c040 2023-10-05T19:52:50.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x7f407c03c040 2023-10-05T19:52:50.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:17 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893a730 2023-10-05T19:52:50.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:50.996 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:18 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893ecd0 2023-10-05T19:52:50.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406c0045c0 con 0x555b1893ecd0 2023-10-05T19:52:50.997 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:19 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:50.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:50.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:20 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893a730 2023-10-05T19:52:50.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:50.998 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:21 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893ecd0 2023-10-05T19:52:50.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406c01d040 con 0x555b1893ecd0 2023-10-05T19:52:50.999 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.993+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:22 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:51.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:51.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:23 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:51.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:51.000 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:51.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:51.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:25 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893ecd0 2023-10-05T19:52:51.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406c01d040 con 0x555b1893ecd0 2023-10-05T19:52:51.001 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:26 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x7f407c03c040 2023-10-05T19:52:51.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x7f407c03c040 2023-10-05T19:52:51.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:27 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b18926d30 2023-10-05T19:52:51.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:51.002 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x7f407c03c040 2023-10-05T19:52:51.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x7f407c03c040 2023-10-05T19:52:51.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:50.997+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:29 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893ecd0 2023-10-05T19:52:51.003 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406c01d040 con 0x555b1893ecd0 2023-10-05T19:52:51.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x7f407c03c040 2023-10-05T19:52:51.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4074021580 con 0x7f407c03c040 2023-10-05T19:52:51.004 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:31 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893a730 2023-10-05T19:52:51.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:51.005 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:32 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893a730 2023-10-05T19:52:51.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:51.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:33 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893ecd0 2023-10-05T19:52:51.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f406c01d040 con 0x555b1893ecd0 2023-10-05T19:52:51.006 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4081c44700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893a730 2023-10-05T19:52:51.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=178b] v32'4 uv4 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:51.007 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.001+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:35 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b189415f0 con 0x555b1893a730 2023-10-05T19:52:51.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:51.008 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:51.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:51.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:51.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:51.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:36 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b1893d7b0 con 0x555b18926d30 2023-10-05T19:52:51.009 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(36 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4074021580 con 0x555b18926d30 2023-10-05T19:52:51.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b1893dbb0 con 0x555b1893a730 2023-10-05T19:52:51.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(37 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:51.010 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:51.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:38 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555b1893dfe0 con 0x555b1893a730 2023-10-05T19:52:51.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4082445700 1 -- 172.21.15.167:0/1312693516 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(38 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f407c00fdb0 con 0x555b1893a730 2023-10-05T19:52:51.011 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.005+0000 7f4084910e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:51.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555b1893a730 msgr2=0x555b1893cb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x555b1893a730 0x555b1893cb10 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.013 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555b18926d30 msgr2=0x555b18927170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x555b18926d30 0x555b18927170 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f407c03c040 msgr2=0x7f407c01e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f407c03c040 0x7f407c01e900 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555b1893ecd0 msgr2=0x555b189410b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x555b1893ecd0 0x555b189410b0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4068030c90 msgr2=0x7f4068033140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f4068030c90 0x7f4068033140 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f407c0114f0 tx=0x7f407c043520 comp rx=0 tx=0).stop 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4082c46700 1 -- 172.21.15.167:0/1312693516 reap_dead start 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 msgr2=0x555b188ee5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188ee5d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f407c021040 tx=0x7f407c01b000 comp rx=0 tx=0).stop 2023-10-05T19:52:51.014 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 shutdown_connections 2023-10-05T19:52:51.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/1312693516 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b188c77f0 0x555b188ee5d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 >> 172.21.15.167:0/1312693516 conn(0x555b188c3210 msgr2=0x555b188e1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:51.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 shutdown_connections 2023-10-05T19:52:51.015 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/1312693516 wait complete. 2023-10-05T19:52:51.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/3968044980 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3fd0030c50 msgr2=0x7f3fd0033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/3968044980 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3fd0030c50 0x7f3fd0033100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f406c0044f0 tx=0x7f406c006670 comp rx=0 tx=0).stop 2023-10-05T19:52:51.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/3968044980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 msgr2=0x555b18909050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/3968044980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b18909050 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x555b188ccbd0 tx=0x7f4074013000 comp rx=0 tx=0).stop 2023-10-05T19:52:51.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/3968044980 shutdown_connections 2023-10-05T19:52:51.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/3968044980 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3fd0030c50 0x7f3fd0033100 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 --2- 172.21.15.167:0/3968044980 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x555b18902220 0x555b18909050 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/3968044980 >> 172.21.15.167:0/3968044980 conn(0x555b188c8100 msgr2=0x555b188cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:51.016 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/3968044980 shutdown_connections 2023-10-05T19:52:51.017 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.009+0000 7f4084910e40 1 -- 172.21.15.167:0/3968044980 wait complete. 2023-10-05T19:52:51.017 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:51.017 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "62f730cc-f2d2-47e0-99d9-6d51a9a03581", 2023-10-05T19:52:51.017 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "default", 2023-10-05T19:52:51.017 INFO:teuthology.orchestra.run.smithi167.stdout: "api_name": "default", 2023-10-05T19:52:51.017 INFO:teuthology.orchestra.run.smithi167.stdout: "is_master": "true", 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "endpoints": [], 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "hostnames": [], 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "hostnames_s3website": [], 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "master_zone": "e814e647-c2a9-43bf-96a6-1088a1b789e2", 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "zones": [ 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "id": "e814e647-c2a9-43bf-96a6-1088a1b789e2", 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "default", 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "endpoints": [], 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "log_meta": "false", 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "log_data": "false", 2023-10-05T19:52:51.018 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_index_max_shards": 11, 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "read_only": "false", 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "tier_type": "", 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_from_all": "true", 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_from": [], 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "redirect_zone": "" 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_targets": [ 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "name": "default-placement", 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "tags": [], 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "storage_classes": [ 2023-10-05T19:52:51.019 INFO:teuthology.orchestra.run.smithi167.stdout: "STANDARD" 2023-10-05T19:52:51.020 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2023-10-05T19:52:51.020 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:51.020 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:51.020 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "default-placement", 2023-10-05T19:52:51.020 INFO:teuthology.orchestra.run.smithi167.stdout: "realm_id": "", 2023-10-05T19:52:51.020 INFO:teuthology.orchestra.run.smithi167.stdout: "sync_policy": { 2023-10-05T19:52:51.020 INFO:teuthology.orchestra.run.smithi167.stdout: "groups": [] 2023-10-05T19:52:51.020 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:51.020 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:51.021 DEBUG:tasks.util.rgw: json result: {'id': '62f730cc-f2d2-47e0-99d9-6d51a9a03581', 'name': 'default', 'api_name': 'default', 'is_master': 'true', 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'e814e647-c2a9-43bf-96a6-1088a1b789e2', 'zones': [{'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2', 'name': 'default', 'endpoints': [], 'log_meta': 'false', 'log_data': 'false', 'bucket_index_max_shards': 11, 'read_only': 'false', 'tier_type': '', 'sync_from_all': 'true', 'sync_from': [], 'redirect_zone': ''}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}} 2023-10-05T19:52:51.024 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2023-10-05T19:52:51.039 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2023-10-05T19:52:51.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2023-10-05T19:52:51.039 DEBUG:teuthology.orchestra.run.smithi167:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2023-10-05T19:52:51.113 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setuser ceph since I am not root 2023-10-05T19:52:51.113 INFO:teuthology.orchestra.run.smithi167.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T19:52:51.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f3261344e40 1 Processor -- start 2023-10-05T19:52:51.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f3261344e40 1 -- start start 2023-10-05T19:52:51.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f3261344e40 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55bb9ba60dd0 0x55bb9ba611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f3261344e40 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bb9ba37bd0 con 0x55bb9ba616e0 2023-10-05T19:52:51.114 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f3261344e40 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bb9b9f4ee0 con 0x55bb9ba60dd0 2023-10-05T19:52:51.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f325ee79700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x55bb9ba60dd0 0x55bb9ba611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f325e678700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x55bb9ba616e0 0x55bb9ba62180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.167:60426/0 (socket says 172.21.15.167:60426) 2023-10-05T19:52:51.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f325e678700 1 -- 172.21.15.167:0/2630770257 learned_addr learned my addr 172.21.15.167:0/2630770257 (peer_addr_for_me v1:172.21.15.167:0/0) 2023-10-05T19:52:51.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f325ee79700 1 -- 172.21.15.167:0/2630770257 >> v1:172.21.15.118:6789/0 conn(0x55bb9ba616e0 legacy=0x55bb9ba62180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f325de77700 1 -- 172.21.15.167:0/2630770257 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842588962 0 0) 0x55bb9ba37bd0 con 0x55bb9ba616e0 2023-10-05T19:52:51.115 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f325ee79700 1 -- 172.21.15.167:0/2630770257 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb9ba62890 con 0x55bb9ba60dd0 2023-10-05T19:52:51.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.109+0000 7f325ee79700 1 --2- 172.21.15.167:0/2630770257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9ba611a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f325000a5d0 tx=0x7f3250005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7adc794a5600bbc server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f325de77700 1 -- 172.21.15.167:0/2630770257 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32500086a0 con 0x55bb9ba60dd0 2023-10-05T19:52:51.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f325de77700 1 -- 172.21.15.167:0/2630770257 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250008800 con 0x55bb9ba60dd0 2023-10-05T19:52:51.116 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f325de77700 1 -- 172.21.15.167:0/2630770257 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3250008ad0 con 0x55bb9ba60dd0 2023-10-05T19:52:51.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f3261344e40 1 -- 172.21.15.167:0/2630770257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 msgr2=0x55bb9ba611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.117 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f3261344e40 1 --2- 172.21.15.167:0/2630770257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9ba611a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f325000a5d0 tx=0x7f3250005a50 comp rx=0 tx=0).stop 2023-10-05T19:52:51.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f3261344e40 1 -- 172.21.15.167:0/2630770257 shutdown_connections 2023-10-05T19:52:51.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f3261344e40 1 --2- 172.21.15.167:0/2630770257 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9ba611a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f3261344e40 1 -- 172.21.15.167:0/2630770257 >> 172.21.15.167:0/2630770257 conn(0x55bb9ba604e0 msgr2=0x55bb9baeae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:51.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f3261344e40 1 -- 172.21.15.167:0/2630770257 shutdown_connections 2023-10-05T19:52:51.118 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f3261344e40 1 -- 172.21.15.167:0/2630770257 wait complete. 2023-10-05T19:52:51.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.113+0000 7f3261344e40 1 Processor -- start 2023-10-05T19:52:51.119 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 -- start start 2023-10-05T19:52:51.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb0ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb9b9b8e30 con 0x55bb9ba60dd0 2023-10-05T19:52:51.120 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f325ee79700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb0ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f325ee79700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb0ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48370/0 (socket says 172.21.15.167:48370) 2023-10-05T19:52:51.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f325ee79700 1 -- 172.21.15.167:0/847782312 learned_addr learned my addr 172.21.15.167:0/847782312 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:51.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f325ee79700 1 -- 172.21.15.167:0/847782312 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3250005cf0 con 0x55bb9ba60dd0 2023-10-05T19:52:51.121 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f325ee79700 1 --2- 172.21.15.167:0/847782312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb0ff30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3250005cc0 tx=0x7f3250015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0e5c06533e4ee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f325ce75700 1 -- 172.21.15.167:0/847782312 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3250008970 con 0x55bb9ba60dd0 2023-10-05T19:52:51.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f325ce75700 1 -- 172.21.15.167:0/847782312 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250008ad0 con 0x55bb9ba60dd0 2023-10-05T19:52:51.122 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f325ce75700 1 -- 172.21.15.167:0/847782312 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3250008dc0 con 0x55bb9ba60dd0 2023-10-05T19:52:51.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 -- 172.21.15.167:0/847782312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 msgr2=0x55bb9bb0ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 --2- 172.21.15.167:0/847782312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb0ff30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3250005cc0 tx=0x7f3250015000 comp rx=0 tx=0).stop 2023-10-05T19:52:51.123 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 -- 172.21.15.167:0/847782312 shutdown_connections 2023-10-05T19:52:51.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 --2- 172.21.15.167:0/847782312 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb0ff30 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 -- 172.21.15.167:0/847782312 >> 172.21.15.167:0/847782312 conn(0x55bb9ba604e0 msgr2=0x55bb9bb0ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:51.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 -- 172.21.15.167:0/847782312 shutdown_connections 2023-10-05T19:52:51.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.117+0000 7f3261344e40 1 -- 172.21.15.167:0/847782312 wait complete. 2023-10-05T19:52:51.124 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f3261344e40 1 Processor -- start 2023-10-05T19:52:51.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f3261344e40 1 -- start start 2023-10-05T19:52:51.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f3261344e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb16b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f3261344e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb9b98bed0 con 0x55bb9ba60dd0 2023-10-05T19:52:51.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f325ee79700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb16b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.125 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f325ee79700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb16b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48386/0 (socket says 172.21.15.167:48386) 2023-10-05T19:52:51.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 learned_addr learned my addr 172.21.15.167:0/498180932 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:51.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb9ba62890 con 0x55bb9ba60dd0 2023-10-05T19:52:51.126 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f325ee79700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb16b40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f325001e040 tx=0x7f325001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f3256ffd700 1 -- 172.21.15.167:0/498180932 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32500086a0 con 0x55bb9ba60dd0 2023-10-05T19:52:51.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f3256ffd700 1 -- 172.21.15.167:0/498180932 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325002a070 con 0x55bb9ba60dd0 2023-10-05T19:52:51.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bb9bb17080 con 0x55bb9ba60dd0 2023-10-05T19:52:51.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f3256ffd700 1 -- 172.21.15.167:0/498180932 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3250012cd0 con 0x55bb9ba60dd0 2023-10-05T19:52:51.127 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.121+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb9bb17520 con 0x55bb9ba60dd0 2023-10-05T19:52:51.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.128 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3256ffd700 1 -- 172.21.15.167:0/498180932 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3250019070 con 0x55bb9ba60dd0 2023-10-05T19:52:51.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3256ffd700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3240030c50 0x7f3240033100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3256ffd700 1 -- 172.21.15.167:0/498180932 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f325002c070 con 0x55bb9ba60dd0 2023-10-05T19:52:51.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f325e678700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3240030c50 0x7f3240033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.129 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bb9ba616e0 0x55bb9bb22630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb22c50 con 0x55bb9ba616e0 2023-10-05T19:52:51.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f325e678700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3240030c50 0x7f3240033100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3258001560 tx=0x7f3258006650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f325f67a700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bb9ba616e0 0x55bb9bb22630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.130 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f325f67a700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bb9ba616e0 0x55bb9bb22630 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f324800a500 con 0x55bb9ba616e0 2023-10-05T19:52:51.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 20 realm 2023-10-05T19:52:51.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb1fc90 con 0x55bb9ba616e0 2023-10-05T19:52:51.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f324800a500 con 0x55bb9ba616e0 2023-10-05T19:52:51.132 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T19:52:51.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.125+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb23730 con 0x55bb9ba616e0 2023-10-05T19:52:51.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f324800a500 con 0x55bb9ba616e0 2023-10-05T19:52:51.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bb9bb24560 0x55bb9bb26940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb26e80 con 0x55bb9bb24560 2023-10-05T19:52:51.133 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f325ee79700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bb9bb24560 0x55bb9bb26940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f325ee79700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bb9bb24560 0x55bb9bb26940 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3250022020 con 0x55bb9bb24560 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:5 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb27720 con 0x55bb9ba616e0 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 4 ==== osd_op_reply(5 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f324800a500 con 0x55bb9ba616e0 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 20 searching for the correct realm 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bb9bb294e0 0x55bb9bb2b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.135 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb294e0 2023-10-05T19:52:51.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f325e678700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bb9bb294e0 0x55bb9bb2b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.129+0000 7f325e678700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bb9bb294e0 0x55bb9bb2b8c0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3258004520 con 0x55bb9bb294e0 2023-10-05T19:52:51.136 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb24560 2023-10-05T19:52:51.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250022020 con 0x55bb9bb24560 2023-10-05T19:52:51.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325ee79700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3250007030 0x7f3250026400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x7f3250007030 2023-10-05T19:52:51.137 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325f67a700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3250007030 0x7f3250026400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325f67a700 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3250007030 0x7f3250026400 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x7f3250007030 2023-10-05T19:52:51.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.138 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb294e0 2023-10-05T19:52:51.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3258004520 con 0x55bb9bb294e0 2023-10-05T19:52:51.139 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.133+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 7 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.140 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb24560 2023-10-05T19:52:51.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250022020 con 0x55bb9bb24560 2023-10-05T19:52:51.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb24560 2023-10-05T19:52:51.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 4 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250022020 con 0x55bb9bb24560 2023-10-05T19:52:51.141 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x7f3250007030 2023-10-05T19:52:51.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x7f3250007030 2023-10-05T19:52:51.142 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x7f3250007030 2023-10-05T19:52:51.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x7f3250007030 2023-10-05T19:52:51.143 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.137+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb24560 2023-10-05T19:52:51.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 5 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325004f040 con 0x55bb9bb24560 2023-10-05T19:52:51.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb294e0 2023-10-05T19:52:51.144 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3258004520 con 0x55bb9bb294e0 2023-10-05T19:52:51.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 10 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.145 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb24560 2023-10-05T19:52:51.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325004f040 con 0x55bb9bb24560 2023-10-05T19:52:51.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb294e0 2023-10-05T19:52:51.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.146 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 11 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.147 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 12 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.141+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 13 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.148 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb294e0 2023-10-05T19:52:51.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x7f3250007030 2023-10-05T19:52:51.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x7f3250007030 2023-10-05T19:52:51.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9ba616e0 2023-10-05T19:52:51.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 14 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.149 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x7f3250007030 2023-10-05T19:52:51.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x7f3250007030 2023-10-05T19:52:51.150 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb294e0 2023-10-05T19:52:51.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x7f3250007030 2023-10-05T19:52:51.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x7f3250007030 2023-10-05T19:52:51.151 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.145+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb24560 2023-10-05T19:52:51.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325004f040 con 0x55bb9bb24560 2023-10-05T19:52:51.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb24560 2023-10-05T19:52:51.152 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325004f040 con 0x55bb9bb24560 2023-10-05T19:52:51.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb294e0 2023-10-05T19:52:51.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.153 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb24560 2023-10-05T19:52:51.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 9 ==== osd_op_reply(36 [pgnls start_epoch 32 out=178b] v32'4 uv4 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f325004f040 con 0x55bb9bb24560 2023-10-05T19:52:51.154 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2be00 con 0x55bb9bb24560 2023-10-05T19:52:51.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 10 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325004f040 con 0x55bb9bb24560 2023-10-05T19:52:51.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f3261344e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:51.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f3261344e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:51.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f3261344e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:51.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f3261344e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:51.155 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.149+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb28290 con 0x55bb9ba616e0 2023-10-05T19:52:51.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 15 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.156 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb28be0 con 0x55bb9bb24560 2023-10-05T19:52:51.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 11 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:51.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.157 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:40 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c1b0 con 0x55bb9bb24560 2023-10-05T19:52:51.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 12 ==== osd_op_reply(40 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:51.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.158 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:41 5.13 5:cbbf6c60:::converted:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c560 con 0x55bb9bb294e0 2023-10-05T19:52:51.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 8 ==== osd_op_reply(41 converted [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 153+0+0 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.159 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:42 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 16 ==== osd_op_reply(42 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.153+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:43 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb287b0 con 0x55bb9bb24560 2023-10-05T19:52:51.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 13 ==== osd_op_reply(43 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f3261344e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:51.160 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:44 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb28780 con 0x55bb9bb294e0 2023-10-05T19:52:51.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 9 ==== osd_op_reply(44 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.161 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:45 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb28780 con 0x55bb9bb24560 2023-10-05T19:52:51.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 14 ==== osd_op_reply(45 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:46 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c1b0 con 0x7f3250007030 2023-10-05T19:52:51.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 7 ==== osd_op_reply(46 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x7f3250007030 2023-10-05T19:52:51.162 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:47 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 17 ==== osd_op_reply(47 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.157+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:48 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.163 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 18 ==== osd_op_reply(48 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:49 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb294e0 2023-10-05T19:52:51.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 10 ==== osd_op_reply(49 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.164 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:50 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 19 ==== osd_op_reply(50 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:51 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb24560 2023-10-05T19:52:51.165 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 15 ==== osd_op_reply(51 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:52 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb24560 2023-10-05T19:52:51.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 16 ==== osd_op_reply(52 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.166 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:53 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 20 ==== osd_op_reply(53 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.161+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:54 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x7f3250007030 2023-10-05T19:52:51.167 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 8 ==== osd_op_reply(54 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x7f3250007030 2023-10-05T19:52:51.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:55 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 21 ==== osd_op_reply(55 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.168 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:56 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x7f3250007030 2023-10-05T19:52:51.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 9 ==== osd_op_reply(56 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x7f3250007030 2023-10-05T19:52:51.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:57 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb24560 2023-10-05T19:52:51.169 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 17 ==== osd_op_reply(57 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:58 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb294e0 2023-10-05T19:52:51.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 11 ==== osd_op_reply(58 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.170 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:59 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 22 ==== osd_op_reply(59 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.165+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:60 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb24560 2023-10-05T19:52:51.171 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 18 ==== osd_op_reply(60 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:61 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb294e0 2023-10-05T19:52:51.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 12 ==== osd_op_reply(61 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.172 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:62 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 23 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248014040 con 0x55bb9ba616e0 2023-10-05T19:52:51.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:63 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 24 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.173 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:64 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 25 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:65 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb294e0 2023-10-05T19:52:51.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.174 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:66 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x7f3250007030 2023-10-05T19:52:51.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 10 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:67 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9ba616e0 2023-10-05T19:52:51.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 26 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.175 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.169+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:68 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x7f3250007030 2023-10-05T19:52:51.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 11 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:69 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb294e0 2023-10-05T19:52:51.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 14 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.176 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:70 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x7f3250007030 2023-10-05T19:52:51.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.177 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:71 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb24560 2023-10-05T19:52:51.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:72 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb24560 2023-10-05T19:52:51.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 20 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.178 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:73 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb294e0 2023-10-05T19:52:51.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 15 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.179 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.173+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:74 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb24560 2023-10-05T19:52:51.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 21 ==== osd_op_reply(74 [pgnls start_epoch 32 out=178b] v32'4 uv4 ondisk = 1) v8 ==== 144+0+178 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.180 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:75 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c910 con 0x55bb9bb24560 2023-10-05T19:52:51.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 22 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3250059040 con 0x55bb9bb24560 2023-10-05T19:52:51.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 20 RGWRados::pool_iterate: got zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 2023-10-05T19:52:51.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T19:52:51.181 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T19:52:51.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 20 RGWRados::pool_iterate: got zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 2023-10-05T19:52:51.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.182 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:76 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb28780 con 0x55bb9bb24560 2023-10-05T19:52:51.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 23 ==== osd_op_reply(76 zone_names.default [read 0~46 out=46b] v0'0 uv4 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:51.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:77 5.12 5:48d4dbab:::zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2c1b0 con 0x55bb9ba616e0 2023-10-05T19:52:51.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 27 ==== osd_op_reply(77 zone_info.e814e647-c2a9-43bf-96a6-1088a1b789e2 [read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T19:52:51.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.183 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.177+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:78 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2d230 con 0x55bb9bb24560 2023-10-05T19:52:51.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 24 ==== osd_op_reply(78 zonegroups_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T19:52:51.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.184 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:79 5.f 5:f4dd67d2:::zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2d230 con 0x55bb9bb24560 2023-10-05T19:52:51.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 25 ==== osd_op_reply(79 zonegroup_info.62f730cc-f2d2-47e0-99d9-6d51a9a03581 [read 0~362 out=362b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+362 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados_obj.operate() r=0 bl.length=362 2023-10-05T19:52:51.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.185 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:80 5.3 5:c0ad8cbd:::region_map:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2d630 con 0x7f3250007030 2023-10-05T19:52:51.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 13 ==== osd_op_reply(80 region_map [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 zone default found 2023-10-05T19:52:51.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 4 Realm: () 2023-10-05T19:52:51.186 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 4 ZoneGroup: default (62f730cc-f2d2-47e0-99d9-6d51a9a03581) 2023-10-05T19:52:51.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 4 Zone: default (e814e647-c2a9-43bf-96a6-1088a1b789e2) 2023-10-05T19:52:51.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T19:52:51.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 zonegroup default 2023-10-05T19:52:51.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:81 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2d630 con 0x7f3250007030 2023-10-05T19:52:51.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 14 ==== osd_op_reply(81 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.187 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:82 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2efb0 con 0x55bb9bb294e0 2023-10-05T19:52:51.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 16 ==== osd_op_reply(82 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 20 rados->read ofs=0 len=0 2023-10-05T19:52:51.188 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.181+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:83 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2f360 con 0x55bb9bb294e0 2023-10-05T19:52:51.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.185+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 17 ==== osd_op_reply(83 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.185+0000 7f3261344e40 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T19:52:51.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.185+0000 7f3261344e40 20 started sync module instance, tier type = 2023-10-05T19:52:51.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.185+0000 7f3261344e40 20 started zone id=e814e647-c2a9-43bf-96a6-1088a1b789e2 (name=default) with tier type = 2023-10-05T19:52:51.189 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.185+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:84 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2e670 con 0x55bb9bb24560 2023-10-05T19:52:51.190 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.185+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 26 ==== osd_op_reply(84 notify.0 [create] v32'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.185+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:85 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94264259431616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2eb60 con 0x55bb9bb24560 2023-10-05T19:52:51.191 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.185+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:86 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb2fc00 con 0x55bb9ba616e0 2023-10-05T19:52:51.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.189+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 28 ==== osd_op_reply(86 notify.1 [create] v32'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.189+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:87 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94264259442448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb30050 con 0x55bb9ba616e0 2023-10-05T19:52:51.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.189+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 27 ==== osd_op_reply(85 notify.0 [watch watch cookie 94264259431616] v32'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.193 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.189+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:88 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb30a60 con 0x55bb9bb24560 2023-10-05T19:52:51.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.189+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 29 ==== osd_op_reply(87 notify.1 [watch watch cookie 94264259442448] v32'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.189+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 28 ==== osd_op_reply(88 notify.2 [create] v32'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.195 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.189+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:89 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94264259446128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb30050 con 0x55bb9bb24560 2023-10-05T19:52:51.196 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.193+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:90 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb309c0 con 0x7f3250007030 2023-10-05T19:52:51.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.193+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 29 ==== osd_op_reply(89 notify.2 [watch watch cookie 94264259446128] v32'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.193+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 15 ==== osd_op_reply(90 notify.3 [create] v32'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.193+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:91 7.e 7:7759931f:::notify.3:head [watch watch cookie 94264259447232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb30050 con 0x7f3250007030 2023-10-05T19:52:51.198 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.193+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:92 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb315c0 con 0x55bb9bb24560 2023-10-05T19:52:51.199 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.197+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 16 ==== osd_op_reply(91 notify.3 [watch watch cookie 94264259447232] v32'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.197+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 30 ==== osd_op_reply(92 notify.4 [create] v32'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.197+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:93 7.d 7:b4812045:::notify.4:head [watch watch cookie 94264259448976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb30050 con 0x55bb9bb24560 2023-10-05T19:52:51.200 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.197+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:94 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb32020 con 0x55bb9bb294e0 2023-10-05T19:52:51.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.197+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 18 ==== osd_op_reply(94 notify.5 [create] v32'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.197+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [watch watch cookie 94264259451696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb328c0 con 0x55bb9bb294e0 2023-10-05T19:52:51.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.197+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:96 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb332d0 con 0x55bb9bb294e0 2023-10-05T19:52:51.202 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.197+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 31 ==== osd_op_reply(93 notify.4 [watch watch cookie 94264259448976] v32'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 19 ==== osd_op_reply(95 notify.5 [watch watch cookie 94264259451696] v32'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 20 ==== osd_op_reply(96 notify.6 [create] v32'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:97 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94264259456480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb33680 con 0x55bb9bb294e0 2023-10-05T19:52:51.204 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:98 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb33f20 con 0x7f3250007030 2023-10-05T19:52:51.205 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 21 ==== osd_op_reply(97 notify.6 [watch watch cookie 94264259456480] v32'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 17 ==== osd_op_reply(98 notify.7 [create] v32'270 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:99 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94264259459632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb34370 con 0x7f3250007030 2023-10-05T19:52:51.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 20 add_watcher() i=0 2023-10-05T19:52:51.206 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 20 add_watcher() i=1 2023-10-05T19:52:51.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 20 add_watcher() i=2 2023-10-05T19:52:51.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 20 add_watcher() i=3 2023-10-05T19:52:51.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 20 add_watcher() i=4 2023-10-05T19:52:51.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 20 add_watcher() i=5 2023-10-05T19:52:51.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.201+0000 7f3261344e40 20 add_watcher() i=6 2023-10-05T19:52:51.207 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 18 ==== osd_op_reply(99 notify.7 [watch watch cookie 94264259459632] v32'271 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 20 add_watcher() i=7 2023-10-05T19:52:51.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 2 all 8 watchers are set, enabling cache 2023-10-05T19:52:51.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb374e0 con 0x55bb9ba616e0 2023-10-05T19:52:51.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 30 ==== osd_op_reply(100 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.208 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:101 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94264259460736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb347c0 con 0x55bb9ba616e0 2023-10-05T19:52:51.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 31 ==== osd_op_reply(101 data_loggenerations_metadata [watch watch cookie 94264259460736] v32'259 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.210 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f31abfff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:51.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T19:52:51.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T19:52:51.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 1 Processor -- start 2023-10-05T19:52:51.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 1 -- start start 2023-10-05T19:52:51.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.211 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f3261344e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb9bb42620 con 0x55bb9bb41d10 2023-10-05T19:52:51.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f325e678700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f325e678700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48390/0 (socket says 172.21.15.167:48390) 2023-10-05T19:52:51.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.205+0000 7f325e678700 1 -- 172.21.15.167:0/3881630931 learned_addr learned my addr 172.21.15.167:0/3881630931 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:51.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f325e678700 1 -- 172.21.15.167:0/3881630931 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb9bb42760 con 0x55bb9bb41d10 2023-10-05T19:52:51.212 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f325e678700 1 --2- 172.21.15.167:0/3881630931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb420e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3250032b80 tx=0x7f3258006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1c7360ad446f04 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f31ab7fe700 1 -- 172.21.15.167:0/3881630931 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f325801a040 con 0x55bb9bb41d10 2023-10-05T19:52:51.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f31ab7fe700 1 -- 172.21.15.167:0/3881630931 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325801b040 con 0x55bb9bb41d10 2023-10-05T19:52:51.213 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f31ab7fe700 1 -- 172.21.15.167:0/3881630931 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32580049a0 con 0x55bb9bb41d10 2023-10-05T19:52:51.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 -- 172.21.15.167:0/3881630931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 msgr2=0x55bb9bb420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 --2- 172.21.15.167:0/3881630931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb420e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3250032b80 tx=0x7f3258006000 comp rx=0 tx=0).stop 2023-10-05T19:52:51.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 -- 172.21.15.167:0/3881630931 shutdown_connections 2023-10-05T19:52:51.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 --2- 172.21.15.167:0/3881630931 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb420e0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 -- 172.21.15.167:0/3881630931 >> 172.21.15.167:0/3881630931 conn(0x55bb9bb3d0d0 msgr2=0x55bb9bb3b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:51.214 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 -- 172.21.15.167:0/3881630931 shutdown_connections 2023-10-05T19:52:51.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 -- 172.21.15.167:0/3881630931 wait complete. 2023-10-05T19:52:51.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 Processor -- start 2023-10-05T19:52:51.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 -- start start 2023-10-05T19:52:51.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.215 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f3261344e40 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb9bb487a0 con 0x55bb9bb41d10 2023-10-05T19:52:51.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f325e678700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f325e678700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.167:48406/0 (socket says 172.21.15.167:48406) 2023-10-05T19:52:51.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f325e678700 1 -- 172.21.15.167:0/2133838169 learned_addr learned my addr 172.21.15.167:0/2133838169 (peer_addr_for_me v2:172.21.15.167:0/0) 2023-10-05T19:52:51.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f325e678700 1 -- 172.21.15.167:0/2133838169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258004b00 con 0x55bb9bb41d10 2023-10-05T19:52:51.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.209+0000 7f325e678700 1 --2- 172.21.15.167:0/2133838169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb477a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f325803a040 tx=0x7f3258036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.216 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f31a9ffb700 1 -- 172.21.15.167:0/2133838169 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f325801a040 con 0x55bb9bb41d10 2023-10-05T19:52:51.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f3261344e40 1 -- 172.21.15.167:0/2133838169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bb9bb47da0 con 0x55bb9bb41d10 2023-10-05T19:52:51.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f31a9ffb700 1 -- 172.21.15.167:0/2133838169 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325802cb90 con 0x55bb9bb41d10 2023-10-05T19:52:51.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f31a9ffb700 1 -- 172.21.15.167:0/2133838169 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f325802cd40 con 0x55bb9bb41d10 2023-10-05T19:52:51.217 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f3261344e40 1 -- 172.21.15.167:0/2133838169 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb9bb481e0 con 0x55bb9bb41d10 2023-10-05T19:52:51.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f31a9ffb700 1 -- 172.21.15.167:0/2133838169 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f3258011410 con 0x55bb9bb41d10 2023-10-05T19:52:51.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f31a9ffb700 1 --2- 172.21.15.167:0/2133838169 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f319c030bb0 0x7f319c033060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:52:51.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f31a9ffb700 1 -- 172.21.15.167:0/2133838169 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f3258027040 con 0x55bb9bb41d10 2023-10-05T19:52:51.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f325f67a700 1 --2- 172.21.15.167:0/2133838169 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f319c030bb0 0x7f319c033060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:52:51.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f3261344e40 5 note: GC not initialized 2023-10-05T19:52:51.218 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f325f67a700 1 --2- 172.21.15.167:0/2133838169 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f319c030bb0 0x7f319c033060 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55bb9bb375b0 tx=0x7f324800e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:52:51.219 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.213+0000 7f31a2ffd700 20 reqs_thread_entry: start 2023-10-05T19:52:51.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f31a0ff9700 20 reqs_thread_entry: start 2023-10-05T19:52:51.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 20 init_complete bucket index max shards: 11 2023-10-05T19:52:51.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 rgw notify: Started notification manager with: 1 workers 2023-10-05T19:52:51.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f318effd700 20 rgw notify: INFO: next queues processing will happen at: Thu Oct 5 19:53:21 2023 2023-10-05T19:52:51.220 INFO:teuthology.orchestra.run.smithi167.stderr: 2023-10-05T19:52:51.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f318e7fc700 20 reqs_thread_entry: start 2023-10-05T19:52:51.220 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 20 get_system_obj_state: rctx=0x7fff0a78bf38 obj=default.rgw.meta:users.uid:ada state=0x55bb9b9c40b0 s->prefetch_data=0 2023-10-05T19:52:51.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2023-10-05T19:52:51.221 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:102 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bbaffb0 con 0x55bb9ba616e0 2023-10-05T19:52:51.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 32 ==== osd_op_reply(102 ada [call,getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2023-10-05T19:52:51.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2023-10-05T19:52:51.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 20 get_system_obj_state: rctx=0x7fff0a78bc28 obj=default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W state=0x55bb9b9c40b0 s->prefetch_data=0 2023-10-05T19:52:51.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2023-10-05T19:52:51.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:103 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bbaffb0 con 0x55bb9ba616e0 2023-10-05T19:52:51.222 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 33 ==== osd_op_reply(103 MH1WC2XQ1S8UISFDZC8W [getxattrs,stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2023-10-05T19:52:51.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2023-10-05T19:52:51.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 20 get_system_obj_state: rctx=0x7fff0a78b4c8 obj=default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W state=0x55bb9b9c40b0 s->prefetch_data=0 2023-10-05T19:52:51.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2023-10-05T19:52:51.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 20 get_system_obj_state: rctx=0x7fff0a78bb68 obj=default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W state=0x55bb9b9c40b0 s->prefetch_data=0 2023-10-05T19:52:51.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2023-10-05T19:52:51.223 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:104 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~439 in=439b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bbb2a40 con 0x55bb9ba616e0 2023-10-05T19:52:51.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 34 ==== osd_op_reply(104 ada [delete,create,call,writefull 0~439] v32'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2023-10-05T19:52:51.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2023-10-05T19:52:51.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2023-10-05T19:52:51.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.217+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [notify cookie 94264259974784 in=627b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bbb3550 con 0x55bb9bb24560 2023-10-05T19:52:51.224 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 32 ==== watch-notify(notify (1) cookie 94264259448976 notify 137438953519 ret 0) v3 ==== 657+0+0 (crc 0 0 0) 0x55bb9bb17520 con 0x55bb9bb24560 2023-10-05T19:52:51.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f325ce75700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953519 cookie 94264259448976 notifier 4805 bl.length()=615 2023-10-05T19:52:51.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 33 ==== osd_op_reply(105 notify.4 [notify cookie 94264259974784 out=8b] v0'0 uv270 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f325ce75700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2023-10-05T19:52:51.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f325ce75700 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2023-10-05T19:52:51.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f325ce75700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:106 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3244003d90 con 0x55bb9bb24560 2023-10-05T19:52:51.225 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 34 ==== osd_op_reply(106 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 35 ==== watch-notify(notify_complete (2) cookie 94264259974784 notify 137438953519 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55bb9bb17080 con 0x55bb9bb24560 2023-10-05T19:52:51.226 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:107 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bbb3550 con 0x55bb9ba616e0 2023-10-05T19:52:51.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 35 ==== osd_op_reply(107 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'21 uv21 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f3261344e40 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2023-10-05T19:52:51.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f3261344e40 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2023-10-05T19:52:51.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f3261344e40 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2023-10-05T19:52:51.227 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.221+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [notify cookie 94264259981408 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bbb34b0 con 0x55bb9bb24560 2023-10-05T19:52:51.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.225+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 36 ==== watch-notify(notify (1) cookie 94264259446128 notify 137438953520 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55bb9bb17080 con 0x55bb9bb24560 2023-10-05T19:52:51.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.225+0000 7f325ce75700 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953520 cookie 94264259446128 notifier 4805 bl.length()=177 2023-10-05T19:52:51.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.225+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 37 ==== osd_op_reply(108 notify.2 [notify cookie 94264259981408 out=8b] v0'0 uv270 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.225+0000 7f325ce75700 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2023-10-05T19:52:51.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.225+0000 7f325ce75700 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2023-10-05T19:52:51.228 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.225+0000 7f325ce75700 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:109 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f3244003d90 con 0x55bb9bb24560 2023-10-05T19:52:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.225+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 38 ==== osd_op_reply(109 notify.2 [notify-ack] v0'0 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.229 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.225+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 39 ==== watch-notify(notify_complete (2) cookie 94264259981408 notify 137438953520 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55bb9ba62890 con 0x55bb9bb24560 2023-10-05T19:52:51.229 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2023-10-05T19:52:51.229 INFO:teuthology.orchestra.run.smithi167.stdout: "user_id": "ada", 2023-10-05T19:52:51.229 INFO:teuthology.orchestra.run.smithi167.stdout: "display_name": "Ms. Admin User", 2023-10-05T19:52:51.229 INFO:teuthology.orchestra.run.smithi167.stdout: "email": "", 2023-10-05T19:52:51.229 INFO:teuthology.orchestra.run.smithi167.stdout: "suspended": 0, 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: "max_buckets": 0, 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: "subusers": [], 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: "keys": [ 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: "user": "ada", 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: "access_key": "MH1WC2XQ1S8UISFDZC8W", 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: "secret_key": "dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG" 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: "swift_keys": [], 2023-10-05T19:52:51.230 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": [ 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "buckets", 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: "perm": "*" 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "info", 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: "perm": "read" 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "ratelimit", 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: "perm": "*" 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:51.231 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "usage", 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: "perm": "*" 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "users", 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: "perm": "*" 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: { 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "zone", 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: "perm": "*" 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: } 2023-10-05T19:52:51.232 INFO:teuthology.orchestra.run.smithi167.stdout: ], 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "op_mask": "read, write, delete", 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "default_placement": "", 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "default_storage_class": "", 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "placement_tags": [], 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "bucket_quota": { 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:51.233 INFO:teuthology.orchestra.run.smithi167.stdout: "user_quota": { 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: "enabled": false, 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: "check_on_raw": false, 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size": -1, 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: "max_size_kb": 0, 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: "max_objects": -1 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: "temp_url_keys": [], 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "rgw", 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: "mfa_ids": [] 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout:} 2023-10-05T19:52:51.234 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-10-05T19:52:51.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.225+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:110 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94264259431616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb06710 con 0x55bb9bb24560 2023-10-05T19:52:51.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.229+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 40 ==== osd_op_reply(110 notify.0 [watch unwatch cookie 94264259431616] v32'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.235 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.229+0000 7f3261344e40 20 remove_watcher() i=0 2023-10-05T19:52:51.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.229+0000 7f3261344e40 2 removed watcher, disabling cache 2023-10-05T19:52:51.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.229+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:111 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94264259442448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb06710 con 0x55bb9ba616e0 2023-10-05T19:52:51.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.229+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 36 ==== osd_op_reply(111 notify.1 [watch unwatch cookie 94264259442448] v32'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.229+0000 7f3261344e40 20 remove_watcher() i=1 2023-10-05T19:52:51.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.229+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:112 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94264259446128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb06710 con 0x55bb9bb24560 2023-10-05T19:52:51.236 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.233+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 41 ==== osd_op_reply(112 notify.2 [watch unwatch cookie 94264259446128] v32'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.233+0000 7f3261344e40 20 remove_watcher() i=2 2023-10-05T19:52:51.237 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.233+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:113 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94264259447232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb06710 con 0x7f3250007030 2023-10-05T19:52:51.238 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.233+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 19 ==== osd_op_reply(113 notify.3 [watch unwatch cookie 94264259447232] v32'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.233+0000 7f3261344e40 20 remove_watcher() i=3 2023-10-05T19:52:51.239 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.233+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] -- osd_op(unknown.0.0:114 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94264259448976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb06710 con 0x55bb9bb24560 2023-10-05T19:52:51.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.237+0000 7f325ee79700 1 -- 172.21.15.167:0/498180932 <== osd.0 v2:172.21.15.118:6800/26580 42 ==== osd_op_reply(114 notify.4 [watch unwatch cookie 94264259448976] v32'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3250064040 con 0x55bb9bb24560 2023-10-05T19:52:51.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.237+0000 7f3261344e40 20 remove_watcher() i=4 2023-10-05T19:52:51.241 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.237+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:115 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94264259451696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb06710 con 0x55bb9bb294e0 2023-10-05T19:52:51.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.237+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 22 ==== osd_op_reply(115 notify.5 [watch unwatch cookie 94264259451696] v32'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.243 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.237+0000 7f3261344e40 20 remove_watcher() i=5 2023-10-05T19:52:51.244 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.237+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] -- osd_op(unknown.0.0:116 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94264259456480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb06710 con 0x55bb9bb294e0 2023-10-05T19:52:51.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.241+0000 7f325e678700 1 -- 172.21.15.167:0/498180932 <== osd.3 v2:172.21.15.167:6800/26773 23 ==== osd_op_reply(116 notify.6 [watch unwatch cookie 94264259456480] v32'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f325801d040 con 0x55bb9bb294e0 2023-10-05T19:52:51.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.241+0000 7f3261344e40 20 remove_watcher() i=6 2023-10-05T19:52:51.246 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.241+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] -- osd_op(unknown.0.0:117 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94264259459632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb06710 con 0x7f3250007030 2023-10-05T19:52:51.247 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.245+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.2 v2:172.21.15.167:6816/26774 20 ==== osd_op_reply(117 notify.7 [watch unwatch cookie 94264259459632] v32'272 uv270 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3248033040 con 0x7f3250007030 2023-10-05T19:52:51.248 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.245+0000 7f3261344e40 20 remove_watcher() i=7 2023-10-05T19:52:51.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.245+0000 7f31abfff700 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T19:52:51.249 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.245+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 --> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] -- osd_op(unknown.0.0:118 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94264259460736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55bb9bb06710 con 0x55bb9ba616e0 2023-10-05T19:52:51.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.245+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 <== osd.1 v2:172.21.15.167:6808/26775 37 ==== osd_op_reply(118 data_loggenerations_metadata [watch unwatch cookie 94264259460736] v32'260 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3248033040 con 0x55bb9ba616e0 2023-10-05T19:52:51.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bb9bb24560 msgr2=0x55bb9bb26940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.118:6800/26580,v1:172.21.15.118:6801/26580] conn(0x55bb9bb24560 0x55bb9bb26940 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bb9ba616e0 msgr2=0x55bb9bb22630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6808/26775,v1:172.21.15.167:6809/26775] conn(0x55bb9ba616e0 0x55bb9bb22630 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3250007030 msgr2=0x7f3250026400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6816/26774,v1:172.21.15.167:6817/26774] conn(0x7f3250007030 0x7f3250026400 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.252 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bb9bb294e0 msgr2=0x55bb9bb2b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6800/26773,v1:172.21.15.167:6801/26773] conn(0x55bb9bb294e0 0x55bb9bb2b8c0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3240030c50 msgr2=0x7f3240033100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f3240030c50 0x7f3240033100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3258001560 tx=0x7f3258006650 comp rx=0 tx=0).stop 2023-10-05T19:52:51.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f325f67a700 1 -- 172.21.15.167:0/498180932 reap_dead start 2023-10-05T19:52:51.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 msgr2=0x55bb9bb16b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.253 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb16b40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f325001e040 tx=0x7f325001c000 comp rx=0 tx=0).stop 2023-10-05T19:52:51.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 shutdown_connections 2023-10-05T19:52:51.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/498180932 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9ba60dd0 0x55bb9bb16b40 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 >> 172.21.15.167:0/498180932 conn(0x55bb9ba604e0 msgr2=0x55bb9bb0a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:51.254 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 shutdown_connections 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/498180932 wait complete. 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/2133838169 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f319c030bb0 msgr2=0x7f319c033060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/2133838169 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f319c030bb0 0x7f319c033060 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55bb9bb375b0 tx=0x7f324800e040 comp rx=0 tx=0).stop 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/2133838169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 msgr2=0x55bb9bb477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/2133838169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb477a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f325803a040 tx=0x7f3258036000 comp rx=0 tx=0).stop 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/2133838169 shutdown_connections 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/2133838169 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f319c030bb0 0x7f319c033060 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 --2- 172.21.15.167:0/2133838169 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55bb9bb41d10 0x55bb9bb477a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/2133838169 >> 172.21.15.167:0/2133838169 conn(0x55bb9bb3d0d0 msgr2=0x55bb9bb3b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/2133838169 shutdown_connections 2023-10-05T19:52:51.255 INFO:teuthology.orchestra.run.smithi167.stderr:2023-10-05T19:52:51.249+0000 7f3261344e40 1 -- 172.21.15.167:0/2133838169 wait complete. 2023-10-05T19:52:51.260 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.260 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.260 ERROR:root:0 2023-10-05T19:52:51.261 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.268 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'RequestId': 'tx00000515b6e1c4dc7c3c9-00651f1413-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:52:51.268 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2023-10-05T19:52:51.286 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.286 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2023-10-05T19:52:51.313 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2023-10-05T19:52:51.314 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2023-10-05T19:52:51.342 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2023-10-05T19:52:51.342 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2023-10-05T19:52:51.355 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2023-10-05T19:52:51.355 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.360 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.360 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2023-10-05T19:52:51.365 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2023-10-05T19:52:51.375 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.375 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.379 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.379 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2023-10-05T19:52:51.390 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.390 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.394 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.598 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2023-10-05T19:52:51.613 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}] 2023-10-05T19:52:51.613 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.618 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.618 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2023-10-05T19:52:51.630 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:52:51.630 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.634 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.634 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2023-10-05T19:52:51.647 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2023-10-05T19:52:51.647 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.651 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.651 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2023-10-05T19:52:51.665 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2023-10-05T19:52:51.665 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.670 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.671 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2023-10-05T19:52:51.685 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:52:51.685 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.690 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.690 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2023-10-05T19:52:51.698 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:52:51.699 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.703 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.703 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2023-10-05T19:52:51.716 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:52:51.716 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.721 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.721 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.727 INFO:tasks.radosgw_admin_rest: json result: [] 2023-10-05T19:52:51.728 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2023-10-05T19:52:51.733 INFO:tasks.radosgw_admin_rest: json result: [] 2023-10-05T19:52:51.751 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2023-10-05T19:52:51.756 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2023-10-05T19:52:51.756 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2023-10-05T19:52:51.761 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '62f730cc-f2d2-47e0-99d9-6d51a9a03581', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T19:52:51.745020Z', 'creation_time': '2023-10-05T19:52:51.738229Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T19:52:51.761 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2023-10-05T19:52:51.767 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '62f730cc-f2d2-47e0-99d9-6d51a9a03581', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T19:52:51.745020Z', 'creation_time': '2023-10-05T19:52:51.738229Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2023-10-05T19:52:51.775 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2023-10-05T19:52:51.781 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '62f730cc-f2d2-47e0-99d9-6d51a9a03581', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T19:52:51.745020Z', 'creation_time': '2023-10-05T19:52:51.738229Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T19:52:51.782 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2023-10-05T19:52:51.786 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'RequestId': 'tx000005c89af0bb46122fc-00651f1413-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:52:51.794 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2023-10-05T19:52:51.802 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:52:51.803 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2023-10-05T19:52:51.814 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:52:51.871 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9'} 2023-10-05T19:52:51.883 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:52:51.885 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9'} 2023-10-05T19:52:51.898 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:52:51.898 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2023-10-05T19:52:51.912 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:52:51.933 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2023-10-05T19:52:52.088 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:52:52.089 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2023-10-05T19:52:52.095 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'num_shards': 11, 'tenant': '', 'zonegroup': '62f730cc-f2d2-47e0-99d9-6d51a9a03581', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9', 'marker': 'e814e647-c2a9-43bf-96a6-1088a1b789e2.4231.9', 'index_type': 'Normal', 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-10-05T19:52:51.890249Z', 'creation_time': '2023-10-05T19:52:51.738229Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2023-10-05T19:53:52.190 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2023-10-05T19:53:52.222 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2023-10-05T19:53:52.222 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2023-10-05T19:53:52.251 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 215, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 231, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 215, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 223, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2023-10-05T19:53:52.252 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2023-10-05T19:53:52.258 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2023-10-05T19:53:52.258 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2023-10-05T19:53:52.264 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2023-10-05T19:53:52.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2023-10-05T19:53:52.270 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2023-10-05T19:53:52.270 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2023-10-05T19:53:52.276 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2023-10-05T19:53:52.276 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2023-10-05T19:53:52.281 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2023-10-05T19:00:00.000000Z', 'epoch': 1696532400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2023-10-05T19:53:52.281 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2023-10-05T19:53:52.291 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:53:52.291 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2023-10-05T19:53:52.297 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2023-10-05T19:53:52.298 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2023-10-05T19:53:52.312 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:53:52.316 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2023-10-05T19:53:52.330 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:53:52.634 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2023-10-05T19:53:52.639 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'RequestId': 'tx0000078811daa678296a2-00651f1450-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:52.849 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2023-10-05T19:53:52.855 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'email': '', 'permission': {'flags': 15}, 'name': 'Foo', 'group': 0, 'url_spec': ''}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2023-10-05T19:53:52.864 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2023-10-05T19:53:52.870 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'id': '', 'email': '', 'permission': {'flags': 1}, 'name': '', 'group': 1, 'url_spec': ''}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'email': '', 'permission': {'flags': 15}, 'name': 'Foo', 'group': 0, 'url_spec': ''}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2023-10-05T19:53:52.987 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2023-10-05T19:53:53.060 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:53:53.060 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2023-10-05T19:53:53.068 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2023-10-05T19:53:53.068 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2023-10-05T19:53:53.076 INFO:tasks.radosgw_admin_rest: json result: [] 2023-10-05T19:53:53.091 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2023-10-05T19:53:53.095 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'RequestId': 'tx00000aecbb0d1c25f118a-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.106 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2023-10-05T19:53:53.168 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:53:53.169 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-10-05T19:53:53.174 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'RequestId': 'tx0000014813b3d0eabad50-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.174 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2023-10-05T19:53:53.178 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '3d9357fa-146c-4f86-b124-205784953dac'}]}} 2023-10-05T19:53:53.178 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2023-10-05T19:53:53.196 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': 'false', 'admin': 'false', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-10-05T19:53:53.196 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2023-10-05T19:53:53.201 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2023-10-05T19:53:53.201 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2023-10-05T19:53:53.206 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'RequestId': 'tx000007d9fb7190adec2f9-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.206 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2023-10-05T19:53:53.209 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'RequestId': 'tx0000073d06e6822c0e119-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.226 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2023-10-05T19:53:53.230 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2023-10-05T19:53:53.230 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2023-10-05T19:53:53.237 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'RequestId': 'tx000007cb8932580a88183-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.237 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2023-10-05T19:53:53.241 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'RequestId': 'tx00000c394ae111e105d04-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.242 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2023-10-05T19:53:53.246 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2023-10-05T19:53:53.246 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2023-10-05T19:53:53.250 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'RequestId': 'tx0000046bea8a5036a7ddb-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.250 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2023-10-05T19:53:53.254 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'RequestId': 'tx00000054411abdab8251f-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.254 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2023-10-05T19:53:53.258 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'RequestId': 'tx0000061855f8a7072e829-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.258 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2023-10-05T19:53:53.262 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'RequestId': 'tx000004fe8a045a3433d26-00651f1451-1085-default', 'HostId': '1085-default-default'} 2023-10-05T19:53:53.262 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2023-10-05T19:53:53.278 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:53:53.278 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2023-10-05T19:53:53.282 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2023-10-05T19:53:53.283 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2023-10-05T19:53:53.291 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:53:53.291 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2023-10-05T19:53:53.295 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2023-10-05T19:53:53.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2023-10-05T19:53:53.302 INFO:tasks.radosgw_admin_rest: empty result 2023-10-05T19:53:53.306 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2023-10-05T19:53:53.316 DEBUG:tasks.rgw.client.0:waiting for process to exit 2023-10-05T19:53:53.316 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T19:53:53.317 INFO:tasks.rgw.client.0.smithi167.stdout:2023-10-05T19:53:53.311+0000 7f54c8f49700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 27332) UID: 0 2023-10-05T19:53:53.317 INFO:tasks.rgw.client.0.smithi167.stdout:2023-10-05T19:53:53.311+0000 7f54ccc28e40 -1 shutting down 2023-10-05T19:53:57.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2023-10-05T19:53:59.418 INFO:tasks.rgw.client.0:Stopped 2023-10-05T19:53:59.418 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2023-10-05T19:53:59.425 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/vault-root-token 2023-10-05T19:53:59.483 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-05T19:53:59.492 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-05T19:53:59.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T19:53:59.609 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.602+0000 7f226b59e700 1 Processor -- start 2023-10-05T19:53:59.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.602+0000 7f226b59e700 1 -- start start 2023-10-05T19:53:59.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.602+0000 7f226b59e700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f226c093800 0x7f226c093bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:53:59.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c092a60 con 0x7f226c091380 2023-10-05T19:53:59.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c093330 con 0x7f226c093800 2023-10-05T19:53:59.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f2269d9b700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f226c091380 0x7f226c091790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:53798/0 (socket says 172.21.15.118:53798) 2023-10-05T19:53:59.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f2269d9b700 1 -- 172.21.15.118:0/2478084491 learned_addr learned my addr 172.21.15.118:0/2478084491 (peer_addr_for_me v1:172.21.15.118:0/0) 2023-10-05T19:53:59.610 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226a59c700 1 --2- 172.21.15.118:0/2478084491 >> v2:172.21.15.118:3300/0 conn(0x7f226c093800 0x7f226c093bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:53:59.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226959a700 1 -- 172.21.15.118:0/2478084491 <== mon.0 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311278424 0 0) 0x7f226c092a60 con 0x7f226c091380 2023-10-05T19:53:59.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226959a700 1 -- 172.21.15.118:0/2478084491 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2258003570 con 0x7f226c091380 2023-10-05T19:53:59.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226a59c700 1 -- 172.21.15.118:0/2478084491 >> v1:172.21.15.118:6789/0 conn(0x7f226c091380 legacy=0x7f226c091790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:53:59.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226959a700 1 -- 172.21.15.118:0/2478084491 <== mon.0 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3287048050 0 0) 0x7f2258003570 con 0x7f226c091380 2023-10-05T19:53:59.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226a59c700 1 -- 172.21.15.118:0/2478084491 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c092fb0 con 0x7f226c093800 2023-10-05T19:53:59.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226a59c700 1 --2- 172.21.15.118:0/2478084491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c093800 0x7f226c093bd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f225c009850 tx=0x7f225c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68c6f6ec1a11d97 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:53:59.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226959a700 1 -- 172.21.15.118:0/2478084491 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2254001930 con 0x7f226c093800 2023-10-05T19:53:59.612 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226959a700 1 -- 172.21.15.118:0/2478084491 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c011630 con 0x7f226c093800 2023-10-05T19:53:59.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226959a700 1 -- 172.21.15.118:0/2478084491 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f225c0117a0 con 0x7f226c093800 2023-10-05T19:53:59.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 -- 172.21.15.118:0/2478084491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c093800 msgr2=0x7f226c093bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:53:59.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 --2- 172.21.15.118:0/2478084491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c093800 0x7f226c093bd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f225c009850 tx=0x7f225c009120 comp rx=0 tx=0).stop 2023-10-05T19:53:59.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 -- 172.21.15.118:0/2478084491 shutdown_connections 2023-10-05T19:53:59.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 --2- 172.21.15.118:0/2478084491 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c093800 0x7f226c093bd0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:53:59.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 -- 172.21.15.118:0/2478084491 >> 172.21.15.118:0/2478084491 conn(0x7f226c096ac0 msgr2=0x7f226c096ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:53:59.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 -- 172.21.15.118:0/2478084491 shutdown_connections 2023-10-05T19:53:59.613 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 -- 172.21.15.118:0/2478084491 wait complete. 2023-10-05T19:53:59.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 Processor -- start 2023-10-05T19:53:59.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 -- start start 2023-10-05T19:53:59.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.606+0000 7f226b59e700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c091380 0x7f226c1377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:53:59.614 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f226b59e700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c06e8d0 con 0x7f226c091380 2023-10-05T19:53:59.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f226a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c091380 0x7f226c1377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:53:59.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f226a59c700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c091380 0x7f226c1377c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58966/0 (socket says 172.21.15.118:58966) 2023-10-05T19:53:59.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f226a59c700 1 -- 172.21.15.118:0/3748883268 learned_addr learned my addr 172.21.15.118:0/3748883268 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:53:59.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f226a59c700 1 -- 172.21.15.118:0/3748883268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0093c0 con 0x7f226c091380 2023-10-05T19:53:59.615 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f226a59c700 1 --2- 172.21.15.118:0/3748883268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c091380 0x7f226c1377c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f226c093470 tx=0x7f225c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:53:59.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f22627fc700 1 -- 172.21.15.118:0/3748883268 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f225c01a450 con 0x7f226c091380 2023-10-05T19:53:59.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f22627fc700 1 -- 172.21.15.118:0/3748883268 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c01a5f0 con 0x7f226c091380 2023-10-05T19:53:59.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c08f720 con 0x7f226c091380 2023-10-05T19:53:59.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f22627fc700 1 -- 172.21.15.118:0/3748883268 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f225c01a7a0 con 0x7f226c091380 2023-10-05T19:53:59.616 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c137d00 con 0x7f226c091380 2023-10-05T19:53:59.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f22627fc700 1 -- 172.21.15.118:0/3748883268 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f225c01a990 con 0x7f226c091380 2023-10-05T19:53:59.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c11f0e0 con 0x7f226c091380 2023-10-05T19:53:59.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f22627fc700 1 --2- 172.21.15.118:0/3748883268 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f224c0323e0 0x7f224c034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:53:59.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f22627fc700 1 -- 172.21.15.118:0/3748883268 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f225c045e10 con 0x7f226c091380 2023-10-05T19:53:59.617 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.610+0000 7f2269d9b700 1 --2- 172.21.15.118:0/3748883268 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f224c0323e0 0x7f224c034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:53:59.618 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.614+0000 7f2269d9b700 1 --2- 172.21.15.118:0/3748883268 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f224c0323e0 0x7f224c034890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2254007fd0 tx=0x7f2254007cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:53:59.621 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.618+0000 7f22627fc700 1 -- 172.21.15.118:0/3748883268 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f226c11f0e0 con 0x7f226c091380 2023-10-05T19:53:59.782 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.778+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f226c11f0e0 con 0x7f226c091380 2023-10-05T19:53:59.784 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.778+0000 7f22627fc700 1 -- 172.21.15.118:0/3748883268 <== mon.0 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18787 (secure 0 0 0) 0x7f226c11f0e0 con 0x7f226c091380 2023-10-05T19:53:59.785 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-10-05T19:53:59.785 INFO:teuthology.orchestra.run.smithi118.stdout:{"epoch":32,"fsid":"3d9357fa-146c-4f86-b124-205784953dac","created":"2023-10-05T19:49:54.360690+0000","modified":"2023-10-05T19:51:00.382406+0000","last_up_change":"2023-10-05T19:49:58.460378+0000","last_in_change":"2023-10-05T19:49:55.451738+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-05T19:49:58.615025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-05T19:50:03.270780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2023-10-05T19:50:11.583611+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2023-10-05T19:50:13.973841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":".rgw.root","create_time":"2023-10-05T19:50:15.736371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2023-10-05T19:50:17.785269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2023-10-05T19:50:19.667460+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2023-10-05T19:50:21.859078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"c3f11994-670e-4caa-8693-e9021d7bd47f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":26580},{"type":"v1","addr":"172.21.15.118:6801","nonce":26580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":26580},{"type":"v1","addr":"172.21.15.118:6803","nonce":26580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":26580},{"type":"v1","addr":"172.21.15.118:6807","nonce":26580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":26580},{"type":"v1","addr":"172.21.15.118:6805","nonce":26580}]},"public_addr":"172.21.15.118:6801/26580","cluster_addr":"172.21.15.118:6803/26580","heartbeat_back_addr":"172.21.15.118:6807/26580","heartbeat_front_addr":"172.21.15.118:6805/26580","state":["exists","up"]},{"osd":1,"uuid":"b60451bf-0be1-4f42-8ac8-59e525b1ed5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":26775},{"type":"v1","addr":"172.21.15.167:6809","nonce":26775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":26775},{"type":"v1","addr":"172.21.15.167:6811","nonce":26775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":26775},{"type":"v1","addr":"172.21.15.167:6815","nonce":26775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":26775},{"type":"v1","addr":"172.21.15.167:6813","nonce":26775}]},"public_addr":"172.21.15.167:6809/26775","cluster_addr":"172.21.15.167:6811/26775","heartbeat_back_addr":"172.21.15.167:6815/26775","heartbeat_front_addr":"172.21.15.167:6813/26775","state":["exists","up"]},{"osd":2,"uuid":"38ec3ae8-cc65-4596-b2f0-996cd54b59a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":26774},{"type":"v1","addr":"172.21.15.167:6817","nonce":26774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":26774},{"type":"v1","addr":"172.21.15.167:6819","nonce":26774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":26774},{"type":"v1","addr":"172.21.15.167:6823","nonce":26774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":26774},{"type":"v1","addr":"172.21.15.167:6821","nonce":26774}]},"public_addr":"172.21.15.167:6817/26774","cluster_addr":"172.21.15.167:6819/26774","heartbeat_back_addr":"172.21.15.167:6823/26774","heartbeat_front_addr":"172.21.15.167:6821/26774","state":["exists","up"]},{"osd":3,"uuid":"840e7308-39d6-4524-ac13-f91a77125e7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":26773},{"type":"v1","addr":"172.21.15.167:6801","nonce":26773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":26773},{"type":"v1","addr":"172.21.15.167:6803","nonce":26773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":26773},{"type":"v1","addr":"172.21.15.167:6807","nonce":26773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":26773},{"type":"v1","addr":"172.21.15.167:6805","nonce":26773}]},"public_addr":"172.21.15.167:6801/26773","cluster_addr":"172.21.15.167:6803/26773","heartbeat_back_addr":"172.21.15.167:6807/26773","heartbeat_front_addr":"172.21.15.167:6805/26773","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.583291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.564146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.533170+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T19:49:56.558782+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":3,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.28","mappings":[{"from":0,"to":2}]},{"pgid":"4.2b","mappings":[{"from":0,"to":2}]},{"pgid":"5.13","mappings":[{"from":1,"to":2}]},{"pgid":"6.3","mappings":[{"from":0,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T19:53:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f224c0323e0 msgr2=0x7f224c034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:53:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 --2- 172.21.15.118:0/3748883268 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f224c0323e0 0x7f224c034890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2254007fd0 tx=0x7f2254007cf0 comp rx=0 tx=0).stop 2023-10-05T19:53:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c091380 msgr2=0x7f226c1377c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:53:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 --2- 172.21.15.118:0/3748883268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c091380 0x7f226c1377c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f226c093470 tx=0x7f225c016000 comp rx=0 tx=0).stop 2023-10-05T19:53:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 shutdown_connections 2023-10-05T19:53:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 --2- 172.21.15.118:0/3748883268 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f224c0323e0 0x7f224c034890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:53:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 --2- 172.21.15.118:0/3748883268 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f226c091380 0x7f226c1377c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:53:59.787 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 >> 172.21.15.118:0/3748883268 conn(0x7f226c096ac0 msgr2=0x7f226c06c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:53:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 shutdown_connections 2023-10-05T19:53:59.788 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.782+0000 7f226b59e700 1 -- 172.21.15.118:0/3748883268 wait complete. 2023-10-05T19:53:59.799 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-05T19:53:59.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f44564f2700 1 Processor -- start 2023-10-05T19:53:59.907 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f44564f2700 1 -- start start 2023-10-05T19:53:59.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f44564f2700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44500944e0 0x7f445012e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:53:59.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f44564f2700 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4450095710 con 0x7f4450093a00 2023-10-05T19:53:59.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f44564f2700 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4450095450 con 0x7f44500944e0 2023-10-05T19:53:59.908 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f4454cef700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44500944e0 0x7f445012e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:53:59.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f4454cef700 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44500944e0 0x7f445012e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58972/0 (socket says 172.21.15.118:58972) 2023-10-05T19:53:59.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f44554f0700 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f4450093a00 0x7f4450093dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:53806/0 (socket says 172.21.15.118:53806) 2023-10-05T19:53:59.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f4454cef700 1 -- 172.21.15.118:0/2758272735 learned_addr learned my addr 172.21.15.118:0/2758272735 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:53:59.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f4454cef700 1 -- 172.21.15.118:0/2758272735 >> v1:172.21.15.118:6789/0 conn(0x7f4450093a00 legacy=0x7f4450093dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:53:59.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f4454cef700 1 -- 172.21.15.118:0/2758272735 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500948b0 con 0x7f44500944e0 2023-10-05T19:53:59.909 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f4454cef700 1 --2- 172.21.15.118:0/2758272735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44500944e0 0x7f445012e2a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4444009930 tx=0x7f4444009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f6bea06edf3eef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:53:59.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f4443fff700 1 -- 172.21.15.118:0/2758272735 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f444400b860 con 0x7f44500944e0 2023-10-05T19:53:59.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f4443fff700 1 -- 172.21.15.118:0/2758272735 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444400b9c0 con 0x7f44500944e0 2023-10-05T19:53:59.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.902+0000 7f4443fff700 1 -- 172.21.15.118:0/2758272735 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f444400bc90 con 0x7f44500944e0 2023-10-05T19:53:59.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 -- 172.21.15.118:0/2758272735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44500944e0 msgr2=0x7f445012e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:53:59.910 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 --2- 172.21.15.118:0/2758272735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44500944e0 0x7f445012e2a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4444009930 tx=0x7f4444009250 comp rx=0 tx=0).stop 2023-10-05T19:53:59.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 -- 172.21.15.118:0/2758272735 shutdown_connections 2023-10-05T19:53:59.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 --2- 172.21.15.118:0/2758272735 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44500944e0 0x7f445012e2a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:53:59.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 -- 172.21.15.118:0/2758272735 >> 172.21.15.118:0/2758272735 conn(0x7f445009a1c0 msgr2=0x7f445009a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:53:59.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 -- 172.21.15.118:0/2758272735 shutdown_connections 2023-10-05T19:53:59.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 -- 172.21.15.118:0/2758272735 wait complete. 2023-10-05T19:53:59.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 Processor -- start 2023-10-05T19:53:59.911 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 -- start start 2023-10-05T19:53:59.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4450093a00 0x7f445008eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:53:59.912 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44500905d0 con 0x7f4450093a00 2023-10-05T19:53:59.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44554f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4450093a00 0x7f445008eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:53:59.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44554f0700 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4450093a00 0x7f445008eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:58976/0 (socket says 172.21.15.118:58976) 2023-10-05T19:53:59.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44554f0700 1 -- 172.21.15.118:0/258213137 learned_addr learned my addr 172.21.15.118:0/258213137 (peer_addr_for_me v2:172.21.15.118:0/0) 2023-10-05T19:53:59.913 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44554f0700 1 -- 172.21.15.118:0/258213137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44440094f0 con 0x7f4450093a00 2023-10-05T19:53:59.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44554f0700 1 --2- 172.21.15.118:0/258213137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4450093a00 0x7f445008eb90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f444c00c6c0 tx=0x7f444c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:53:59.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44417fa700 1 -- 172.21.15.118:0/258213137 <== mon.0 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f444c007320 con 0x7f4450093a00 2023-10-05T19:53:59.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44417fa700 1 -- 172.21.15.118:0/258213137 <== mon.0 v2:172.21.15.118:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c0074a0 con 0x7f4450093a00 2023-10-05T19:53:59.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4450092660 con 0x7f4450093a00 2023-10-05T19:53:59.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44417fa700 1 -- 172.21.15.118:0/258213137 <== mon.0 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f444c0057f0 con 0x7f4450093a00 2023-10-05T19:53:59.914 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.906+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44500917a0 con 0x7f4450093a00 2023-10-05T19:53:59.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.910+0000 7f44417fa700 1 -- 172.21.15.118:0/258213137 <== mon.0 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) v1 ==== 40329+0+0 (secure 0 0 0) 0x7f444c005a20 con 0x7f4450093a00 2023-10-05T19:53:59.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.910+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445005ecb0 con 0x7f4450093a00 2023-10-05T19:53:59.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.910+0000 7f44417fa700 1 --2- 172.21.15.118:0/258213137 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44340323e0 0x7f4434034890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-05T19:53:59.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.910+0000 7f44417fa700 1 -- 172.21.15.118:0/258213137 <== mon.0 v2:172.21.15.118:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6260+0+0 (secure 0 0 0) 0x7f444c044340 con 0x7f4450093a00 2023-10-05T19:53:59.915 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.910+0000 7f4454cef700 1 --2- 172.21.15.118:0/258213137 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44340323e0 0x7f4434034890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-05T19:53:59.916 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.910+0000 7f4454cef700 1 --2- 172.21.15.118:0/258213137 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44340323e0 0x7f4434034890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4444009930 tx=0x7f4444016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-05T19:53:59.924 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:53:59.918+0000 7f44417fa700 1 -- 172.21.15.118:0/258213137 <== mon.0 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166807 (secure 0 0 0) 0x7f444c0106d0 con 0x7f4450093a00 2023-10-05T19:54:00.086 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.082+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f445004b5c0 con 0x7f4450093a00 2023-10-05T19:54:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.086+0000 7f44417fa700 1 -- 172.21.15.118:0/258213137 <== mon.0 v2:172.21.15.118:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f444c0106d0 con 0x7f4450093a00 2023-10-05T19:54:00.092 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.086+0000 7f44417fa700 1 -- 172.21.15.118:0/258213137 <== mon.0 v2:172.21.15.118:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f444c01c390 con 0x7f4450093a00 2023-10-05T19:54:00.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44340323e0 msgr2=0x7f4434034890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:54:00.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 --2- 172.21.15.118:0/258213137 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44340323e0 0x7f4434034890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4444009930 tx=0x7f4444016000 comp rx=0 tx=0).stop 2023-10-05T19:54:00.095 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4450093a00 msgr2=0x7f445008eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-05T19:54:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 --2- 172.21.15.118:0/258213137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4450093a00 0x7f445008eb90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f444c00c6c0 tx=0x7f444c007ea0 comp rx=0 tx=0).stop 2023-10-05T19:54:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 shutdown_connections 2023-10-05T19:54:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 --2- 172.21.15.118:0/258213137 >> [v2:172.21.15.167:6824/26627,v1:172.21.15.167:6825/26627] conn(0x7f44340323e0 0x7f4434034890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:54:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 --2- 172.21.15.118:0/258213137 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4450093a00 0x7f445008eb90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-05T19:54:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 >> 172.21.15.118:0/258213137 conn(0x7f445009a1c0 msgr2=0x7f445006c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-05T19:54:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 shutdown_connections 2023-10-05T19:54:00.096 INFO:teuthology.orchestra.run.smithi118.stderr:2023-10-05T19:54:00.090+0000 7f44564f2700 1 -- 172.21.15.118:0/258213137 wait complete. 2023-10-05T19:54:00.108 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-05T19:54:00.108 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-05T19:54:00.108 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-05T19:54:00.108 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T19:54:00.128 INFO:tasks.ceph.osd.0:Stopped 2023-10-05T19:54:00.128 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-05T19:54:00.128 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T19:54:00.146 INFO:tasks.ceph.osd.1:Stopped 2023-10-05T19:54:00.146 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-05T19:54:00.147 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T19:54:00.160 INFO:tasks.ceph.osd.2:Stopped 2023-10-05T19:54:00.161 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-05T19:54:00.161 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T19:54:00.177 INFO:tasks.ceph.osd.3:Stopped 2023-10-05T19:54:00.177 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-05T19:54:00.178 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-05T19:54:00.178 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T19:54:00.201 INFO:tasks.ceph.mgr.x:Stopped 2023-10-05T19:54:00.201 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-05T19:54:00.201 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-05T19:54:00.201 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T19:54:00.221 INFO:tasks.ceph.mon.a:Stopped 2023-10-05T19:54:00.221 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-05T19:54:00.221 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-10-05T19:54:00.238 INFO:teuthology.orchestra.run.smithi118.stdout:1696535399.5626595 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T19:54:00.239 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-05T19:54:00.239 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-10-05T19:54:00.252 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-10-05T19:54:00.310 DEBUG:teuthology.orchestra.run.smithi118:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-10-05T19:54:00.322 INFO:teuthology.orchestra.run.smithi118.stdout:1696535399.5626595 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-05T19:54:00.323 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi118.front.sepia.ceph.com 2023-10-05T19:54:00.323 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-05T19:54:00.555 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T19:54:00.555 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-05T19:54:00.813 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T19:54:00.813 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-05T19:54:00.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T19:54:00.992 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-05T19:54:01.176 INFO:tasks.ceph:Archiving mon data... 2023-10-05T19:54:01.177 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765/data/mon.a.tgz 2023-10-05T19:54:01.177 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2023-10-05T19:54:01.184 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.jkOAMPi3qo 2023-10-05T19:54:01.184 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jkOAMPi3qo 2023-10-05T19:54:01.253 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.jkOAMPi3qo 2023-10-05T19:54:01.278 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.jkOAMPi3qo is 220KB 2023-10-05T19:54:01.340 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.jkOAMPi3qo 2023-10-05T19:54:01.345 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-05T19:54:01.345 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-05T19:54:01.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-05T19:54:01.364 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-05T19:54:01.364 DEBUG:teuthology.orchestra.run.smithi118:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-05T19:54:01.366 DEBUG:teuthology.orchestra.run.smithi167:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-05T19:54:01.392 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-05T19:54:01.394 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-05T19:54:01.399 INFO:tasks.ceph:Archiving crash dumps... 2023-10-05T19:54:01.401 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765/remote/smithi118/crash 2023-10-05T19:54:01.402 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-05T19:54:01.458 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765/remote/smithi167/crash 2023-10-05T19:54:01.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-05T19:54:01.474 INFO:tasks.ceph:Compressing logs... 2023-10-05T19:54:01.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T19:54:01.477 DEBUG:teuthology.orchestra.run.smithi167:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T19:54:02.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2023-10-05T19:54:04.384 INFO:tasks.ceph:Archiving logs... 2023-10-05T19:54:04.384 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765/remote/smithi118/log 2023-10-05T19:54:04.386 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T19:54:04.555 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765/remote/smithi167/log 2023-10-05T19:54:04.556 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T19:54:04.981 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-05T19:54:04.991 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-05T19:54:04.992 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T19:54:04.994 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T19:54:05.062 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-05T19:54:05.072 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-05T19:54:05.073 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T19:54:05.075 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T19:54:05.094 INFO:teuthology.orchestra.run.smithi118.stdout: remote refid st t when poll reach delay offset jitter 2023-10-05T19:54:05.094 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================== 2023-10-05T19:54:05.094 INFO:teuthology.orchestra.run.smithi118.stdout:*hv01.front.sepi 44.4.53.2 2 u 50 64 77 0.112 0.478 1.722 2023-10-05T19:54:05.094 INFO:teuthology.orchestra.run.smithi118.stdout:+hv02.front.sepi 63.231.80.2 3 u 52 64 77 0.122 -0.027 1.737 2023-10-05T19:54:05.094 INFO:teuthology.orchestra.run.smithi118.stdout:+hv03.front.sepi 74.6.168.72 3 u 49 64 77 0.091 0.119 1.088 2023-10-05T19:54:05.094 INFO:teuthology.orchestra.run.smithi118.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:54:05.098 INFO:teuthology.orchestra.run.smithi167.stdout: remote refid st t when poll reach delay offset jitter 2023-10-05T19:54:05.098 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================== 2023-10-05T19:54:05.098 INFO:teuthology.orchestra.run.smithi167.stdout:*hv01.front.sepi 44.4.53.2 2 u 52 64 77 0.080 0.333 2.114 2023-10-05T19:54:05.098 INFO:teuthology.orchestra.run.smithi167.stdout:+hv02.front.sepi 63.231.80.2 3 u 55 64 77 0.152 -0.200 2.018 2023-10-05T19:54:05.098 INFO:teuthology.orchestra.run.smithi167.stdout:+hv03.front.sepi 74.6.168.72 3 u 52 64 77 0.098 0.561 1.377 2023-10-05T19:54:05.098 INFO:teuthology.orchestra.run.smithi167.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-05T19:54:05.099 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-05T19:54:05.108 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-05T19:54:05.109 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-05T19:54:05.124 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-05T19:54:05.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-05T19:54:05.156 INFO:teuthology.task.internal:Duration was 728.941922 seconds 2023-10-05T19:54:05.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-05T19:54:05.176 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-05T19:54:05.177 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T19:54:05.179 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T19:54:05.229 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-05T19:54:05.229 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2023-10-05T19:54:05.229 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T19:54:05.242 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2023-10-05T19:54:05.242 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T19:54:05.257 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-05T19:54:05.257 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T19:54:05.259 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T19:54:05.284 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-05T19:54:05.285 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T19:54:05.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T19:54:05.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-05T19:54:05.399 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-05T19:54:05.399 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T19:54:05.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T19:54:05.431 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-05T19:54:05.445 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T19:54:05.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T19:54:05.471 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2023-10-05T19:54:05.474 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2023-10-05T19:54:05.503 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T19:54:05.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:54:05.509 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T19:54:05.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T19:54:05.549 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-05T19:54:05.561 INFO:teuthology.task.internal:Transferring archived files... 2023-10-05T19:54:05.562 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765/remote/smithi118 2023-10-05T19:54:05.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T19:54:05.585 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765/remote/smithi167 2023-10-05T19:54:05.585 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T19:54:05.608 INFO:teuthology.task.internal:Removing archive directory... 2023-10-05T19:54:05.608 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T19:54:05.611 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T19:54:05.618 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-05T19:54:05.632 INFO:teuthology.task.internal:Not uploading archives. 2023-10-05T19:54:05.632 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-05T19:54:05.646 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-05T19:54:05.646 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T19:54:05.648 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T19:54:05.654 INFO:teuthology.orchestra.run.smithi118.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 19:54 /home/ubuntu/cephtest 2023-10-05T19:54:05.670 INFO:teuthology.orchestra.run.smithi167.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 19:54 /home/ubuntu/cephtest 2023-10-05T19:54:05.674 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-05T19:54:05.688 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-05T19:54:05.718 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T19:54:05.746 DEBUG:teuthology.nuke:shortname: smithi118 2023-10-05T19:54:05.746 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T19:54:05.771 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 19:32:02.569276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-05T19:54:05.775 DEBUG:teuthology.nuke:shortname: smithi167 2023-10-05T19:54:05.775 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T19:54:05.793 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_14:30:58-rgw-wip-yuri2-testing-2023-10-04-1333-quincy-distro-default-smithi/7411765', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 19:32:02.567700', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-05T19:54:05.828 INFO:teuthology.orchestra.console.smithi118:Power off 2023-10-05T19:54:05.829 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T19:54:05.855 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-10-05T19:54:05.855 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T19:54:05.872 INFO:teuthology.orchestra.console.smithi167:Power off 2023-10-05T19:54:05.872 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T19:54:05.883 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-05T19:54:05.896 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-10-05T19:54:05.896 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T19:54:05.919 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-05T19:54:09.884 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T19:54:09.920 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T19:54:09.995 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-05T19:54:10.031 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-05T19:54:13.998 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T19:54:14.032 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T19:54:14.108 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-05T19:54:14.143 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-05T19:54:14.243 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-10-05T19:54:18.109 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T19:54:18.219 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-10-05T19:54:18.320 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-10-05T19:54:18.424 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 728.9419224262238 failure_reason: '"1696535399.5626595 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-05T19:54:18.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T19:54:18.496 INFO:teuthology.run:FAIL